Remove repeated words from wordlist

[ghost]

Description

I want to add a small program that removes repeated words from wordlist and create a new file(can also be overridden) with non-repeated words.

Type of issue

• [x] Feature (New Script)
• [ ] Bug
• [ ] Documentation

Checklist:

• [x] I have read the project guidelines.
• [x] I have checked all the existing projects, before submitting a new project issue.
• [x] I have checked previous issues to avoid duplicates.
• [x] This issue will be meaningful for the project.

[zealshah29]

Hello, can I work on this under the hactoberfest?

[munzzz5]

Hey there! would love to contribute to this issue!

There are a few ways i thought of implementing it so i will provide different function names to achieve the same take.

1. set creation from wordlist which can only hold unique values
2. use an efficient sorting algorithm and remving repeated values using two counter technique

Do share if you have more ideas, will work on them too!

Regards 😄

[ojasaklechayt]

I would like to contribute to this issue. It can be resolved by creating a set from the wordlist.

[dinezra11]

I would love to contribute to this issue! I can implement it with python or c++ if needed. I'm thinking about coding an implementation of a Hash Table that the program will fill with the words included in a text file, and as an output will create a new text file with all of the words without the duplicates.

[munzzz5]

@dinezra11 Haha, I asked this as my first contribution to open source. No replies. Are you on the same boat 😅

[dinezra11]

@dinezra11 Haha, I asked this as my first contribution to open source. No replies. Are you on the same boat 😅

hahaha yes! Trying to dive into the open source contribution world for the first time