word-family-counter 0.1.0

A script for counting word families in a text file.

word_family_counter

A Python script for counting word families in a text file using advanced morphological analysis with spaCy.

Features

• Processes text files to count word families
• Uses spaCy for advanced linguistic analysis and lemmatization
• Handles contractions, compound words, and various text preprocessing tasks
• Supports multiple languages (depending on available spaCy models)
• Provides detailed output with word family frequencies

Installation

1. Clone the repository:

   git clone https://github.com/BlueBirdBack/word_family_counter.git
   cd word_family_counter
   

2. Create a virtual environment (optional but recommended):

   python -m venv venv
   source venv/bin/activate  # On Windows, use `venv\Scripts\activate`
   

3. Install the required dependencies:

   pip install -r requirements.txt
   

4. Download the spaCy language model:

   python -m spacy download en_core_web_sm
   

Usage

Run the script with a text file as an argument:

python src/word_family_counter/main.py path/to/your/text_file.txt

Optional arguments:

• --verbose: Increase output verbosity for debugging purposes
• --language: Specify the spaCy model to use (default: en_core_web_sm)

Example:

python src/word_family_counter/main.py sample.txt --verbose --language en_core_web_md

Output

The script will display:

1. Total number of words in the text
2. Total number of unique word families
3. A list of word families sorted by frequency (descending) and then alphabetically

License

This project is licensed under the MIT License. See the LICENSE file for details.

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

1. Fork the repository
2. Create your feature branch (git checkout -b feature/AmazingFeature)
3. Commit your changes (git commit -m 'Add some AmazingFeature')
4. Push to the branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

Contact

BlueBirdBack - [e-mail]

Project Link: https://github.com/BlueBirdBack/word_family_counter