chunking4rag 0.0.4

A small library to chunk large files into smaller arrays that can be used for generating RAG embeddings

chunking4rag

This repo will have various chunking strategies one can build in order to get best performance out of RAG framework The strategies discussed in this repo are:

1. Fixed length chunking

2. Keyword chunking

3. Adaptive chunking

4. Sliding window

5. Paragraph chunking

6. Sentence chunking

To install this library

Run the following command

pip install chunking4rag

To start with contribution to the project

1. Clone the repository using git

2. Create a virtual environment using uv

uv create chunking4rag

3. Activate the virtual environment

source .venv/bin/activate

4. Install the dependencies by running

uv install -r requirements.txt

5. Run tests to make sure everything is working fine

python chuking_tests.py