Skip to main content

A small library to chunk large files into smaller arrays that can be used for generating RAG embeddings

Reason this release was yanked:

deprecated and old

Project description

chunking4rag

This repo will have various chunking strategies one can build in order to get best performance out of RAG framework

To install this library

Run the following command

pip install chunking4rag

To start with contribution to the project

  1. Clone the repository using git

  2. Create a virtual environment using uv

uv create chunking4rag
  1. Activate the virtual environment
uv activate chunking4rag
  1. Install the dependencies by running
uv install -r requirements.txt
  1. Run tests to make sure everything is working fine
python chuking_tests.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

chunking4rag-0.0.1.tar.gz (9.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

chunking4rag-0.0.1-py3-none-any.whl (11.2 kB view details)

Uploaded Python 3

File details

Details for the file chunking4rag-0.0.1.tar.gz.

File metadata

  • Download URL: chunking4rag-0.0.1.tar.gz
  • Upload date:
  • Size: 9.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.4.29

File hashes

Hashes for chunking4rag-0.0.1.tar.gz
Algorithm Hash digest
SHA256 699458bef7b404203d115b1dd1df2a3c2166effd914b432ca96be9c50c639c28
MD5 4c6d2a3351d45cd0c62b7f20b0192acc
BLAKE2b-256 9e970382da20beb0da23c1de81a93c4d59cefb968d826f2325d1f070eea8552f

See more details on using hashes here.

File details

Details for the file chunking4rag-0.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for chunking4rag-0.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 94914295c6a373b441285c3dcd48282f6c9d1d8284a8bedd4f119f504ccbe953
MD5 36d00c85767d407c14ebab4cc6e6167d
BLAKE2b-256 ea20fd1bdb1c2f33459957c52c3cd5415be20e6799ec266cc6397f2c31c1d35f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page