Skip to main content

A small library to chunk large files into smaller arrays that can be used for generating RAG embeddings

Project description

chunking4rag

This repo will have various chunking strategies one can build in order to get best performance out of RAG framework

To install this library

Run the following command

pip install chunking4rag

To start with contribution to the project

  1. Clone the repository using git

  2. Create a virtual environment using uv

uv create chunking4rag
  1. Activate the virtual environment
uv activate chunking4rag
  1. Install the dependencies by running
uv install -r requirements.txt
  1. Run tests to make sure everything is working fine
python chuking_tests.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

chunking4rag-0.0.3.tar.gz (9.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

chunking4rag-0.0.3-py3-none-any.whl (11.8 kB view details)

Uploaded Python 3

File details

Details for the file chunking4rag-0.0.3.tar.gz.

File metadata

  • Download URL: chunking4rag-0.0.3.tar.gz
  • Upload date:
  • Size: 9.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.4.29

File hashes

Hashes for chunking4rag-0.0.3.tar.gz
Algorithm Hash digest
SHA256 1f57e71ac25bd8097fa792dfa92845b3ffa42b93e147f60132a3c28aa635b005
MD5 f6b37012bfbd22852a647441325014bd
BLAKE2b-256 1d380a21f926a21f7284f7e262152cbe50c705161c22a4d61fd0c90762030f06

See more details on using hashes here.

File details

Details for the file chunking4rag-0.0.3-py3-none-any.whl.

File metadata

File hashes

Hashes for chunking4rag-0.0.3-py3-none-any.whl
Algorithm Hash digest
SHA256 bc4cfd731cae78de771734d722a67b752ada3cc0456e75ec2e1a863d7456ab91
MD5 1352edd5f3478b4853e12efcca6d432c
BLAKE2b-256 0d695f213d511a2e763dc48581775e22fb6ef5ae8cfb727c1b11be8e34e39167

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page