Sayou Chunking
Flexible text segmentation strategies for preprocessing large documents before embedding or RAG.
💡 Why Sayou Chunking?
sayou_chunking turns raw text into manageable, context-preserving chunks — a critical step for embedding pipelines and RAG.
- Multiple Strategies: Fixed-length, recursive, semantic, structure-based.
- LLM-Aware Chunking: Uses LLM cues to split logically.
- Interoperable: Produces DataAtoms usable by Sayou Refinery or Assembler.
🚀 Quick Start
pip install sayou-chunking
🏗️ Core Concepts
- Splitter: Defines the splitting strategy.
- Plugins: Extend chunking logic for domain-specific use cases.
📜 License
Apache 2.0 License © 2025 Sayouzone
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
sayou_chunking_dev-0.0.2.tar.gz
(12.7 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file sayou_chunking_dev-0.0.2.tar.gz.
File metadata
- Download URL: sayou_chunking_dev-0.0.2.tar.gz
- Upload date:
- Size: 12.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7842a37b9d97aab0e8caf446b51c36aa4c83f0b4cee7f4a1c2c0adc04ae1789e
|
|
| MD5 |
01e6e83d1f806e46adea4d0cb521dce3
|
|
| BLAKE2b-256 |
ebaa22b92c763e8160eda9ed6b1a9523f8c445ac2d2d308ab0659dcf0850d2f4
|
File details
Details for the file sayou_chunking_dev-0.0.2-py3-none-any.whl.
File metadata
- Download URL: sayou_chunking_dev-0.0.2-py3-none-any.whl
- Upload date:
- Size: 16.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e2099d5fc254b75517f11a422e9e6dbfc4332537238486b2c8c2f576139981e6
|
|
| MD5 |
fabd20e385eb35b89c3e12e7cb982d62
|
|
| BLAKE2b-256 |
babae2626ee5fa1f9c94f19dba84fd0239384e01e6b63119d4fb44793bfdd7f1
|
