sayou-chunking 0.0.2

Chunking components for the Sayou Data Platform

Sayou Chunking

Flexible text segmentation strategies for preprocessing large documents before embedding or RAG.

---

💡 Why Sayou Chunking?

sayou_chunking turns raw text into manageable, context-preserving chunks — a critical step for embedding pipelines and RAG.

• Multiple Strategies: Fixed-length, recursive, semantic, structure-based.
• LLM-Aware Chunking: Uses LLM cues to split logically.
• Interoperable: Produces DataAtoms usable by Sayou Refinery or Assembler.

---

🚀 Quick Start

pip install sayou-chunking

🏗️ Core Concepts

• Splitter: Defines the splitting strategy.
• Plugins: Extend chunking logic for domain-specific use cases.

📜 License

Apache 2.0 License © 2025 Sayouzone