Skip to main content

A RAG (Retrieval-Augmented Generation) library for document processing and retrieval.

Project description

insta_rag

insta_rag is a modular, plug-and-play Python library for building advanced Retrieval-Augmented Generation (RAG) pipelines. It abstracts the complexity of document processing, embedding, and hybrid retrieval into a simple, configuration-driven client.

Core Features

  • Semantic Chunking: Splits documents at natural topic boundaries to preserve context.
  • Hybrid Retrieval: Combines semantic vector search with BM25 keyword search for the best of both worlds.
  • Query Transformation (HyDE): Uses an LLM to generate hypothetical answers, improving retrieval relevance.
  • Reranking: Integrates with state-of-the-art rerankers like Cohere to intelligently re-order results.
  • Pluggable Architecture: Easily extend the library by adding new chunkers, embedders, or vector databases.
  • Hybrid Storage: Optional integration with MongoDB for cost-effective content storage, keeping Qdrant lean for vector search.

Quick Start

1. Installation

# Recommended: using uv
uv pip install insta-rag

# Or with pip
pip install insta-rag

2. Basic Usage

from insta_rag import RAGClient, RAGConfig, DocumentInput

# Load configuration from environment variables (.env file)
config = RAGConfig.from_env()
client = RAGClient(config)

# 1. Add documents to a collection
documents = [DocumentInput.from_text("Your first document content.")]
client.add_documents(documents, collection_name="my_docs")

# 2. Retrieve relevant information
response = client.retrieve(
    query="What is this document about?", collection_name="my_docs"
)

# Print the most relevant chunk
if response.chunks:
    print(response.chunks[0].content)

Documentation

For detailed guides on installation, configuration, and advanced features, please see the Full Documentation.

Key sections include:

License

This project is licensed under the MIT License.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

insta_rag-0.1.0b2.tar.gz (38.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

insta_rag-0.1.0b2-py3-none-any.whl (48.9 kB view details)

Uploaded Python 3

File details

Details for the file insta_rag-0.1.0b2.tar.gz.

File metadata

  • Download URL: insta_rag-0.1.0b2.tar.gz
  • Upload date:
  • Size: 38.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.9.4

File hashes

Hashes for insta_rag-0.1.0b2.tar.gz
Algorithm Hash digest
SHA256 74ad65c83dc8b12c51f3035fc0808deec5975b2d30ff34d8507b147d98b1652a
MD5 981bea468d0339bf3ccba442a6a1fbd0
BLAKE2b-256 baef1cd1bd1539cb6a0a1887691b5d1b46e717253f093db28765df8382bd581b

See more details on using hashes here.

File details

Details for the file insta_rag-0.1.0b2-py3-none-any.whl.

File metadata

File hashes

Hashes for insta_rag-0.1.0b2-py3-none-any.whl
Algorithm Hash digest
SHA256 c68fb3f98a8be1fc8485c452d65186a8279471769173df2efb415b99d8617bc7
MD5 17b4c27f15f41ce19d4d158cdebbd7f7
BLAKE2b-256 509554064df79cfc76b61568873c7551a71b63a3f5a779ea588045a6bf47d6a1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page