RAG (Retrieval-Augmented Generation) System
Project description
RAG (Retrieval-Augmented Generation) System
A Python-based RAG system that processes text files, generates embeddings, and stores them in a Postgres database with pgvector for efficient similarity search.
For detailed information, see:
- Design Document - System architecture and requirements
- Developer Guide - Detailed setup and development instructions
Features
- File ingestion (source code, Markdown, plain text)
- Text chunking with configurable overlap
- Vector embeddings via OpenAI or Hugging Face
- Postgres + pgvector for vector storage and search
- Project-based organization of documents
Quick Start
- Set up the environment:
# Create and activate virtual environment
python -m venv venv
source venv/bin/activate
# Install dependencies
pip install -r requirements.txt
- Configure environment variables:
cp .env.example .env
# Edit .env with your settings:
# - Database credentials
# - OpenAI API key (if using OpenAI embeddings)
- Start the database:
task db:up
- Run the example:
task demo:example
Development
# Run tests
task test:integration
License
MIT License
Contributing
- Fork the repository
- Create a feature branch
- Commit your changes
- Push to the branch
- Create a Pull Request
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
postgres_rag-0.1.0.tar.gz
(9.8 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file postgres_rag-0.1.0.tar.gz.
File metadata
- Download URL: postgres_rag-0.1.0.tar.gz
- Upload date:
- Size: 9.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
416768ba8a833147f5770ca338d7f26d68dab52d0d8c181c4288e1f5680edd1b
|
|
| MD5 |
0131172a697b84b03eb06cc1fb1b20fd
|
|
| BLAKE2b-256 |
9a556d6c14ac216e3de27db68e354991a0f3a4d1d346943ad98bfe9b267bdaa8
|
File details
Details for the file postgres_rag-0.1.0-py3-none-any.whl.
File metadata
- Download URL: postgres_rag-0.1.0-py3-none-any.whl
- Upload date:
- Size: 12.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9061529788f51cc7c8d422f52d0c7db9dd7d5513179c9dca192af279f874d192
|
|
| MD5 |
28d81a87013b2b8ec77cec1e677d2456
|
|
| BLAKE2b-256 |
56f2d5e8d334d94720e7bd24e8e14e1a1077e3bb9bdfab9675d44697775094d1
|