A modular RAG library with embeddings and vector store support
Project description
๐ง MyRAGProject
A lightweight, developer-friendly Retrieval-Augmented Generation (RAG) engine in Python.
This project allows you to ingest .txt files, generate embeddings, store them in Qdrant (a vector database), and later query them to build intelligent AI applications (like chatbots, document Q&A, etc.).
๐ฆ Features
- ๐ Smart chunking of input documents
- ๐ค Embedding generation via HuggingFace
- ๐ง Vector storage using Qdrant
- ๐ฌ Ready for question-answering and search
- ๐ Modular and easy to extend
๐๏ธ Folder Structure
myragproject/ โโโ main.py โโโ data/ โ โโโ sample.txt โโโ app/ โ โโโ config.py โ โโโ ingest.py โโโ raglib/ โ โโโ chunking/ โ โ โโโ smart_chunker.py โ โโโ embeddings/ โ โ โโโ huggingface.py โ โโโ vector_stores/ โ โโโ qdrant_store.py
yaml Copy Edit
๐ง Setup Instructions
1. Clone the repository
git clone https://github.com/your-username/myragproject.git
cd myragproject
2. Install dependencies
bash
Copy
Edit
pip install -r requirements.txt
Or manually install:
bash
Copy
Edit
pip install sentence-transformers qdrant-client requests
3. Start Qdrant (vector DB)
bash
Copy
Edit
docker run -p 6333:6333 -v qdrant_data:/qdrant/storage qdrant/qdrant
This ensures persistent vector storage.
4. Add your document
Place a .txt file inside the data/ folder, e.g.:
bash
Copy
Edit
data/sample.txt
๐ Run the RAG Ingest Pipeline
bash
Copy
Edit
python main.py
It will:
Read the file
Split it into chunks
Generate embeddings
Store in Qdrant with payloads
๐ Example Output
bash
Copy
Edit
๐ Starting ingestion for: data/sample.txt
๐งฉ Created 4 chunks
๐ข Generated embeddings
โ
Stored 4 points in Qdrant.
โ
Embeddings stored successfully in Qdrant.
๐ Coming Soon
โ Ask questions and retrieve top relevant chunks
๐ Support for PDFs and multiple file types
๐งช FastAPI-based chatbot API
๐ง Tech Stack
Python 3.10+
HuggingFace (sentence-transformers)
Qdrant vector store
Docker (for Qdrant server)
๐งฉ Credits
Built with โค๏ธ by [Abhishek]
Inspired by modern RAG systems like LangChain, LlamaIndex
๐ License
MIT License
yaml
Copy
Edit
---
## โ
To Use It Now
Just create a `README.md` file in your root folder and paste the above content.
---
Would you like me to generate:
- `requirements.txt` for you?
- Add FastAPI interface?
- Publish this to GitHub with a badge?
Letโs make this production-ready ๐
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file raggenius-0.2.1.tar.gz.
File metadata
- Download URL: raggenius-0.2.1.tar.gz
- Upload date:
- Size: 6.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
c6224aba3881b7eeaefc3856861ece436ccaf535c4ba3c26a2868f5ccceb0d99
|
|
| MD5 |
c57f75886e74abf3cb0d6ec34977b332
|
|
| BLAKE2b-256 |
240cb34ece04f8b491ae07f4cda2e42b9bdeeb22e6844bc4f0f74d7f74947116
|
File details
Details for the file raggenius-0.2.1-py3-none-any.whl.
File metadata
- Download URL: raggenius-0.2.1-py3-none-any.whl
- Upload date:
- Size: 7.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
10792ebd43e2659a6b98d1755b61d2b2a8b352b1796933bea9ce5aa21ab5ad48
|
|
| MD5 |
fb4e61460c9a23e2050d3e70984d2c7c
|
|
| BLAKE2b-256 |
012ee3ef4314bf2bcbd9d410b9073e3e0c6cafba996418c0fb42d94bd227e9d8
|