Skip to main content

Improve development of retrieval augmented generation (RAG) applications at the BR AI + Automation Lab.

Project description

rag-tools-library

Library to support common tasks in retrieval augmented generation (RAG).

This library is in a very early stage and all the documentation is AI generated.

Tutorial and Documentation

You find a brief tutorial and the documentation under br-data.github.io/rag-tools-library.

Roadmap

  • Add Google Bison to available LLMs
  • Add an offline database alternative
    • FAISS and SQLite
  • Allow users to register their own LLMs
  • Allow users to register their own Embedding models
  • Support Semantic Scholar endpoint to generate embeddings for scientific papers.
  • Support chat functionality; e.g. let the user give feedback on the result to the LLM.

Deployment

Run the build_and_deploy.sh script in the root folder. Once prompted for the username, pass __token__ and the pypi API token you've received. If you don't have an API token and feel like you should, feel free to contact the maintainers.

Contact

Marco Lehner

marco.lehner@br.de

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

brdata-rag-tools-0.1.4.3.tar.gz (14.1 kB view details)

Uploaded Source

Built Distribution

brdata_rag_tools-0.1.4.3-py3-none-any.whl (13.6 kB view details)

Uploaded Python 3

File details

Details for the file brdata-rag-tools-0.1.4.3.tar.gz.

File metadata

  • Download URL: brdata-rag-tools-0.1.4.3.tar.gz
  • Upload date:
  • Size: 14.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.11.7

File hashes

Hashes for brdata-rag-tools-0.1.4.3.tar.gz
Algorithm Hash digest
SHA256 f5165324da2465fbd66e4b625d893737817bbb02fe692a1bd7dbfb2ce25377f2
MD5 0553818edb0da49c88f0cce8be5674bc
BLAKE2b-256 ba12c0f12e8078b4bf433e157c44ad2fc64081d5ac1b5b9ac38f7a2fc1ff1567

See more details on using hashes here.

File details

Details for the file brdata_rag_tools-0.1.4.3-py3-none-any.whl.

File metadata

File hashes

Hashes for brdata_rag_tools-0.1.4.3-py3-none-any.whl
Algorithm Hash digest
SHA256 9f015f8297284e75ec700f2e4dce59ed27693fc9bb87fae176ae8b93dff709a9
MD5 d2a143c3368c3bf0e16367753149c39b
BLAKE2b-256 b889e53747743345c38aa8d2f6b9551ae1738da31082beca4017456210d705a9

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page