Skip to main content

Multi-tenant RAG: hybrid retrieval, chunking, embeddings, ingestion, PDF + image + repo pipelines, agent-extraction indexing, priority-aware ranking.

Project description

matrx-rag

Multi-tenant RAG: hybrid retrieval, chunking, embeddings, ingestion, PDF + image + repo pipelines, agent-extraction indexing, NER/KG writes, priority-aware ranking — extracted from aidream/services/rag/ so any host (aidream's cloud server, matrx-local) can consume the same stack.

Documentation hub: docs/rag_and_ner/README.md
(Vision in docs/knowledge/ · code truth in docs/rag_and_ner/reality/ · backlog in 00_CLEANUP.md.)

What it does

  • Ingestion: ingest_source(source_kind, source_id, ...) — chunk → embed → upsert; NER inline for non-code sources.
  • PDF / image / code repo pipelines with provenance.
  • Hybrid search: pgvector HNSW + lexical FTS → RRF → optional Cohere → MMR.
  • Priority-aware ranking: agent-extracted chunks with non-zero priority.
  • Agent-extraction → RAG: extraction_indexing materializes page-extraction payloads as chunks.
  • Data stores: curated buckets with scoped search.
  • Eval harness: retrieval + answer quality assessment.

Host integration

  • aidream wires the package in aidream/package_integration.py::_configure_matrx_rag (NER extractor, embedding cache, ORM models, search callable).
  • aidream/services/rag/ is a re-export shim; HTTP routes live in aidream/api/routers/rag.py.
  • Auto-ingest (gates, budget, scope suggestions) lives in aidream/services/auto_ingest/ — not in this package.

Schema

Migrations: matrx_rag/migrations/ (mirrored in db/migrations/ until package owns the runner).
ORM / pgvector notes: docs/rag_and_ner/reality/04_ORM_AND_SCHEMA.md.

Package development

See CLAUDE.md for injection seams, test baselines, and the no-aidream-imports rule.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

matrx_rag-0.1.13.tar.gz (286.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

matrx_rag-0.1.13-py3-none-any.whl (301.8 kB view details)

Uploaded Python 3

File details

Details for the file matrx_rag-0.1.13.tar.gz.

File metadata

  • Download URL: matrx_rag-0.1.13.tar.gz
  • Upload date:
  • Size: 286.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for matrx_rag-0.1.13.tar.gz
Algorithm Hash digest
SHA256 6d75652238b7bf6e7bc060b160eaaae7dcccf0eb11a953b0c7783e7aa823db7b
MD5 37a7510661dd76e928cfcc8236bcb753
BLAKE2b-256 ced3adeea4fa6f1f6eccf937f3a23e2f6714586815e240ce15b1b92fd7623cd2

See more details on using hashes here.

Provenance

The following attestation bundles were made for matrx_rag-0.1.13.tar.gz:

Publisher: publish-package.yml on AI-Matrix-Engine/aidream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file matrx_rag-0.1.13-py3-none-any.whl.

File metadata

  • Download URL: matrx_rag-0.1.13-py3-none-any.whl
  • Upload date:
  • Size: 301.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for matrx_rag-0.1.13-py3-none-any.whl
Algorithm Hash digest
SHA256 96fcea0e92c809df16c73622a31412a742b052eb074a22327126f00702e44724
MD5 56ed71cff50d55aaa8a20dbc9f2dc73b
BLAKE2b-256 be6bfce9309420bdd9e971bfcfd46debace3c8fa0621441f6c27064c6e86fb77

See more details on using hashes here.

Provenance

The following attestation bundles were made for matrx_rag-0.1.13-py3-none-any.whl:

Publisher: publish-package.yml on AI-Matrix-Engine/aidream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page