Skip to main content

Multi-tenant RAG: hybrid retrieval, chunking, embeddings, ingestion, PDF + image + repo pipelines, agent-extraction indexing, priority-aware ranking.

Project description

matrx-rag

Multi-tenant RAG: hybrid retrieval, chunking, embeddings, ingestion, PDF + image + repo pipelines, agent-extraction indexing, NER/KG writes, priority-aware ranking — extracted from aidream/services/rag/ so any host (aidream's cloud server, matrx-local) can consume the same stack.

Documentation hub: docs/rag_and_ner/README.md
(Vision in docs/knowledge/ · code truth in docs/rag_and_ner/reality/ · backlog in 00_CLEANUP.md.)

What it does

  • Ingestion: ingest_source(source_kind, source_id, ...) — chunk → embed → upsert; NER inline for non-code sources.
  • PDF / image / code repo pipelines with provenance.
  • Hybrid search: pgvector HNSW + lexical FTS → RRF → optional Cohere → MMR.
  • Priority-aware ranking: agent-extracted chunks with non-zero priority.
  • Agent-extraction → RAG: extraction_indexing materializes page-extraction payloads as chunks.
  • Data stores: curated buckets with scoped search.
  • Eval harness: retrieval + answer quality assessment.

Host integration

  • aidream wires the package in aidream/package_integration.py::_configure_matrx_rag (NER extractor, embedding cache, ORM models, search callable).
  • aidream/services/rag/ is a re-export shim; HTTP routes live in aidream/api/routers/rag.py.
  • Auto-ingest (gates, budget, scope suggestions) lives in aidream/services/auto_ingest/ — not in this package.

Schema

Migrations: matrx_rag/migrations/ (mirrored in db/migrations/ until package owns the runner).
ORM / pgvector notes: docs/rag_and_ner/reality/04_ORM_AND_SCHEMA.md.

Package development

See CLAUDE.md for injection seams, test baselines, and the no-aidream-imports rule.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

matrx_rag-0.1.11.tar.gz (280.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

matrx_rag-0.1.11-py3-none-any.whl (297.6 kB view details)

Uploaded Python 3

File details

Details for the file matrx_rag-0.1.11.tar.gz.

File metadata

  • Download URL: matrx_rag-0.1.11.tar.gz
  • Upload date:
  • Size: 280.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for matrx_rag-0.1.11.tar.gz
Algorithm Hash digest
SHA256 eb9cbe35a287ef2d28975371f68e4978a1ed43b7770ffb3839dccd96f9c2456d
MD5 e3c51ca722bc4783f16c4e75f156265a
BLAKE2b-256 1ed79600e0f465b413b799c43e2e41368b72bd7c13cea46d57799c8310bb0c48

See more details on using hashes here.

Provenance

The following attestation bundles were made for matrx_rag-0.1.11.tar.gz:

Publisher: publish-package.yml on AI-Matrix-Engine/aidream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file matrx_rag-0.1.11-py3-none-any.whl.

File metadata

  • Download URL: matrx_rag-0.1.11-py3-none-any.whl
  • Upload date:
  • Size: 297.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for matrx_rag-0.1.11-py3-none-any.whl
Algorithm Hash digest
SHA256 06a55de15118101958a33695608cd537bda3b8fafcc901c5cd810eb9e67e40c0
MD5 9139d14fabfa36a39dbb4e2e38932217
BLAKE2b-256 0facfc1d588f64d0206b487e58836e76e309538b2a752aa742013733c5df2117

See more details on using hashes here.

Provenance

The following attestation bundles were made for matrx_rag-0.1.11-py3-none-any.whl:

Publisher: publish-package.yml on AI-Matrix-Engine/aidream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page