Skip to main content

Multi-tenant RAG: hybrid retrieval, chunking, embeddings, ingestion, PDF + image + repo pipelines, agent-extraction indexing, priority-aware ranking.

Project description

matrx-rag

Multi-tenant RAG: hybrid retrieval, chunking, embeddings, ingestion, PDF + image + repo pipelines, agent-extraction indexing, NER/KG writes, priority-aware ranking — extracted from aidream/services/rag/ so any host (aidream's cloud server, matrx-local) can consume the same stack.

Documentation hub: docs/rag_and_ner/README.md
(Vision in docs/knowledge/ · code truth in docs/rag_and_ner/reality/ · backlog in 00_CLEANUP.md.)

What it does

  • Ingestion: ingest_source(source_kind, source_id, ...) — chunk → embed → upsert; NER inline for non-code sources.
  • PDF / image / code repo pipelines with provenance.
  • Hybrid search: pgvector HNSW + lexical FTS → RRF → optional Cohere → MMR.
  • Priority-aware ranking: agent-extracted chunks with non-zero priority.
  • Agent-extraction → RAG: extraction_indexing materializes page-extraction payloads as chunks.
  • Data stores: curated buckets with scoped search.
  • Eval harness: retrieval + answer quality assessment.

Host integration

  • aidream wires the package in aidream/package_integration.py::_configure_matrx_rag (NER extractor, embedding cache, ORM models, search callable).
  • aidream/services/rag/ is a re-export shim; HTTP routes live in aidream/api/routers/rag.py.
  • Auto-ingest (gates, budget, scope suggestions) lives in aidream/services/auto_ingest/ — not in this package.

Schema

Migrations: matrx_rag/migrations/ (mirrored in db/migrations/ until package owns the runner).
ORM / pgvector notes: docs/rag_and_ner/reality/04_ORM_AND_SCHEMA.md.

Package development

See CLAUDE.md for injection seams, test baselines, and the no-aidream-imports rule.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

matrx_rag-0.1.45.tar.gz (341.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

matrx_rag-0.1.45-py3-none-any.whl (389.4 kB view details)

Uploaded Python 3

File details

Details for the file matrx_rag-0.1.45.tar.gz.

File metadata

  • Download URL: matrx_rag-0.1.45.tar.gz
  • Upload date:
  • Size: 341.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for matrx_rag-0.1.45.tar.gz
Algorithm Hash digest
SHA256 dc954deb82f6eec956ca4a59dfd2184ddc522ecf1e8dfbb92a948d7fa0ecaac3
MD5 f8f3b9fda9aad1b4f1d8cee3bdb1ab3a
BLAKE2b-256 5cc154c17fba33820b78289320f44386dc785ac725d1898280fc859d90db4042

See more details on using hashes here.

Provenance

The following attestation bundles were made for matrx_rag-0.1.45.tar.gz:

Publisher: publish-package.yml on AI-Matrix-Engine/aidream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file matrx_rag-0.1.45-py3-none-any.whl.

File metadata

  • Download URL: matrx_rag-0.1.45-py3-none-any.whl
  • Upload date:
  • Size: 389.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for matrx_rag-0.1.45-py3-none-any.whl
Algorithm Hash digest
SHA256 92b87bd4efd9e33e6bd5aeeb6a7a20c583508519e08adb8b5bc03991d69cc680
MD5 1bc2f49044a7cf0280f3800130f61161
BLAKE2b-256 2e98f1cb251a6e8ad3e8a62f697c3bf4c95606d1cdacdf5bfd1ecd6d86b80a08

See more details on using hashes here.

Provenance

The following attestation bundles were made for matrx_rag-0.1.45-py3-none-any.whl:

Publisher: publish-package.yml on AI-Matrix-Engine/aidream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page