Skip to main content

Multi-tenant RAG: hybrid retrieval, chunking, embeddings, ingestion, PDF + image + repo pipelines, agent-extraction indexing, priority-aware ranking.

Project description

matrx-rag

Multi-tenant RAG: hybrid retrieval, chunking, embeddings, ingestion, PDF + image + repo pipelines, agent-extraction indexing, NER/KG writes, priority-aware ranking — extracted from aidream/services/rag/ so any host (aidream's cloud server, matrx-local) can consume the same stack.

Documentation hub: docs/rag_and_ner/README.md
(Vision in docs/knowledge/ · code truth in docs/rag_and_ner/reality/ · backlog in 00_CLEANUP.md.)

What it does

  • Ingestion: ingest_source(source_kind, source_id, ...) — chunk → embed → upsert; NER inline for non-code sources.
  • PDF / image / code repo pipelines with provenance.
  • Hybrid search: pgvector HNSW + lexical FTS → RRF → optional Cohere → MMR.
  • Priority-aware ranking: agent-extracted chunks with non-zero priority.
  • Agent-extraction → RAG: extraction_indexing materializes page-extraction payloads as chunks.
  • Data stores: curated buckets with scoped search.
  • Eval harness: retrieval + answer quality assessment.

Host integration

  • aidream wires the package in aidream/package_integration.py::_configure_matrx_rag (NER extractor, embedding cache, ORM models, search callable).
  • aidream/services/rag/ is a re-export shim; HTTP routes live in aidream/api/routers/rag.py.
  • Auto-ingest (gates, budget, scope suggestions) lives in aidream/services/auto_ingest/ — not in this package.

Schema

Migrations: matrx_rag/migrations/ (mirrored in db/migrations/ until package owns the runner).
ORM / pgvector notes: docs/rag_and_ner/reality/04_ORM_AND_SCHEMA.md.

Package development

See CLAUDE.md for injection seams, test baselines, and the no-aidream-imports rule.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

matrx_rag-0.1.19.tar.gz (294.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

matrx_rag-0.1.19-py3-none-any.whl (309.6 kB view details)

Uploaded Python 3

File details

Details for the file matrx_rag-0.1.19.tar.gz.

File metadata

  • Download URL: matrx_rag-0.1.19.tar.gz
  • Upload date:
  • Size: 294.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for matrx_rag-0.1.19.tar.gz
Algorithm Hash digest
SHA256 495451cece7c9a53f8b21af855a9281f9d0df7bd1b229f5c321c7e65b265f9c0
MD5 0b6c83c58c75217f7f12a96ef8c8a227
BLAKE2b-256 902d60f2e7d287b14bd35634bacb4a7a8e48ba8872ad1cf796f326320f6dec80

See more details on using hashes here.

Provenance

The following attestation bundles were made for matrx_rag-0.1.19.tar.gz:

Publisher: publish-package.yml on AI-Matrix-Engine/aidream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file matrx_rag-0.1.19-py3-none-any.whl.

File metadata

  • Download URL: matrx_rag-0.1.19-py3-none-any.whl
  • Upload date:
  • Size: 309.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for matrx_rag-0.1.19-py3-none-any.whl
Algorithm Hash digest
SHA256 17488a0fd4355373df27174fb98506b8f84225c595d325249f90c86f088af9e6
MD5 b7efb4d189502d6fe3e00c4ca4c220d4
BLAKE2b-256 46e06cb41e111a5ca60dcce475c78abe6582a8d37b2dc9fb58f57e95888b5806

See more details on using hashes here.

Provenance

The following attestation bundles were made for matrx_rag-0.1.19-py3-none-any.whl:

Publisher: publish-package.yml on AI-Matrix-Engine/aidream

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page