matrx-batch

Cost-shield foundation for AI workloads in the Matrx ecosystem.

Three primitives:

OpenAI Batch API + Anthropic Message Batches — submit JSONL, poll status, fetch results. Async wrappers over the provider SDKs.
Urgency router — BatchRouter.submit(job) routes a job to live inference, to the provider's Batch API (50% discount, 24h SLA), or makes a cost-based decision automatically.
Embedding cache — content-addressable (SHA256 of model || text) reuse of embedding vectors across the org. Backed by rag.embedding_cache via a host-supplied asyncpg pool.

Dependency posture

matrx-batch sits one notch above matrx-utils in the dependency graph and is consumed by matrx-rag (embedding cache) and matrx-ai (urgency router, future). It MUST NOT import from aidream/ or from any other matrx-* sibling — every cross-boundary dependency comes in via matrx_batch.configure(...).

Usage (host-side wiring)

import matrx_batch
from openai import AsyncOpenAI
from anthropic import AsyncAnthropic

matrx_batch.configure(
    openai_client=AsyncOpenAI(api_key=settings.OPENAI_API_KEY),
    anthropic_client=AsyncAnthropic(api_key=settings.ANTHROPIC_API_KEY),
    pool_factory=lambda: get_async_pg_pool(),
    cost_check=_aidream_budget_precheck,
)

# Wire the cache into matrx-rag's embed() funnel
import matrx_rag
matrx_rag.configure(embedding_cache=matrx_batch.get_embedding_cache())

Usage (consumer)

from matrx_batch import BatchRouter, BatchableJob

router = BatchRouter()
receipt = await router.submit(
    BatchableJob(
        kind="chat",
        provider="anthropic",
        urgency="auto",
        payload={"model": "claude-haiku-4-5", "messages": [...]},
        estimated_tokens_in=8200,
    )
)

Metadata

Release files for matrx-batch 0.2.153

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for matrx-batch 0.2.153
File	Size	Uploaded
matrx_batch-0.2.153.tar.gz	94.1 kB	Oct 17, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for matrx-batch 0.2.153
File	Interpreter	ABI	Platform	Reset
matrx_batch-0.2.153-py3-none-any.whl 81.2 kB Oct 17, 2026	Python 3	none	any	Details

Total release size: 175.2 kB

Release files / matrx_batch-0.2.153.tar.gz

Download URL	matrx_batch-0.2.153.tar.gz
Size	94.1 kB
Tags	Source
SHA-256 checksum How to use checksums	`506ca63f5f649d5da0fb6d3d04502a7d782d23d9dacecc84c4e67420a0f8b2c4`
BLAKE2b-256 checksum How to use checksums	`7abbf3b83d8dcbfe9d001ea9198c87354925e7a464ee11f0b0a7ffa83d30626b`
Upload date	Oct 17, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/7.0.0 CPython/3.13.14`

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/AI-Matrix-Engine/aidream
Publishing commit: github.com/AI-Matrix-Engine/aidream/tree/a487aa49de3edb4b5e9af94f3b3c64f3e45e0a00

Workflow

Publishing configuration: github.com/AI-Matrix-Engine/aidream/blob/a487aa49de3edb4b5e9af94f3b3c64f3e45e0a00/.github/workflows/publish-package.yml
Publishing logs: github.com/AI-Matrix-Engine/aidream/actions/runs/39022871764/attempts/1

Artifact

Subject: matrx_batch-0.2.153.tar.gz
SHA-256 checksum: 506ca63f5f649d5da0fb6d3d04502a7d782d23d9dacecc84c4e67420a0f8b2c4 Verifying attestations

Release files / matrx_batch-0.2.153-py3-none-any.whl

Download URL	matrx_batch-0.2.153-py3-none-any.whl
Size	81.2 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`1dc364c27ea37a080a1fd52eff7ab90ebdd5309afbb068f70e15dca2453b6b69`
BLAKE2b-256 checksum How to use checksums	`94f0612049710f3324934412c1a24594013b5529601162670717f487f0bfd5e2`
Upload date	Oct 17, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/7.0.0 CPython/3.13.14`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/AI-Matrix-Engine/aidream
Publishing commit: github.com/AI-Matrix-Engine/aidream/tree/a487aa49de3edb4b5e9af94f3b3c64f3e45e0a00

Workflow

Publishing configuration: github.com/AI-Matrix-Engine/aidream/blob/a487aa49de3edb4b5e9af94f3b3c64f3e45e0a00/.github/workflows/publish-package.yml
Publishing logs: github.com/AI-Matrix-Engine/aidream/actions/runs/39022871764/attempts/1

Artifact

Subject: matrx_batch-0.2.153-py3-none-any.whl
SHA-256 checksum: 1dc364c27ea37a080a1fd52eff7ab90ebdd5309afbb068f70e15dca2453b6b69 Verifying attestations