Skip to main content

llm-catalog-core

Runtime-agnostic core for llm-catalog. It holds the config schema (shipped as schema.json for editor validation; parity with ai-sdk-catalog 0.13), validation, role resolution, the path-rewriting GatewayTransport, native LiteLLM codegen, and an embedded models.dev price snapshot that fills a model's missing cost by vendor and model id (an explicit cost in the config always wins).

This package knows nothing about any runtime adapter and never touches the filesystem, so installing it pulls in neither Pydantic AI nor LiteLLM. Use it directly when you only need resolution or codegen. Otherwise install one of the adapter distributions (llm-catalog-pydantic-ai, llm-catalog-ai-sdk, llm-catalog-litellm), which depend on this.

The config format is JSON, shared verbatim with ai-sdk-catalog — read the file yourself and hand the parsed mapping to Catalog, which validates it:

import json
from pathlib import Path

from llm_catalog.core import Catalog

config = json.loads(Path("ai-sdk-catalog.json").read_text(encoding="utf-8"))
cat = Catalog(config)
rm = cat.resolve_role("fast")  # -> ResolvedModel (no adapter types)
print(rm.kind, rm.vendor, rm.base_url)  # "gateway" or "direct"

To keep using YAML, parse it yourself (e.g. yaml.safe_load) and pass the result the same way.

GatewayTransport comes in two flavours with identical behaviour, because vendor SDKs are split between httpx and its continuation httpx2:

  • llm_catalog.core.transport (also re-exported from llm_catalog.core) for httpx clients, e.g. LiteLLM with openai<3.
  • llm_catalog.core.transport2 for httpx2 clients (openai>=3, anthropic>=1, Pydantic AI, the AI SDK for Python); install the optional dependency with pip install "llm-catalog-core[httpx2]".

Build one for a resolved model with GatewayTransport.for_model(inner, rm).

See the repository README for the full picture, the public/private boundary, and the verification notes.

import namespace: llm_catalog.core

Metadata

Release files for llm-catalog-core 0.10.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for llm-catalog-core 0.10.0
File Size Uploaded
llm_catalog_core-0.10.0.tar.gz 33.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for llm-catalog-core 0.10.0
File Interpreter ABI Platform
llm_catalog_core-0.10.0-py3-none-any.whl Python 3 none any Details

Total release size: 72.9 kB

Release files / llm_catalog_core-0.10.0.tar.gz

Download URL llm_catalog_core-0.10.0.tar.gz
Size 33.0 kB
Tags Source
SHA-256 checksum
How to use checksums
b3f8e044ebb2815ebe92fcf7c9223f0a2916ca688f81b32e2c02408c6027fb70
BLAKE2b-256 checksum
How to use checksums
9658444feffd470138c67bfd8af01f82aa475850ac1fc37132caacbd8367f8bc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.13.0 {"installer":{"name":"uv","version":"0.13.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / llm_catalog_core-0.10.0-py3-none-any.whl

Download URL llm_catalog_core-0.10.0-py3-none-any.whl
Size 39.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
df97e0213afd486b51bad242a523aadb7cac0f1bcb568d0a2ea09fbe81cb7630
BLAKE2b-256 checksum
How to use checksums
7b724b35733e7b4f9fb9d9e65c602464fadef9e2f24f2514d3eebbe199affe1a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
Yes
Uploaded via uv/0.13.0 {"installer":{"name":"uv","version":"0.13.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release history Release notifications | RSS feed

0.10.2

2 release files

0.10.1

2 release files

This release

0.10.0 This release

2 release files

0.9.1

2 release files

0.9.0

2 release files

0.8.8

2 release files

0.8.7

2 release files

0.8.6

2 release files

0.8.5

2 release files

0.8.4

2 release files

0.8.3

2 release files

0.8.2

2 release files

0.8.1

2 release files

0.8.0

2 release files

0.7.0

2 release files

0.6.0

2 release files

0.5.1

2 release files

0.5.0

2 release files

0.4.0

2 release files

0.3.0

2 release files

0.2.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page