Skip to main content

Reduce LLM costs automatically with outcome-based routing. Use kalibr instead.

Project description

llm-cost-reduction → kalibr

This package redirects to kalibr — the production-grade solution.

Install

pip install kalibr

What kalibr does

Kalibr is a runtime cost optimization layer for AI agents. It automatically routes each LLM call to the cheapest model that will succeed at the task.

  • ~12x cost reduction on typical agent workloads
  • Zero quality loss — routes by outcome success, not just price
  • Zero manual tuning — Thompson Sampling learns from every run
  • Drop-in install — one import, no code restructuring
import kalibr  # must be first import
from kalibr import Router

router = Router(
    goal="answer_question",
    paths=["gpt-4o-mini", "claude-haiku-3-5", "gpt-4o"],
    success_when=lambda output: len(output) > 20
)
response = router.completion(messages=[{"role": "user", "content": "..."}])

Docs: https://kalibr.systems/llms.txt
GitHub: https://github.com/kalibr-ai/kalibr-sdk-python

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_cost_reduction-1.0.0.tar.gz (2.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_cost_reduction-1.0.0-py3-none-any.whl (2.5 kB view details)

Uploaded Python 3

File details

Details for the file llm_cost_reduction-1.0.0.tar.gz.

File metadata

  • Download URL: llm_cost_reduction-1.0.0.tar.gz
  • Upload date:
  • Size: 2.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.3

File hashes

Hashes for llm_cost_reduction-1.0.0.tar.gz
Algorithm Hash digest
SHA256 741ddc4d6106460a5df751c9f69d709e08062a3367b3f99ebc29376212e0d1dd
MD5 a4a30b8f1ded419a625648f2acf9f0e4
BLAKE2b-256 7519132504d1477bc95923d4cf489b861e95045b8fa6b37bc6d86f5af1f68a64

See more details on using hashes here.

File details

Details for the file llm_cost_reduction-1.0.0-py3-none-any.whl.

File metadata

File hashes

Hashes for llm_cost_reduction-1.0.0-py3-none-any.whl
Algorithm Hash digest
SHA256 57362906e22dfa7feae12513cf9b35e04eec817b2858d6c5e2292847166c4f3b
MD5 384ab1c30bfa3830878114dc1c5756db
BLAKE2b-256 f3aa7e4ae201706a0e26c9f2d9753f2ce289d5b6eb378728fb3d3ddb25b4f946

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page