Skip to main content

Real-time LLM spend enforcement — CLI and tray app

Project description

LLMCap

Hard dollar caps on AI API calls. When you hit $50, it stops. Not an alert — it stops.

Install

pip install llmcap

Configure

llmcap configure
# Enter your LLMCap API URL and workspace ID

Commands

llmcap status      # Today's spend, burn rate, blocked requests
llmcap logs -n 20  # Last 20 requests
llmcap keys        # List API keys
llmcap budgets     # List budget rules

How it works

Change one line in your code:

# Before
client = Anthropic(api_key="sk-ant-...")

# After
client = Anthropic(
    api_key="sk-ant-...",
    base_url="https://proxy.llmcap.io/anthropic"
)

When you hit your dollar cap, the next request returns 429 instead of forwarding to Anthropic. The token is never consumed. The money is never spent.

Links

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llmcap-0.1.0.tar.gz (379.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llmcap-0.1.0-py3-none-any.whl (23.2 kB view details)

Uploaded Python 3

File details

Details for the file llmcap-0.1.0.tar.gz.

File metadata

  • Download URL: llmcap-0.1.0.tar.gz
  • Upload date:
  • Size: 379.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.13

File hashes

Hashes for llmcap-0.1.0.tar.gz
Algorithm Hash digest
SHA256 232e10023b603697b1d21c2973ef0af36a4053e5f33e78cdb55c46f5e9a96f19
MD5 813623fcc9e6022a36b244dee9e788db
BLAKE2b-256 2ba4399ec1daf2473bb0fb9eb6e8f23c87600fecea7e3af18171d02890a7b6b6

See more details on using hashes here.

File details

Details for the file llmcap-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: llmcap-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 23.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.13.13

File hashes

Hashes for llmcap-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2ece437320331624f66355dbacfad4fdeba84cb3271639ca1b36c6e365d22e78
MD5 62191c18fd385a06ec371006575b663b
BLAKE2b-256 be7ac140c68f30803ab621f9dfc9833a59f9a9f75acad485fedb0c9f4cac97dc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page