Skip to main content

Lightweight caching layer for LLM API responses with TTL and size limits

Project description

llm-cache-lite

Installation

pip install llm-cache-lite

Usage

import llm_cache_lite

License

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_cache_toolkit-0.1.0.tar.gz (2.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

llm_cache_toolkit-0.1.0-py3-none-any.whl (2.3 kB view details)

Uploaded Python 3

File details

Details for the file llm_cache_toolkit-0.1.0.tar.gz.

File metadata

  • Download URL: llm_cache_toolkit-0.1.0.tar.gz
  • Upload date:
  • Size: 2.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.12.8

File hashes

Hashes for llm_cache_toolkit-0.1.0.tar.gz
Algorithm Hash digest
SHA256 0a46370502d874cbefd8571dcb6306b6d0689532cc70830e2929144dfb9a811a
MD5 c4546dec7b8afe9de6c8f498427099f6
BLAKE2b-256 8752c2e31238d921a1944f989f4fa4c17bf9e834bfd725d3cb2f420978a4a4de

See more details on using hashes here.

File details

Details for the file llm_cache_toolkit-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for llm_cache_toolkit-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7fe40f5ee9f05c23e30b86c4e6e3830b71f5cb10c38e5c7fc243e06088c6a310
MD5 a73172f2a568fb8c245733eeb8cfe402
BLAKE2b-256 3763524b0f02a0f094d8d68a9d49812db870f185de4cdf1136137a99a1ac7248

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page