ai-cachekit 0.1.0

Lightweight caching library for AI/LLM API responses

AI CacheKit

Lightweight caching library for AI/LLM API responses.
Reduce costs and improve performance by storing API responses locally with hash-based keys and optional TTL.

---

Features

• 🔹 Simple API: get, set, get_or_set
• 🔹 Local JSON storage (no external DB required)
• 🔹 Optional TTL (time-to-live) for cache expiration
• 🔹 Perfect for OpenAI, Anthropic, Ollama, etc.

---

Installation

From GitHub (development version):

pip install git+https://github.com/EDLadder/ai-cachekit.git

From PyPI (after release):

pip install ai-cachekit

---

Usage

from ai_cachekit.cache import AIResponseCache

cache = AIResponseCache(ttl=3600)  # Cache for 1 hour

def call_ai():
    # Example: call your AI API here
    return "Dragon story result"

prompt = "Write a short story about a dragon"
result = cache.get_or_set(prompt, call_ai)
print(result)

---

Why?

• Avoid repeated API calls (save cost & time)
• Minimal dependencies and setup
• Flexible for any AI API (OpenAI, LLaMA, etc.)

---

Development

Clone repo and install dev dependencies:

git clone https://github.com/EDLadder/ai-cachekit.git
cd ai-cachekit
pip install -r requirements.txt
pytest

---

License

MIT License – free to use and modify.