Cut AI API costs by 63-99% with intelligent routing
Project description
APICrusher - Cut AI API Costs by 63-99%
Stop bleeding money on AI APIs. APICrusher automatically routes requests to the cheapest capable model and caches responses, cutting costs by 63-99% with just 2 lines of code.
🚀 Quick Start
pip install apicrusher
# Before (expensive)
from openai import OpenAI
client = OpenAI()
# After (63-99% cheaper)
from apicrusher import OpenAI
client = OpenAI(apicrusher_key="your_key")
That's it. Your code stays the same, your costs drop dramatically.
💰 How Much Can You Save?
| Your Current Usage | Monthly Cost | With APICrusher | You Save |
|---|---|---|---|
| GPT-4 for everything | $1,000 | $180 | $820 (82%) |
| Mixed GPT-4/3.5 | $500 | $95 | $405 (81%) |
| Heavy API usage | $5,000 | $750 | $4,250 (85%) |
| Long conversations | $2,000 | $340 | $1,660 (83%) |
🎯 Features
Universal Provider Support
Works with ALL major AI providers:
- OpenAI (GPT-4, GPT-4o, GPT-3.5, O1)
- Anthropic (Claude 3.5, Claude Opus 4.1)
- Google (Gemini 1.5, Gemini 2.0)
- Groq, Cohere, Meta, Mistral, and more
Intelligent Model Routing
- Simple queries → Cheap models (gpt-4o-mini)
- Complex queries → Premium models (GPT-4)
- Automatic quality preservation
Smart Caching
- Deduplicates identical requests
- Redis + in-memory fallback
- 33% average cache hit rate
🆕 Context Compression (NEW!)
Stop paying to reprocess the same conversation 50 times:
# Enable context compression for long conversations
response = client.chat.completions.create(
model="gpt-4",
messages=conversation_history, # 50 messages = 15,000 tokens normally
compress_context=True # Reduces to ~3,000 tokens automatically
)
# Features:
# - Summarizes older messages while preserving key decisions
# - Removes duplicate context automatically
# - Compresses code blocks by 40-60%
# - Sends only deltas for continuing conversations
# - Preserves last 3 messages in full for accuracy
Context Compression Savings Example:
- Normal 20-message conversation: 150,000 tokens ($2.25)
- With compression: 35,000 tokens ($0.52)
- Savings: 77% on long conversations
Analytics & Reporting
# Get detailed savings report
client.print_savings_summary()
# Output:
# 💸 Total Saved: $127.43
# 📞 Total Calls: 1,432
# 💾 Cache Hit Rate: 34.2%
# ⚡ Optimization Rate: 91.3%
🔧 Advanced Usage
Multi-Provider Setup
from apicrusher import OpenAI
client = OpenAI(
openai_api_key="sk-...",
anthropic_api_key="sk-ant-...",
google_api_key="...",
apicrusher_key="apc_..."
)
# Automatically routes to cheapest provider
response = client.chat.completions.create(
model="gpt-4", # Will use gpt-4o-mini if appropriate
messages=[{"role": "user", "content": "Format this date: 2024-01-01"}]
)
Context Compression Options
# Fine-tune compression behavior
response = client.chat.completions.create(
model="gpt-4",
messages=long_conversation,
compress_context=True,
compression_threshold=10, # Start compressing after 10 messages
preserve_recent=5 # Keep last 5 messages uncompressed
)
Manual Optimization Control
# Force specific model
response = client.chat.completions.create(
model="gpt-4o-mini", # Use this exact model
messages=messages,
skip_optimization=True # Bypass routing logic
)
📊 Real-World Results
Based on actual customer usage:
- E-commerce company: Reduced costs from $8,400/mo to $1,260/mo (85% savings)
- SaaS startup: Cut API bills from $3,200/mo to $480/mo (85% savings)
- AI coding assistant: Dropped from $12,000/mo to $2,400/mo (80% savings)
🛡️ Security & Privacy
- Your API keys stay local - Never sent to our servers
- No prompt logging - Your data remains private
- Open source - Audit the code yourself
- SOC2 compliant - Enterprise-ready security
🚀 Getting Started
- Install:
pip install apicrusher - Get your key: Sign up at apicrusher.com
- Add 2 lines: Replace your import and add your key
- Save money: Watch your costs drop by 63-99%
💰 Pricing
- Free Trial: 7 days, no credit card required
- Professional: $99/month (pays for itself in hours)
- Enterprise: Custom pricing for high-volume usage
Most customers save 10-50x the subscription cost in the first month.
🤝 Support
- Email: hello@apicrusher.com
- Documentation: apicrusher.com/docs
- GitHub: github.com/apicrusher/apicrusher
License
MIT License - Use it however you want.
Stop bleeding money on AI APIs. Start saving with APICrusher today.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file apicrusher-1.2.0.tar.gz.
File metadata
- Download URL: apicrusher-1.2.0.tar.gz
- Upload date:
- Size: 16.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
76e4688ee246e7e707c5f81066de35178218d0c43b10a297eb5022634812e78f
|
|
| MD5 |
bcdb0bd9c963c939aa64c6b292d3acd9
|
|
| BLAKE2b-256 |
eb7f86f930871016ee2fbbc8750765e482fd0bf47fef34f0b995263edd2cee1a
|
File details
Details for the file apicrusher-1.2.0-py3-none-any.whl.
File metadata
- Download URL: apicrusher-1.2.0-py3-none-any.whl
- Upload date:
- Size: 15.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.3
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
10b4eeb0ebefdd50332de8b5a21381ed00ff27b3a593ff5039e7f49f719eb529
|
|
| MD5 |
98e0e305760e987a0a2acfef48726ecc
|
|
| BLAKE2b-256 |
ce5a203012a6df35cbdadd35928d09bc213e5c042bd583af3072e97b296c0e5a
|