portkey-ai 0.1.34

Python client library for the Portkey API

---

Portkey streamlines API requests to 20+ LLMs. It provides a unified API signature for interacting with all LLMs alongwith powerful LLM Gateway features like load balancing, fallbacks, retries and more.

pip install portkey-ai

💡 Features

	Name	Description	Example
🌐	Interoperability	Write once, run with any provider. Switch between __ models from __ providers seamlessly.
🔀	Fallback Strategies	Don't let failures stop you. If one provider fails, Portkey can automatically switch to another.
🔄	Retry Strategies	Temporary issues shouldn't mean manual re-runs. Portkey can automatically retry failed requests.
⚖️	Load Balancing	Distribute load effectively across multiple API keys or providers based on custom weights.
📝	Unified API Signature	If you've used OpenAI, you already know how to use Portkey with any other provider.

🤝 Supported Providers

	Provider	Support Status	Supported Endpoints
	OpenAI	✅ Supported	/completion, /embed
	Azure OpenAI	✅ Supported	/completion, /embed
	Anthropic	✅ Supported	/complete
	Cohere	✅ Supported	generate, embed
	Google Bard	🚧 Coming Soon
	LocalAI	🚧 Coming Soon

---

📝 Full Documentation | 🎯 Roadmap | 🐞 Bug Reports | 💡 Feature Requests

📞 Talk to the devs: Rohit | Ayush