portkey-ai 0.1.45

Python client library for the Portkey API

---

Portkey streamlines API requests to 20+ LLMs. It provides a unified API signature for interacting with all LLMs alongwith powerful LLM Gateway features like load balancing, fallbacks, retries and more.

pip install portkey-ai

💡 Features

	Name	Description	Example
🌐	Interoperability	Write once, run with any provider. Switch between __ models from __ providers seamlessly.
🔀	Fallback Strategies	Don't let failures stop you. If one provider fails, Portkey can automatically switch to another.
🔄	Retry Strategies	Temporary issues shouldn't mean manual re-runs. Portkey can automatically retry failed requests.
⚖️	Load Balancing	Distribute load effectively across multiple API keys or providers based on custom weights.
📝	Unified API Signature	If you've used OpenAI, you already know how to use Portkey with any other provider.

🤝 Supported Providers

	Provider	Support Status	Supported Endpoints
	OpenAI	✅ Supported	/completion, /embed
	Azure OpenAI	✅ Supported	/completion, /embed
	Anthropic	✅ Supported	/complete
	Cohere	✅ Supported	generate, embed
	Google Bard	🚧 Coming Soon
	LocalAI	🚧 Coming Soon

---

📝 Full Documentation | 🎯 Roadmap | 🐞 Bug Reports | 💡 Feature Requests

📞 Talk to the devs: Rohit | Ayush

Changelog

We are excited to announce the stable release of the all-new Portkey Python SDK, version 0.1.44! This SDK makes it easier than ever to add production capabilities to your existing LLM systems with one line of change to your code.

Key Features and Enhancements of this release

• Stability and Reliability: This release marks the stable version of Portkey Python SDK, thoroughly tested to ensure reliable performance in your projects.

• Ease of Use: The SDK follows OpenAI SDK footprint, and with one line of change to your existing code, you can add Portkey's production features to your app.

• Community Support: Join our growing community of practitioners putting LLMs in production. Share ideas, resolve doubts, and collaborate on projects.

Feedback and Contributions

We welcome your feedback and contributions! Feel free to report issues, suggest enhancements, or submit pull requests on our GitHub repository.

Thank you for your support and enthusiasm for the Portkey Python SDK. We look forward to seeing the amazing projects you will build with it!

Happy coding!

• The Portkey Team