Python client library for the Portkey API
Project description
Portkey streamlines API requests to 20+ LLMs. It provides a unified API signature for interacting with all LLMs alongwith powerful LLM Gateway features like load balancing, fallbacks, retries and more.
pip install portkey-ai
💡 Features
🤝 Supported Providers
Provider | Support Status | Supported Endpoints | |
---|---|---|---|
OpenAI | ✅ Supported | /completion , /embed |
|
Azure OpenAI | ✅ Supported | /completion , /embed |
|
Anthropic | ✅ Supported | /complete |
|
Cohere | ✅ Supported | generate , embed |
|
Google Bard | 🚧 Coming Soon | ||
LocalAI | 🚧 Coming Soon |
📝 Full Documentation | 🎯 Roadmap | 🐞 Bug Reports | 💡 Feature Requests
📞 Talk to the devs: Rohit | Ayush
Changelog
We are excited to announce the stable release of the all-new Portkey Python SDK, version 0.1.44! This SDK makes it easier than ever to add production capabilities to your existing LLM systems with one line of change to your code.
Key Features and Enhancements of this release
-
Stability and Reliability: This release marks the stable version of Portkey Python SDK, thoroughly tested to ensure reliable performance in your projects.
-
Ease of Use: The SDK follows OpenAI SDK footprint, and with one line of change to your existing code, you can add Portkey's production features to your app.
-
Community Support: Join our growing community of practitioners putting LLMs in production. Share ideas, resolve doubts, and collaborate on projects.
Feedback and Contributions
We welcome your feedback and contributions! Feel free to report issues, suggest enhancements, or submit pull requests on our GitHub repository.
Thank you for your support and enthusiasm for the Portkey Python SDK. We look forward to seeing the amazing projects you will build with it!
Happy coding!
- The Portkey Team
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.