Python client library for the Portkey API
Project description
Portkey streamlines API requests to 20+ LLMs. It provides a unified API signature for interacting with all LLMs alongwith powerful LLM Gateway features like load balancing, fallbacks, retries and more.
pip install portkey-ai
💡 Features
🤝 Supported Providers
Provider | Support Status | Supported Endpoints | |
---|---|---|---|
OpenAI | ✅ Supported | /completion , /embed |
|
Azure OpenAI | ✅ Supported | /completion , /embed |
|
Anthropic | ✅ Supported | /complete |
|
Cohere | ✅ Supported | generate , embed |
|
Google Bard | 🚧 Coming Soon | ||
LocalAI | 🚧 Coming Soon |
📝 Full Documentation | 🎯 Roadmap | 🐞 Bug Reports | 💡 Feature Requests
📞 Talk to the devs: Rohit | Ayush
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
portkey-ai-0.1.40.tar.gz
(14.4 kB
view hashes)