Skip to main content

Python client library for the Rubeus API

Project description


Rubeus streamlines API requests to 20+ LLMs. It provides a unified API signature for interacting with all LLMs alongwith powerful LLM Gateway features like load balancing, fallbacks, retries and more.

pip install rubeus

💡 Features

Name Description Example
🌐 Interoperability Write once, run with any provider. Switch between __ models from __ providers seamlessly. Open In Colab
🔀 Fallback Strategies Don't let failures stop you. If one provider fails, Rubeus can automatically switch to another. Open In Colab
🔄 Retry Strategies Temporary issues shouldn't mean manual re-runs. Rubeus can automatically retry failed requests. Open In Colab
⚖️ Load Balancing Distribute load effectively across multiple API keys or providers based on custom weights. Open In Colab
📝 Unified API Signature If you've used OpenAI, you already know how to use Rubeus with any other provider. Open In Colab

🤝 Supported Providers

Provider Support Status Supported Endpoints
OpenAI ✅ Supported /completion, /embed
Azure OpenAI ✅ Supported /completion, /embed
Anthropic ✅ Supported /complete
Cohere ✅ Supported generate, embed
Google Bard 🚧 Coming Soon
LocalAI 🚧 Coming Soon

📝 Full Documentation | 🎯 Roadmap | 🐞 Bug Reports | 💡 Feature Requests

📞 Talk to the devs: Rohit | Ayush

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rubeus-0.1.24.tar.gz (15.0 kB view details)

Uploaded Source

Built Distribution

rubeus-0.1.24-py3-none-any.whl (17.0 kB view details)

Uploaded Python 3

File details

Details for the file rubeus-0.1.24.tar.gz.

File metadata

  • Download URL: rubeus-0.1.24.tar.gz
  • Upload date:
  • Size: 15.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.2

File hashes

Hashes for rubeus-0.1.24.tar.gz
Algorithm Hash digest
SHA256 6b1cf6806a4bc964e558d5da6cf43c43541e8f17b07cde2699c0cec2edbd3a9e
MD5 028a37aeea3103259c79abcf9edddd24
BLAKE2b-256 57b74f6ed774d62719e5f4c5a5fe2b596c6a66cd6546f42edfdc9535fd32d748

See more details on using hashes here.

File details

Details for the file rubeus-0.1.24-py3-none-any.whl.

File metadata

  • Download URL: rubeus-0.1.24-py3-none-any.whl
  • Upload date:
  • Size: 17.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.10.2

File hashes

Hashes for rubeus-0.1.24-py3-none-any.whl
Algorithm Hash digest
SHA256 1fa7d7abd658d05d351235b810a90c8ac099980dc841452c35d811b2e07a4b69
MD5 52258e50facd9d2b2f8a9dfeb9b87678
BLAKE2b-256 373f8c2724d9eac515f4ce6c6d5fdc9a6b9de174d2e1b5b3fe99e80882afab9d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page