An open-source Python REST API framework with built-in Generative AI integration.
Project description
InferaAPI 🚀
High-speed Python framework with built-in Generative AI, ready for real-world scale.
InferaAPI is a blazing-fast, Python-based open-source REST API framework built from scratch, with native support for Generative AI models like OpenAI (ChatGPT), Grok, and Ollama.
- 🤖 Multiple LLM providers (OpenAI, Anthropic, HuggingFace, custom)
- 📚 RESTful API with OpenAPI/Swagger documentation
- ⚡ Streaming responses (SSE and WebSockets)
- 🔄 Batch processing and model comparison
- 🛠️ Custom model registration
- 🔒 Rate limiting and authentication
- 🧪 Designed for research and experimentation
Installation
# Install from source
git clone https://github.com/yourusername/inferaapi.git
cd inferaapi
pip install -e .
# Or install directly
pip install inferaapi
## 📄 License
This project is licensed under the [MIT License](LICENSE).
---
## 🤝 Contributing
We welcome contributions of all kinds!
Please read the [CONTRIBUTING.md](CONTRIBUTING.md) for how to get started with development or submit an issue/PR.
---
## 🌐 Community & Links
- 📘 Documentation: _Coming Soon_
- 🧑💻 GitHub: [github.com/inferaapi/inferaapi](https://github.com/inferaapi/inferaapi)
- 💬 Discord/Forum: _Coming Soon_
---
Built with ❤️ for the AI dev community.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file inferaapi-0.1.0.tar.gz.
File metadata
- Download URL: inferaapi-0.1.0.tar.gz
- Upload date:
- Size: 23.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4e99426a36ae36ac22c196404b77bf6c406f928204a9711b5a9b7dc2b189c6bb
|
|
| MD5 |
6cf4832b35025e4f74ce36622fd1574e
|
|
| BLAKE2b-256 |
85dbaaf8e1d5f679fd4e4895fe82a05e4b4866973ad5d9c11b62829fc3e98c62
|
File details
Details for the file inferaapi-0.1.0-py3-none-any.whl.
File metadata
- Download URL: inferaapi-0.1.0-py3-none-any.whl
- Upload date:
- Size: 23.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.12.9
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7b0268fe4b37d41291532b1a37c2f415de59cbde0803cfc09a1b15d6dc9c406d
|
|
| MD5 |
c39f604ef7504345159e3403dc7c7fd9
|
|
| BLAKE2b-256 |
895ee4040d3008b28b4d02b561c6e6f6d2baf877f191895a9fc6af6e725119cc
|