Skip to main content

An open-source Python REST API framework with built-in Generative AI integration.

Project description

InferaAPI 🚀

PyPI Version Python Versions Tests License Code Coverage

High-speed Python framework with built-in Generative AI, ready for real-world scale.

InferaAPI is a blazing-fast, Python-based open-source REST API framework built from scratch, with native support for Generative AI models like OpenAI (ChatGPT), Grok, and Ollama.

  • 🤖 Multiple LLM providers (OpenAI, Anthropic, HuggingFace, custom)
  • 📚 RESTful API with OpenAPI/Swagger documentation
  • ⚡ Streaming responses (SSE and WebSockets)
  • 🔄 Batch processing and model comparison
  • 🛠️ Custom model registration
  • 🔒 Rate limiting and authentication
  • 🧪 Designed for research and experimentation

Installation

# Install from source
git clone https://github.com/yourusername/inferaapi.git
cd inferaapi
pip install -e .

# Or install directly
pip install inferaapi


## 📄 License

This project is licensed under the [MIT License](LICENSE).

---

## 🤝 Contributing

We welcome contributions of all kinds!  
Please read the [CONTRIBUTING.md](CONTRIBUTING.md) for how to get started with development or submit an issue/PR.

---

## 🌐 Community & Links

- 📘 Documentation: _Coming Soon_
- 🧑‍💻 GitHub: [github.com/inferaapi/inferaapi](https://github.com/inferaapi/inferaapi)
- 💬 Discord/Forum: _Coming Soon_

---

Built with ❤️ for the AI dev community.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

inferaapi-0.1.0.tar.gz (23.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

inferaapi-0.1.0-py3-none-any.whl (23.5 kB view details)

Uploaded Python 3

File details

Details for the file inferaapi-0.1.0.tar.gz.

File metadata

  • Download URL: inferaapi-0.1.0.tar.gz
  • Upload date:
  • Size: 23.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for inferaapi-0.1.0.tar.gz
Algorithm Hash digest
SHA256 4e99426a36ae36ac22c196404b77bf6c406f928204a9711b5a9b7dc2b189c6bb
MD5 6cf4832b35025e4f74ce36622fd1574e
BLAKE2b-256 85dbaaf8e1d5f679fd4e4895fe82a05e4b4866973ad5d9c11b62829fc3e98c62

See more details on using hashes here.

File details

Details for the file inferaapi-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: inferaapi-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 23.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for inferaapi-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7b0268fe4b37d41291532b1a37c2f415de59cbde0803cfc09a1b15d6dc9c406d
MD5 c39f604ef7504345159e3403dc7c7fd9
BLAKE2b-256 895ee4040d3008b28b4d02b561c6e6f6d2baf877f191895a9fc6af6e725119cc

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page