A flexible inference framework for large language models
Project description
Infraion
A flexible inference framework for large language models.
Installation
pip install infraion
With provider support:
pip install infraion[openai]
pip install infraion[anthropic]
pip install infraion[all]
Quick Start
from infraion import InfraionEngine, InfraionConfig
config = InfraionConfig(model="gpt-4")
engine = InfraionEngine(config)
response = await engine.generate("Hello, world!")
print(response)
Status
This package is currently in pre-alpha. Full implementation coming soon.
License
Apache-2.0
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
infraion-0.1.0.tar.gz
(7.7 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file infraion-0.1.0.tar.gz.
File metadata
- Download URL: infraion-0.1.0.tar.gz
- Upload date:
- Size: 7.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
81ae2a25850f152b171d62d5932de950664849cd0e3cb7b9e6574bcc76d082c4
|
|
| MD5 |
1f6c6c26fa18afa9e88eacf0ae0e025b
|
|
| BLAKE2b-256 |
b4e43108f8a4695790575d6bdcd8ebcfacca801c3bc1b6c1f8b7a58ea279ff6e
|
File details
Details for the file infraion-0.1.0-py3-none-any.whl.
File metadata
- Download URL: infraion-0.1.0-py3-none-any.whl
- Upload date:
- Size: 8.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
abba670003eb964083494df89831847dd099453a6d60f48532c9cac9286c2e6c
|
|
| MD5 |
cf6de88ce244400f58166be2f1882fe6
|
|
| BLAKE2b-256 |
cce72b716dcb351fb52097e9323fea5e0e31f23668f65de7136edc4183d0118a
|
