Flint
Deploy LLMs to Kubernetes.
v0.1.0 — early (alpha) release. Interfaces may still change; try it on a non-production cluster first. The GPU serving paths (vLLM, TGI) are best validated on your own hardware.
Flint is an open-source CLI that deploys large language models to your own Kubernetes cluster and routes traffic between versions. It uses your existing kubeconfig; there is no Flint server to operate.
Install
pip install flint-llm # the distribution is flint-llm; the CLI command is `flint`
Status
Alpha — v0.1.0. See CHANGELOG.md for what's included and docs/troubleshooting.md for common errors.
License
Apache 2.0. See LICENSE.
1 maintainer
Metadata
1 maintainer
Release files for flint-llm 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| flint_llm-0.1.0.tar.gz | 41.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| flint_llm-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 98.9 kB
Release files / flint_llm-0.1.0.tar.gz
| Download URL | flint_llm-0.1.0.tar.gz |
|---|---|
| Size | 41.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
2e889e8403c01aa82465cb2ec6e2377d02099587cee084702d8ffab56792042e
|
|
BLAKE2b-256 checksum How to use checksums |
f4210ec45a55f124ef02056f81b69d057de68dc1b91c6af07ba0c7ca0fd951e3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.13
|
Release files / flint_llm-0.1.0-py3-none-any.whl
| Download URL | flint_llm-0.1.0-py3-none-any.whl |
|---|---|
| Size | 57.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
2082d409243c476e99e40e2c53136334cd28cd890a5bfd02d98ae9fab4a8c042
|
|
BLAKE2b-256 checksum How to use checksums |
ce28f779081bb3e534d4580e7b74e82dee2532766d61f5f91ca5827bdf472fae
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.12.13
|
