Caikit Text Generation Inference Service (TGIS) Backend
This project provides a Caikit module backend that manages models run in TGIS
Configuration
Sample configuration using the MULTI finder and a remote TGIS backend):
runtime:
library: caikit_nlp
local_models_dir: /path/to/models
lazy_load_local_models: true
model_management:
finders:
default:
type: MULTI
config:
finder_priority:
- local
- tgis-auto
initializers:
default:
type: LOCAL
config:
backend_priority:
- type: TGIS
config:
connection:
hostname: "localhost:8033"
connect_timeout: 30
test_connections: true
log:
formatter: pretty
2 maintainers
Metadata
2 maintainers
Release files for caikit-tgis-backend 0.1.39
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | |
|---|---|---|---|---|
| caikit_tgis_backend-0.1.39.tar.gz | 54.5 kB | Without provenance | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| caikit_tgis_backend-0.1.39-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 86.3 kB
Release files / caikit_tgis_backend-0.1.39.tar.gz
| Download URL | caikit_tgis_backend-0.1.39.tar.gz |
|---|---|
| Size | 54.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
942ff2854a536899f0b26ccafb840a826e7e02875d92b930cd6e4f0e5556611a
|
|
BLAKE2b-256 checksum How to use checksums |
a8cd28014c2af378288e5b748c0f2e8a90152acff9da3a106cf792e25afea3ab
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
Release files / caikit_tgis_backend-0.1.39-py3-none-any.whl
| Download URL | caikit_tgis_backend-0.1.39-py3-none-any.whl |
|---|---|
| Size | 31.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
3af9d24e8a00d776480365c7b89de7830725daef424570c8cb8e009f83115796
|
|
BLAKE2b-256 checksum How to use checksums |
0600f5c4fb6d05e3c105ea772445fc912ac1f773361519fbd22110fe7b923737
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.9
|
Security for caikit-tgis-backend 0.1.39
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
