📖 Introduction
With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps, and more.
To learn more about OpenLLM, please visit OpenLLM's README.md
This package holds the core components of OpenLLM, and considered as internal.
Components includes:
- Configuration generation.
- Utilities for interacting with OpenLLM server.
- Schema and generation utilities for OpenLLM server.
📔 Citation
If you use OpenLLM in your research, we provide a citation to use:
@software{Pham_OpenLLM_Operating_LLMs_2023,
author = {Pham, Aaron and Yang, Chaoyu and Sheng, Sean and Zhao, Shenyang and Lee, Sauyon and Jiang, Bo and Dong, Fog and Guan, Xipeng and Ming, Frost},
license = {Apache-2.0},
month = jun,
title = {{OpenLLM: Operating LLMs in production}},
url = {https://github.com/bentoml/OpenLLM},
year = {2023}
}
Metadata
Release files for openllm-core 0.5.7
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| openllm_core-0.5.7.tar.gz | 52.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| openllm_core-0.5.7-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 123.7 kB
Release files / openllm_core-0.5.7.tar.gz
| Download URL | openllm_core-0.5.7.tar.gz |
|---|---|
| Size | 52.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
e48fa13e1172b859cba0288cdba23c90a6423e3a04d2b4e157221005b9a76308
|
|
BLAKE2b-256 checksum How to use checksums |
e68bcd3edc28882c51f705f30c04a1600528bfbb0ee9586613eb9b3ed1094672
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/5.0.0 CPython/3.12.4
|
Release files / openllm_core-0.5.7-py3-none-any.whl
| Download URL | openllm_core-0.5.7-py3-none-any.whl |
|---|---|
| Size | 71.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
376847ac66358ecf1a47af905701518db0084f3a434f28a8d1239ca79f77b7a8
|
|
BLAKE2b-256 checksum How to use checksums |
8b61015a6ace0908eb9cb9ae2a21d0cf411fb085138d413a86a7e619e3c6c052
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/5.0.0 CPython/3.12.4
|