📖 Introduction
With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps, and more.
To learn more about OpenLLM, please visit OpenLLM's README.md
This package holds the core components of OpenLLM, and considered as internal.
Components includes:
- Configuration generation.
- Utilities for interacting with OpenLLM server.
- Schema and generation utilities for OpenLLM server.
📔 Citation
If you use OpenLLM in your research, we provide a citation to use:
@software{Pham_OpenLLM_Operating_LLMs_2023,
author = {Pham, Aaron and Yang, Chaoyu and Sheng, Sean and Zhao, Shenyang and Lee, Sauyon and Jiang, Bo and Dong, Fog and Guan, Xipeng and Ming, Frost},
license = {Apache-2.0},
month = jun,
title = {{OpenLLM: Operating LLMs in production}},
url = {https://github.com/bentoml/OpenLLM},
year = {2023}
}
Release files for openllm-core 0.3.10
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| openllm_core-0.3.10.tar.gz | 69.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| openllm_core-0.3.10-py3-none-any.whl | Python 3 | none | any | Details |
Total release size:155.0 kB
Release files / openllm_core-0.3.10.tar.gz
| Download URL | openllm_core-0.3.10.tar.gz |
|---|---|
| Size | 69.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
8d7d0fcdeef65994d77764b479c462802632519caa579c74e0c388c7ccc092d7
|
|
BLAKE2b-256 checksum How to use checksums |
9a971e5a49f2cc69b1d1f800c97b1352cf1df5016df2da625c575afaf7f476fb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/4.0.2 CPython/3.11.6
|
Release files / openllm_core-0.3.10-py3-none-any.whl
| Download URL | openllm_core-0.3.10-py3-none-any.whl |
|---|---|
| Size | 85.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
85866f6b216362f3a2bbeb6f7e9faab56e3130cba1703cac612afe251a2d9c04
|
|
BLAKE2b-256 checksum How to use checksums |
23a243ad39e77a900f3ea3fb4e4a7cab926883a53fe667038b2eeaf3b339b87a
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/4.0.2 CPython/3.11.6
|