🦑 OpenLLM Core
OpenLLM Core: Core components for OpenLLM.
📖 Introduction
With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps, and more.
To learn more about OpenLLM, please visit OpenLLM's README.md
This package holds the core components of OpenLLM, and considered as internal.
Components includes:
- Configuration generation.
- Utilities for interacting with OpenLLM server.
- Schema and generation utilities for OpenLLM server.
📔 Citation
If you use OpenLLM in your research, we provide a citation to use:
@software{Pham_OpenLLM_Operating_LLMs_2023,
author = {Pham, Aaron and Yang, Chaoyu and Sheng, Sean and Zhao, Shenyang and Lee, Sauyon and Jiang, Bo and Dong, Fog and Guan, Xipeng and Ming, Frost},
license = {Apache-2.0},
month = jun,
title = {{OpenLLM: Operating LLMs in production}},
url = {https://github.com/bentoml/OpenLLM},
year = {2023}
}
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file openllm_core-0.5.7.tar.gz.
File metadata
- Download URL: openllm_core-0.5.7.tar.gz
- Upload date:
- Size: 52.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/5.0.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e48fa13e1172b859cba0288cdba23c90a6423e3a04d2b4e157221005b9a76308
|
|
| MD5 |
0fd265dca010f20f22eff5f3e686b805
|
|
| BLAKE2b-256 |
e68bcd3edc28882c51f705f30c04a1600528bfbb0ee9586613eb9b3ed1094672
|
File details
Details for the file openllm_core-0.5.7-py3-none-any.whl.
File metadata
- Download URL: openllm_core-0.5.7-py3-none-any.whl
- Upload date:
- Size: 71.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/5.0.0 CPython/3.12.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
376847ac66358ecf1a47af905701518db0084f3a434f28a8d1239ca79f77b7a8
|
|
| MD5 |
a0964441c7f12d30e615c1cd49566a5d
|
|
| BLAKE2b-256 |
8b61015a6ace0908eb9cb9ae2a21d0cf411fb085138d413a86a7e619e3c6c052
|
