👾 OpenLLM Client
OpenLLM Client: Interacting with OpenLLM HTTP/gRPC server, or any BentoML server.
📖 Introduction
With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps, and more.
To learn more about OpenLLM, please visit OpenLLM's README.md
This package holds the underlying client implementation for OpenLLM. If you are
coming from OpenLLM, the client can be accessed via openllm.client.
import openllm
client = openllm.client.HTTPClient()
client.query('Explain to me the difference between "further" and "farther"')
📔 Citation
If you use OpenLLM in your research, we provide a citation to use:
@software{Pham_OpenLLM_Operating_LLMs_2023,
author = {Pham, Aaron and Yang, Chaoyu and Sheng, Sean and Zhao, Shenyang and Lee, Sauyon and Jiang, Bo and Dong, Fog and Guan, Xipeng and Ming, Frost},
license = {Apache-2.0},
month = jun,
title = {{OpenLLM: Operating LLMs in production}},
url = {https://github.com/bentoml/OpenLLM},
year = {2023}
}
1 maintainer
Metadata
1 maintainer
Release files for openllm-client 0.5.7
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| openllm_client-0.5.7.tar.gz | 19.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| openllm_client-0.5.7-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 37.0 kB
Release files / openllm_client-0.5.7.tar.gz
| Download URL | openllm_client-0.5.7.tar.gz |
|---|---|
| Size | 19.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5fa9ab4b5d65a149dce91328bf734123846b8e48af3cdc16ee183e809db61b00
|
|
BLAKE2b-256 checksum How to use checksums |
fd7e5d613df776e3eccfdd76b35cec613a0ce8fec4be9340bf13feb6bc115588
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/5.0.0 CPython/3.12.4
|
Release files / openllm_client-0.5.7-py3-none-any.whl
| Download URL | openllm_client-0.5.7-py3-none-any.whl |
|---|---|
| Size | 17.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
ea6a7c2644ac0a7d8bb007900b7b54128309ce971127a46f9d3a46c1a431977d
|
|
BLAKE2b-256 checksum How to use checksums |
264d6b0dc71a0b42159ee09911bb7f175e8e5b13c35e2b933db15e4bf42b0f2e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/5.0.0 CPython/3.12.4
|
