Asynchronous, concurrent requests to the LLM REST APIs, that respect their rate limits, using gevent and requests.
Project description
# CallLLM
Asynchronous, concurrent requests to the LLM REST API, that respect its’s rate limits, using [gevent](http://www.gevent.org/) and [requests](http://docs.python-requests.org/).
See example.py for a working example.
## Installation Simply:
$ pip install callllm
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
callllm-0.1.0.tar.gz
(3.7 kB
view details)
Built Distribution
File details
Details for the file callllm-0.1.0.tar.gz.
File metadata
- Download URL: callllm-0.1.0.tar.gz
- Upload date:
- Size: 3.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 1fd24844961f2b51c619eeb88534b547b9fca0e8bc36e2bbb33982e74a360319 |
|
| MD5 | eb4c776510c87a650315bffd2d14174e |
|
| BLAKE2b-256 | 176acc553dd8b2354a91fade01e3ba0596950837b23e9fe366d16ff6c4fedcf4 |
File details
Details for the file callllm-0.1.0-py3-none-any.whl.
File metadata
- Download URL: callllm-0.1.0-py3-none-any.whl
- Upload date:
- Size: 3.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/4.0.2 CPython/3.10.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | cd3d26138ce89c6f9bed4fbf1b2bcb9d95d60da2ac2b991c1993bd15b509e299 |
|
| MD5 | 539cd3ab2d2c89a99dc33527b3af4b3a |
|
| BLAKE2b-256 | 0d7836e1b3afba81d6ec881a5025a7f4e6dacc2ff3bcb49831bb73c726318b08 |
