callllm

Asynchronous, concurrent requests to the LLM REST APIs, that respect their rate limits, using gevent and requests.

These details have not been verified by PyPI

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Development Status
- 4 - Beta
Intended Audience
- Developers
License
- OSI Approved :: BSD License
Operating System
- OS Independent
Programming Language
- Python
Topic
- Internet :: WWW/HTTP
- Software Development :: Libraries :: Python Modules

Project description

# CallLLM

Asynchronous, concurrent requests to the LLM REST API, that respect its’s rate limits, using [gevent](http://www.gevent.org/) and [requests](http://docs.python-requests.org/).

See example.py for a working example.

## Installation Simply:

$ pip install callllm

These details have not been verified by PyPI

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Development Status
- 4 - Beta
Intended Audience
- Developers
License
- OSI Approved :: BSD License
Operating System
- OS Independent
Programming Language
- Python
Topic
- Internet :: WWW/HTTP
- Software Development :: Libraries :: Python Modules

0.1.1

Jul 5, 2023

This version

0.1.0

Jul 5, 2023

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Uploaded Jul 5, 2023 Source

Uploaded Jul 5, 2023 Python 3

Hashes for callllm-0.1.0.tar.gz
Algorithm	Hash digest
SHA256	`1fd24844961f2b51c619eeb88534b547b9fca0e8bc36e2bbb33982e74a360319`
MD5	`eb4c776510c87a650315bffd2d14174e`
BLAKE2b-256	`176acc553dd8b2354a91fade01e3ba0596950837b23e9fe366d16ff6c4fedcf4`

Hashes for callllm-0.1.0-py3-none-any.whl
Algorithm	Hash digest
SHA256	`cd3d26138ce89c6f9bed4fbf1b2bcb9d95d60da2ac2b991c1993bd15b509e299`
MD5	`539cd3ab2d2c89a99dc33527b3af4b3a`
BLAKE2b-256	`0d7836e1b3afba81d6ec881a5025a7f4e6dacc2ff3bcb49831bb73c726318b08`