HTTP API bindings for llama.cpp built-in server
Project description
unreasonable-llama
(Yet another) Python API for llama.cpp server
For now, i'm targeting minimal support necessary for /completion and /health endpoint.
Maybe i'll extend this lib in the future.
Requirements
unreasonable-llama has a single requirement - httpx library, see pyproject.toml for details.
Requirements for llama.cpp scripts can be found in requirements/ directory of theirs repository.
Usage
See test file for example usage.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for unreasonable_llama-0.2.8-py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 48598326a318bf2ba4d9cdbd9e8116d667333da7e2e19cad66882449c73f2188 |
|
| MD5 | 9ddd1c59377812ca616abd4106b31cbf |
|
| BLAKE2b-256 | 5138597981c072a130567ea32f4b90448596ce64dadc81d1b0186e8bb36af8ec |
