HTTP API bindings for llama.cpp built-in server
Project description
unreasonable-llama
(Yet another) Python API for llama.cpp server
For now, i'm targeting minimal support necessary for /completion
and /health
endpoint.
Maybe i'll extend this lib in the future.
Requirements
unreasonable-llama
has a single requirement - httpx
library, see pyproject.toml
for details.
Requirements for llama.cpp
scripts can be found in requirements/
directory of theirs repository.
Usage
See test file for example usage.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for unreasonable_llama-0.3.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d947a08e5fa7f9bda58f1f80188d9e9c579b8a11cec2c00215f61f41e66f8ef0 |
|
MD5 | 50477b41364a1f32381bf61caca7e2df |
|
BLAKE2b-256 | ee3642ec504c32063bbe6fa6592e15db7532b9e2e3d6c496e495c494879c4cd9 |