unreasonable-llama
(Yet another) Python API for llama.cpp server
For now, i'm targeting minimal support necessary for /completion and /health endpoint.
Maybe i'll extend this lib in the future.
Requirements
unreasonable-llama has a single requirement - httpx library, see pyproject.toml for details.
Requirements for llama.cpp scripts can be found in requirements/ directory of theirs repository.
Usage
See test file for example usage.
1 maintainer
Metadata
1 maintainer
Release files for unreasonable-llama 0.4.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| unreasonable_llama-0.4.1.tar.gz | 8.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| unreasonable_llama-0.4.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 17.1 kB
Release files / unreasonable_llama-0.4.1.tar.gz
| Download URL | unreasonable_llama-0.4.1.tar.gz |
|---|---|
| Size | 8.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
fdf71327db58858673e6613c2121eee22b6ec0e308faae5684eab995e825a912
|
|
BLAKE2b-256 checksum How to use checksums |
2d4b8f3ad8554937e8f46442131c9436c34cbf0f09a0f016c34d6607f9cfcf55
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.8.3 CPython/3.12.7 Windows/11
|
Release files / unreasonable_llama-0.4.1-py3-none-any.whl
| Download URL | unreasonable_llama-0.4.1-py3-none-any.whl |
|---|---|
| Size | 8.8 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
98770302c3faac8a534f2753a3d72058f9205aba7a436539e6ef0b7fab74a6e6
|
|
BLAKE2b-256 checksum How to use checksums |
8ccbdaf94635c88a1dae83d243f7b8a99b12295e4a412a02a7b74d02cf6c5650
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.8.3 CPython/3.12.7 Windows/11
|
