Skip to main content

HTTP API bindings for llama.cpp built-in server

Project description

unreasonable-llama

(Yet another) Python API for llama.cpp server

For now, i'm targeting minimal support necessary for /completion and /health endpoint. Maybe i'll extend this lib in the future.

Requirements

unreasonable-llama has a single requirement - httpx library, see pyproject.toml for details.

Requirements for llama.cpp scripts can be found in requirements/ directory of theirs repository.

Usage

See test file for example usage.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

unreasonable_llama-0.2.1.tar.gz (3.9 kB view details)

Uploaded Source

Built Distribution

unreasonable_llama-0.2.1-py3-none-any.whl (4.4 kB view details)

Uploaded Python 3

File details

Details for the file unreasonable_llama-0.2.1.tar.gz.

File metadata

  • Download URL: unreasonable_llama-0.2.1.tar.gz
  • Upload date:
  • Size: 3.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.2 CPython/3.12.4 Windows/11

File hashes

Hashes for unreasonable_llama-0.2.1.tar.gz
Algorithm Hash digest
SHA256 8a0ee7b7b3389e7ee9016f9fb5e61fa3b3a308d9e8b77fd2e1fce9097a6cf72d
MD5 a4d50a2ac944559928c4fee8634672e6
BLAKE2b-256 37af6d0fc3363a95346a272dc3bf15ceb1d1c7a09652883e37265334bda03dc6

See more details on using hashes here.

File details

Details for the file unreasonable_llama-0.2.1-py3-none-any.whl.

File metadata

File hashes

Hashes for unreasonable_llama-0.2.1-py3-none-any.whl
Algorithm Hash digest
SHA256 97311df91e8c47f42a086bb93f6e1ad00c27e5abfde46c5fb1e5ceb1ef683e92
MD5 88ad38e2d94380b93fd37ff1b70d1f37
BLAKE2b-256 5a950b19b3b9590876a1ee1f7d0e9d5b62b3dc4d46ff46784c7962d5f3822bc2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page