Skip to main content

The auxiliary tool is used to invoke the online LLM service API, supporting local caching, prompt rendering, and configuration management.

Project description

LLMQuiver

The auxiliary tool is used to invoke the online LLM service API, supporting local caching, prompt rendering, and configuration management.

Supported

  • Support Openai/Azure LLM service providers (or openai-compatible service providers).
  • Local caching (based on sqlite).
  • Prompt rendering (based on toml and jinja2).
  • Configuration management (based on toml).

To Be Done

  • Multi service provider support.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

llm_quiver-0.3.0.tar.gz (18.8 kB view details)

Uploaded Source

Built Distribution

llm_quiver-0.3.0-py3-none-any.whl (20.1 kB view details)

Uploaded Python 3

File details

Details for the file llm_quiver-0.3.0.tar.gz.

File metadata

  • Download URL: llm_quiver-0.3.0.tar.gz
  • Upload date:
  • Size: 18.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for llm_quiver-0.3.0.tar.gz
Algorithm Hash digest
SHA256 ab81fa2fe85030f0eec024d72bf04f371b046214bc2c3f4335657b75eefac47d
MD5 7273fa551520c021f7fc05f431fa24a9
BLAKE2b-256 a70cadd0c089ebe2a477f4c32def3c4042784da69168b8a4b9e58803cdb2241a

See more details on using hashes here.

File details

Details for the file llm_quiver-0.3.0-py3-none-any.whl.

File metadata

  • Download URL: llm_quiver-0.3.0-py3-none-any.whl
  • Upload date:
  • Size: 20.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/5.1.1 CPython/3.12.7

File hashes

Hashes for llm_quiver-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b49f13ca6915b513271a4c654763700d8a671bbc5dc3a145c4876147a5f7089a
MD5 9f79c76004ac4d04efe68cea6bfef4f4
BLAKE2b-256 f9b23acb36e8653b65bd4ac2010b3e9928eb0988e02a12c80dd4719a7a12ee51

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page