The auxiliary tool is used to invoke the online LLM service API, supporting local caching, prompt rendering, and configuration management.
Project description
LLMQuiver
The auxiliary tool is used to invoke the online LLM service API, supporting local caching, prompt rendering, and configuration management.
Supported
- Support Openai/Azure LLM service providers (or openai-compatible service providers).
- Local caching (based on sqlite).
- Prompt rendering (based on toml and jinja2).
- Configuration management (based on toml).
To Be Done
- Multi service provider support.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
llm_quiver-0.3.0.tar.gz
(18.8 kB
view details)
Built Distribution
File details
Details for the file llm_quiver-0.3.0.tar.gz
.
File metadata
- Download URL: llm_quiver-0.3.0.tar.gz
- Upload date:
- Size: 18.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.1.1 CPython/3.12.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | ab81fa2fe85030f0eec024d72bf04f371b046214bc2c3f4335657b75eefac47d |
|
MD5 | 7273fa551520c021f7fc05f431fa24a9 |
|
BLAKE2b-256 | a70cadd0c089ebe2a477f4c32def3c4042784da69168b8a4b9e58803cdb2241a |
File details
Details for the file llm_quiver-0.3.0-py3-none-any.whl
.
File metadata
- Download URL: llm_quiver-0.3.0-py3-none-any.whl
- Upload date:
- Size: 20.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.1.1 CPython/3.12.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | b49f13ca6915b513271a4c654763700d8a671bbc5dc3a145c4876147a5f7089a |
|
MD5 | 9f79c76004ac4d04efe68cea6bfef4f4 |
|
BLAKE2b-256 | f9b23acb36e8653b65bd4ac2010b3e9928eb0988e02a12c80dd4719a7a12ee51 |