LLMForwarder
LLMForwarder is a Python package for forwarding chat requests to a locally hosted model API (such as OpenAI-compatible models). It allows users to configure the server address, port, and OpenAI API details, as well as customize request handling through an external function. This package is ideal for injecting custom context or pre-processing user messages before forwarding to the model API.
Features
- Configurable server address and port
- Flexible OpenAI API integration
- Customizable prompt-handling function, allowing easy injection of context or prompt modifications
- Easy setup and usage for OpenAI-compatible models
Installation
To install LLMForwarder, use pip:
pip install llm-forwarder
1 maintainer
Metadata
1 maintainer
Release files for llm-forwarder 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| llm_forwarder-0.1.0.tar.gz | 2.6 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| llm_forwarder-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 5.6 kB
Release files / llm_forwarder-0.1.0.tar.gz
| Download URL | llm_forwarder-0.1.0.tar.gz |
|---|---|
| Size | 2.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
3e1c1dd1dd27c395b9108d67537d43a91ee9511c1edcd514bffc55d62aa35036
|
|
BLAKE2b-256 checksum How to use checksums |
1fb2b2de6196130878bc6cbbf1d79ae3b6d79f8e12fc69374dedace315dd7150
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.12.3
|
Release files / llm_forwarder-0.1.0-py3-none-any.whl
| Download URL | llm_forwarder-0.1.0-py3-none-any.whl |
|---|---|
| Size | 3.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
7505f5ee3979a3140a0bffcd3f8b7d9d1991b91ab565374315fae73e6bbc5177
|
|
BLAKE2b-256 checksum How to use checksums |
4e282598568d0243e90ceb4dd7a80b9ce8613dcce6af7dfaae2ff43a64b78b4d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/5.1.1 CPython/3.12.3
|
