pankhllm-server
The pankhllm router binary, installed with pip. pankhllm is the LLM gateway that learns to skip the LLM: it trains its own tiny decision model on your agent's traffic and answers repeat decisions in about 0.2 ms on a CPU with no LLM call. Everything unfamiliar still goes to the LLM you already use. OpenAI-compatible.
pip install pankhllm-server
pankhllm serve --port 4000 # then point any OpenAI client at http://localhost:4000/v1
The pure-Python client and executor helper are in the pankhllm package:
pip install pankhllm. Live demo and docs: https://singhpratech.github.io/pankhllm/
1 maintainer
Release files for pankhllm-server 0.1.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distributions (wheels)
| File | Reset | |||
|---|---|---|---|---|
| pankhllm_server-0.1.1-py3-none-win_amd64.whl | Python 3 | none | Windows x86-64 | Details |
| pankhllm_server-0.1.1-py3-none-manylinux_2_34_x86_64.whl | Python 3 | none | Linux glibc 2.34+ x86-64 | Details |
| pankhllm_server-0.1.1-py3-none-manylinux_2_28_x86_64.whl | Python 3 | none | Linux glibc 2.28+ x86-64 | Details |
| pankhllm_server-0.1.1-py3-none-manylinux_2_28_aarch64.whl | Python 3 | none | Linux glibc 2.28+ ARM64 | Details |
| pankhllm_server-0.1.1-py3-none-macosx_11_0_arm64.whl | Python 3 | none | macOS 11.0+ ARM64 | Details |
| pankhllm_server-0.1.1-py3-none-macosx_10_12_x86_64.whl | Python 3 | none | macOS 10.12+ x86-64 | Details |
Total release size: 31.5 MB
Release files / pankhllm_server-0.1.1-py3-none-win_amd64.whl
| Download URL | pankhllm_server-0.1.1-py3-none-win_amd64.whl |
|---|---|
| Size | 5.5 MB |
| Tags | Python 3 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
8c0c08af2971442daa4a5aab5a84f94931ca809757782cbc508e12ddd9fdd9e8
|
|
BLAKE2b-256 checksum How to use checksums |
3c922228bc500b528808bcd8c63579b796945a9960c2db0a1b87a6dda5090d8b
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Release files / pankhllm_server-0.1.1-py3-none-manylinux_2_34_x86_64.whl
| Download URL | pankhllm_server-0.1.1-py3-none-manylinux_2_34_x86_64.whl |
|---|---|
| Size | 5.4 MB |
| Tags | Linux glibc 2.34+ x86-64 Python 3 |
|
SHA-256 checksum How to use checksums |
0c45c84576aabc0a2901d3eeef070c77ccc35868ecd2b37defbd1af82cd27757
|
|
BLAKE2b-256 checksum How to use checksums |
0ac245b7f77cd5c029be311ff977e2b7884a061bf6a817b1bfa770f4e56e7e0e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.3
|
Release files / pankhllm_server-0.1.1-py3-none-manylinux_2_28_x86_64.whl
| Download URL | pankhllm_server-0.1.1-py3-none-manylinux_2_28_x86_64.whl |
|---|---|
| Size | 5.4 MB |
| Tags | Linux glibc 2.28+ x86-64 Python 3 |
|
SHA-256 checksum How to use checksums |
33bd681187ad6bc800fb1926098350c2522eac9c0605b14a1127282bd8264e48
|
|
BLAKE2b-256 checksum How to use checksums |
eccc382b4f4cf073109a31237b27d5e4079b765b93d4f24f256532f0ea8a0db0
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Release files / pankhllm_server-0.1.1-py3-none-manylinux_2_28_aarch64.whl
| Download URL | pankhllm_server-0.1.1-py3-none-manylinux_2_28_aarch64.whl |
|---|---|
| Size | 5.2 MB |
| Tags | Linux glibc 2.28+ ARM64 Python 3 |
|
SHA-256 checksum How to use checksums |
e67c1e16b86f96e103ca3d82d8eab611b9d0ab0d164e2288fe5a1978ab0060c6
|
|
BLAKE2b-256 checksum How to use checksums |
b28fea5541b08d5f11a0374983b59f01dfec969f0acf22988fe7820d1f253dcb
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Release files / pankhllm_server-0.1.1-py3-none-macosx_11_0_arm64.whl
| Download URL | pankhllm_server-0.1.1-py3-none-macosx_11_0_arm64.whl |
|---|---|
| Size | 4.8 MB |
| Tags | Python 3 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
9144b118923adea1ecaec91d7f91800c1a841aad5edbb155e1b52f26fbe9dacd
|
|
BLAKE2b-256 checksum How to use checksums |
a684e9c462724f91cde38f0fecca51c077b8696ff3f5f11ea8169d0558866df3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
Release files / pankhllm_server-0.1.1-py3-none-macosx_10_12_x86_64.whl
| Download URL | pankhllm_server-0.1.1-py3-none-macosx_10_12_x86_64.whl |
|---|---|
| Size | 5.2 MB |
| Tags | Python 3 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
67f079f9c0ac36da472bfd551fa483d92a75810f83182c6735159fb00c7660aa
|
|
BLAKE2b-256 checksum How to use checksums |
f94eb2817eab4838e32900b04dcef40e3d1a0a221daf12ad92e4f5601b0236c5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.13.14
|
