Routes LLM requests between cheap open-source and premium models based on task difficulty
Project description
shunt
Early development — APIs will change.
Shunt is a small, self-hosted router with an OpenAI-compatible API. It classifies every request — coding, reasoning, light chat — and forwards it to the cheapest open-source model that can handle it.
from shunt import Router
router = Router()
track = router.classify("Refactor this function to be async")
# -> "coding"
Planned for upcoming releases:
shunt serve— local OpenAI-compatible proxy server- Ordered fallback chains per track ("light", "general", "coding", "coding_heavy", "reasoning")
- YAML configuration and a local SQLite cost ledger
Status
v0.0.1 is a name-holding stub for the project under active development.
Follow progress at the project repository.
License
MIT
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file shunt-0.0.1.tar.gz.
File metadata
- Download URL: shunt-0.0.1.tar.gz
- Upload date:
- Size: 6.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
da2037251195e52a46523b252e40d91317ce2c1c82ea84cc3a61b5208adb94f8
|
|
| MD5 |
3ee0aaf24bf9c3da6e8ca723c3e09a5c
|
|
| BLAKE2b-256 |
2cd832313f8c673b91ee98c74321394c8aa584e0027e8a6fb311647ea789a42f
|
File details
Details for the file shunt-0.0.1-py3-none-any.whl.
File metadata
- Download URL: shunt-0.0.1-py3-none-any.whl
- Upload date:
- Size: 3.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.12.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1e02ae24b3c756da8eeb0019003f9e28928a57bd57c9745c63791b81b75bd6f9
|
|
| MD5 |
655c8fa8b2f8281368d7e542b85a58f5
|
|
| BLAKE2b-256 |
20abe414fad8f667f41a8f0e584aa183e85082a7e9ca66ec8a1eda34cd11e9a9
|
