wave Dispatch — local-first AI router. `dispatch serve` runs an OpenAI-compatible proxy that routes each request to the cheapest capable model (local-first; escalate to your frontier only when needed). BYO keys + infra.
Project description
wave-dispatch (Python)
Thin client for wave Dispatch — route each request to the cheapest capable model (local-first; escalate to your frontier only when needed). BYO keys + infra. Zero deps.
from wave_dispatch import Dispatch
d = Dispatch() # reads WAVE_LICENSE env; omit license for x402 pay-per-use
print(d.route("find the auth handler")) # {route, probability, margin, forward}
# d.execute("name 3 colors") # run on the edge (if your plan allows)
# d.route_vector(vec768) # matmul-only: cheapest/fastest
Python 3.8+. The edge worker is open-source: github.com/wave-av/dispatch-edge. A WAVE product.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file wave_dispatch-0.3.0.tar.gz.
File metadata
- Download URL: wave_dispatch-0.3.0.tar.gz
- Upload date:
- Size: 5.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.15
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
30eb38788e7723a82dbcf5e2c9b39e7c29a963220903a79e7d3eed77e578b039
|
|
| MD5 |
ec037e7b222eb1dcd4762248223838ce
|
|
| BLAKE2b-256 |
470a2756a9b6772c56473b02741fcfaa8c0647672be5634fa83fa0f0806abe82
|
File details
Details for the file wave_dispatch-0.3.0-py3-none-any.whl.
File metadata
- Download URL: wave_dispatch-0.3.0-py3-none-any.whl
- Upload date:
- Size: 6.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.15
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b68f9b72484854fdb91e635346909a13c07ec5831ca00b861767d226712d0b7c
|
|
| MD5 |
f6e3bc277dadf6241a2e21eda6abb41e
|
|
| BLAKE2b-256 |
03f1c1f3b12b810dae334d4f204b6c143976a672dadd45d926b48275c2391140
|