Skip to main content

wave Dispatch — local-first AI router. `dispatch serve` runs an OpenAI-compatible proxy that routes each request to the cheapest capable model (local-first; escalate to your frontier only when needed). BYO keys + infra.

Project description

wave-dispatch (Python)

Thin client for wave Dispatch — route each request to the cheapest capable model (local-first; escalate to your frontier only when needed). BYO keys + infra. Zero deps.

from wave_dispatch import Dispatch

d = Dispatch()                      # reads WAVE_LICENSE env; omit license for x402 pay-per-use
print(d.route("find the auth handler"))   # {route, probability, margin, forward}
# d.execute("name 3 colors")        # run on the edge (if your plan allows)
# d.route_vector(vec768)            # matmul-only: cheapest/fastest

Python 3.8+. The edge worker is open-source: github.com/wave-av/dispatch-edge. A WAVE product.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wave_dispatch-0.3.0.tar.gz (5.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

wave_dispatch-0.3.0-py3-none-any.whl (6.6 kB view details)

Uploaded Python 3

File details

Details for the file wave_dispatch-0.3.0.tar.gz.

File metadata

  • Download URL: wave_dispatch-0.3.0.tar.gz
  • Upload date:
  • Size: 5.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for wave_dispatch-0.3.0.tar.gz
Algorithm Hash digest
SHA256 30eb38788e7723a82dbcf5e2c9b39e7c29a963220903a79e7d3eed77e578b039
MD5 ec037e7b222eb1dcd4762248223838ce
BLAKE2b-256 470a2756a9b6772c56473b02741fcfaa8c0647672be5634fa83fa0f0806abe82

See more details on using hashes here.

File details

Details for the file wave_dispatch-0.3.0-py3-none-any.whl.

File metadata

  • Download URL: wave_dispatch-0.3.0-py3-none-any.whl
  • Upload date:
  • Size: 6.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for wave_dispatch-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 b68f9b72484854fdb91e635346909a13c07ec5831ca00b861767d226712d0b7c
MD5 f6e3bc277dadf6241a2e21eda6abb41e
BLAKE2b-256 03f1c1f3b12b810dae334d4f204b6c143976a672dadd45d926b48275c2391140

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page