Skip to main content

wave Dispatch — local-first AI router. `dispatch serve` runs an OpenAI-compatible proxy that routes each request to the cheapest capable model (local-first; escalate to your frontier only when needed). BYO keys + infra.

Project description

wave-dispatch (Python)

Thin client for wave Dispatch — route each request to the cheapest capable model (local-first; escalate to your frontier only when needed). BYO keys + infra. Zero deps.

from wave_dispatch import Dispatch

d = Dispatch()                      # reads WAVE_LICENSE env; omit license for x402 pay-per-use
print(d.route("find the auth handler"))   # {route, probability, margin, forward}
# d.execute("name 3 colors")        # run on the edge (if your plan allows)
# d.route_vector(vec768)            # matmul-only: cheapest/fastest

Python 3.8+. The edge worker is open-source: github.com/wave-av/dispatch-edge. A WAVE product.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wave_dispatch-0.4.1.tar.gz (5.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

wave_dispatch-0.4.1-py3-none-any.whl (6.6 kB view details)

Uploaded Python 3

File details

Details for the file wave_dispatch-0.4.1.tar.gz.

File metadata

  • Download URL: wave_dispatch-0.4.1.tar.gz
  • Upload date:
  • Size: 5.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for wave_dispatch-0.4.1.tar.gz
Algorithm Hash digest
SHA256 db506469a82b9e111e01c7a67f58fe65f36189c36632ef994634916f18bf8d83
MD5 9902d03ff436d87832a194cbb64e2b7f
BLAKE2b-256 bd924a134a420de1374d483c8235d72fc5e106f66329b0aa14edf63841a32e99

See more details on using hashes here.

File details

Details for the file wave_dispatch-0.4.1-py3-none-any.whl.

File metadata

  • Download URL: wave_dispatch-0.4.1-py3-none-any.whl
  • Upload date:
  • Size: 6.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for wave_dispatch-0.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 8bcfdfe37de63ad7b328bace990291b0035b49eb674848131f9776723f466d1c
MD5 d42a8020114ba63722c6fb91a7a55213
BLAKE2b-256 e03b98e17c720e0d3f94dde7034c6c14d18ad72e8ac1e22d7ed74a7552e7cf46

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page