Skip to main content

wave Dispatch — local-first AI router. `dispatch serve` runs an OpenAI-compatible proxy that routes each request to the cheapest capable model (local-first; escalate to your frontier only when needed). BYO keys + infra.

Project description

wave-dispatch (Python)

Thin client for wave Dispatch — route each request to the cheapest capable model (local-first; escalate to your frontier only when needed). BYO keys + infra. Zero deps.

from wave_dispatch import Dispatch

d = Dispatch()                      # reads WAVE_LICENSE env; omit license for x402 pay-per-use
print(d.route("find the auth handler"))   # {route, probability, margin, forward}
# d.execute("name 3 colors")        # run on the edge (if your plan allows)
# d.route_vector(vec768)            # matmul-only: cheapest/fastest

Python 3.8+. The edge worker is open-source: github.com/wave-av/dispatch-edge. A WAVE product.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wave_dispatch-0.4.2.tar.gz (5.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

wave_dispatch-0.4.2-py3-none-any.whl (6.6 kB view details)

Uploaded Python 3

File details

Details for the file wave_dispatch-0.4.2.tar.gz.

File metadata

  • Download URL: wave_dispatch-0.4.2.tar.gz
  • Upload date:
  • Size: 5.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for wave_dispatch-0.4.2.tar.gz
Algorithm Hash digest
SHA256 0d796c3eea6f429cbcdb2c20746911bfea73f8d013422983ef9ff44d1d314626
MD5 90365446f02c320a56093a0a18afe68d
BLAKE2b-256 f408582a6df0ea9d2a0ccdb6081618bbf93f990e2c6bacd0dc896624d9f60964

See more details on using hashes here.

File details

Details for the file wave_dispatch-0.4.2-py3-none-any.whl.

File metadata

  • Download URL: wave_dispatch-0.4.2-py3-none-any.whl
  • Upload date:
  • Size: 6.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for wave_dispatch-0.4.2-py3-none-any.whl
Algorithm Hash digest
SHA256 844abfe702cffd4536f1233d52a6df44588880eef01d52e01224747af2c0f925
MD5 cb51c61c77c7a3b26a7a4bf97d16f85c
BLAKE2b-256 f70da7513edfaf82c13b78b1d9f8547b55a2a665ef1682cc06f6128dbc64d24e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page