Skip to main content

wave Dispatch — local-first AI router. `dispatch serve` runs an OpenAI-compatible proxy that routes each request to the cheapest capable model (local-first; escalate to your frontier only when needed). BYO keys + infra.

Project description

wave-dispatch (Python)

Thin client for wave Dispatch — route each request to the cheapest capable model (local-first; escalate to your frontier only when needed). BYO keys + infra. Zero deps.

from wave_dispatch import Dispatch

d = Dispatch()                      # reads WAVE_LICENSE env; omit license for x402 pay-per-use
print(d.route("find the auth handler"))   # {route, probability, margin, forward}
# d.execute("name 3 colors")        # run on the edge (if your plan allows)
# d.route_vector(vec768)            # matmul-only: cheapest/fastest

Python 3.8+. The edge worker is open-source: github.com/wave-av/dispatch-edge. A WAVE product.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

wave_dispatch-0.4.0.tar.gz (5.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

wave_dispatch-0.4.0-py3-none-any.whl (6.6 kB view details)

Uploaded Python 3

File details

Details for the file wave_dispatch-0.4.0.tar.gz.

File metadata

  • Download URL: wave_dispatch-0.4.0.tar.gz
  • Upload date:
  • Size: 5.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for wave_dispatch-0.4.0.tar.gz
Algorithm Hash digest
SHA256 24df47504463301312e4db880a07311e33296b84b523674a1c9ed0ee33a236dd
MD5 b3d7a537c5a16e8087974c7156fbbecc
BLAKE2b-256 a875a2d0e09ae2ada8b5617592de210aeab8cf83ec8caa764dcdd31613d1ebd9

See more details on using hashes here.

File details

Details for the file wave_dispatch-0.4.0-py3-none-any.whl.

File metadata

  • Download URL: wave_dispatch-0.4.0-py3-none-any.whl
  • Upload date:
  • Size: 6.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.15

File hashes

Hashes for wave_dispatch-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0b06fe9a4849da8fa6af1a85137accedbd662f79992d131182a54b9903554d27
MD5 729fc619b86460c5678bde100834b711
BLAKE2b-256 dc823f111a4b1f947fb0054c34165c00187ea3b60501819af1eae71dd8fbe2ea

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page