Skip to main content

Python SDK + CLI for the 9Router AI gateway (OpenAI-compatible chat, images, TTS, STT, embeddings, web search/fetch)

Project description

PyPI Python versions License Downloads

9router-python demo

9router-python

Python SDK + CLI for the 9Router AI gateway.

One tiny library to talk to an OpenAI-compatible gateway that routes to Gemini, NVIDIA, OpenRouter, Groq, Ollama, Tavily and Exa — chat, images, TTS, STT, embeddings and web search/fetch — all through a single local endpoint, with automatic fallback between providers.

$ pip install 9router-python

✨ Features

Capability SDK method CLI command
💬 Chat (with streaming) client.chat() / chat_stream() ninerouter chat
🌀 Embeddings client.embeddings() ninerouter embed
🖼️ Image generation client.image() ninerouter image
🔊 Text-to-speech client.tts() ninerouter tts
🎙️ Speech-to-text client.stt() ninerouter stt
🔎 Web search client.web_search() ninerouter web search
📄 Fetch URL → markdown client.web_fetch() ninerouter web fetch
⚙️ Models & health client.models(), health() ninerouter models, health

Everything runs through one base URL. Configure once, use everywhere.


⚡ Quickstart

🚀 30 seconds to first chat

$ pip install 9router-python
$ ninerouter chat "Hello, world!" --stream
Hello! 👋 How can I help you today?

That's it. One gateway, one SDK, every capability.

Chat

from ninerouter import NineRouter

with NineRouter() as client:
    reply = client.chat("Explain a monad in one sentence")
    print(reply.text)

Stream tokens as they arrive:

for chunk in client.chat_stream("Write a haiku about Python"):
    print(chunk.content, end="", flush=True)

Generate an image

image = client.image("a watercolor of mountains at sunrise")
open("out.png", "wb").write(image.content)

Text-to-speech

audio = client.tts("Olá, mundo!", voice="pt-BR-FernandaNeural", model="gemini/gemini-3.1-flash-tts-preview")
open("speech.wav", "wb").write(audio)

Speech-to-text

text = client.stt(file=("recording.wav", open("recording.wav", "rb").read()))
print(text.text)

Embeddings — RAG-ready

vector = client.embeddings("The quick brown fox")[0]
curl_similarity = sum(a * b for a, b in zip(vector, other))

Web search & fetch

results = client.web_search("9Router open source")
for r in results.results:
    print(r.title, "-", r.url)

page = client.web_fetch("https://example.com")
print(page.content.text)

🖥️ CLI

ninerouter                          # help
ninerouter health                   # gateway status
ninerouter models --kind chat       # list chat models
ninerouter chat "Hello" --stream    # chat with streaming
ninerouter embed "text"             # embedding vector
ninerouter image "a red fox" --out fox.png
ninerouter tts "Hello" --voice pt-BR-FernandaNeural
ninerouter stt recording.wav
ninerouter web search "9Router"
ninerouter web fetch https://example.com
ninerouter config                   # show effective config

🔧 Configuration

Resolution order: CLI flags > environment variables > defaults.

Setting Env var Default
Base URL NINEROUTER_URL http://localhost:20128
API key NINEROUTER_KEY (optional)
export NINEROUTER_URL="http://localhost:20128"
export NINEROUTER_KEY="sk-..."     # optional if gateway has auth disabled

The key is only sent when non-empty, so a gateway running with requireApiKey=false works out of the box.


⚠️ Gateway quirks handled for you

  • SSE-by-default: the gateway often streams SSE even when stream isn't set — the client parses both JSON and SSE transparently.
  • TTS: some OpenRouter TTS models return 502 upstream errors; prefer a gemini/* TTS model.
  • STT: multipart upload with gemini/* or groq/whisper-* models.
  • Web search/fetch use provider (not model), e.g. tavily, exa, or the search-combo.
  • Combos (owned_by: "combo", like Code) auto-fallback across providers — great defaults for chat.

📦 Install & develop

pip install -e .[dev]
pytest                     # mocked unit tests
pytest -m live             # live tests (needs a running gateway)

Requires Python 3.9+.


🧰 Why 9Router?

9Router gives you keyless access to dozens of AI providers with automatic fallback, so your app keeps working even if one provider's quota or free tier runs out. This SDK removes the friction: you get a typed, tested Python client and a friendly CLI without caring about which endpoint each provider uses.


🔒 Privacy & Security

This SDK is a thin HTTP client — it does not hold AI provider keys, does not upload your prompts anywhere other than the gateway you point it at, and ships no telemetry.

  • No secrets in the client. An optional API key is read from the environment (NINEROUTER_KEY) and sent only to your configured gateway.
  • Nothing leaves your network except to the gateway you configure. The SDK never sends data to the SDK author or any third party.
  • The gateway holds the keys. Provider API keys (Gemini, NVIDIA, Tavily, …) live in your 9Router gateway on your machine/VM — not in this library.
  • Supply-chain hygiene. Only two runtime dependencies (httpx, typer), both widely trusted. CI runs unit tests on every push across Python 3.9/3.11/3.13.
  • No-secrets guardrail. A test in CI scans the repo for committed credentials and fails the build if anything slips in.

See SECURITY.md for the full policy and how to report a vulnerability privately.


📄 License

MIT © (ChristopherDond)


🇧🇷 Português

SDK Python + CLI para o gateway de IA 9Router.

Um único pacote para conversar com um gateway compatível com a API da OpenAI que roteia Gemini, NVIDIA, OpenRouter, Groq, Ollama, Tavily e Exa — chat, imagens, TTS, STT, embeddings e busca web, com fallback automático entre provedores.

pip install 9router-python
ninerouter chat "Olá, mundo!" --stream

Consulte a seção Features e Quickstart acima — a API e o CLI são idênticos. Para configurar, veja Configuration.

Exemplo rápido (PT)

from ninerouter import NineRouter

with NineRouter() as client:
    print(client.chat("Me conta uma piada"))

⬆ back to top

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

9router_python-0.1.0.tar.gz (219.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

9router_python-0.1.0-py3-none-any.whl (16.4 kB view details)

Uploaded Python 3

File details

Details for the file 9router_python-0.1.0.tar.gz.

File metadata

  • Download URL: 9router_python-0.1.0.tar.gz
  • Upload date:
  • Size: 219.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.11.15

File hashes

Hashes for 9router_python-0.1.0.tar.gz
Algorithm Hash digest
SHA256 1030e0f2312c6f8a653ba8ba249a6260dee4572b1783781dadc8a763b41581ea
MD5 f7df5c2081ca66e36fdc326f89f16642
BLAKE2b-256 7fac39d063927ca77e9173537aa7c87c19e4016516c6e61053beee6157028cfa

See more details on using hashes here.

File details

Details for the file 9router_python-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: 9router_python-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 16.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.11.15

File hashes

Hashes for 9router_python-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 a8f053a48fb4af81c395daa3798aa1253964321161f452d8204b210ee71cba1c
MD5 f378b8517397bb4713166ece4102d7bc
BLAKE2b-256 358f81ff1bf002779277d329109ab87ae3473a836166fde46528380b7a9ce3a8

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page