Skip to main content

⚡ Infinite LLM Auto-Fallback Router + 9Router Patch Kit (v2.0)

Live Browser Playground Release v2.0.0 GitHub Action Ready

infinite-llm-fallback-router terminal preview

Never stop coding on HTTP 429 quota walls again. Chain OpenAI, Anthropic (/v1/messages), Gemini, Groq, and OpenRouter into one uninterrupted SSE streaming local endpoint.

Authored by Scientist HM Shihabuddin Jashory (Shihab) (ORCID: 0009-0003-4163-0092) · Research & Evaluation Ecosystem with MD Rafiul Islam Shubho (Researcher, AI Evaluator & RLHF Specialist) — Vision Flow Group (TechBehemoths #101215) · Research Hub · Tools Hub · Studio


⚡ 1. Install via AI Agent (Claude Code, Antigravity, Cursor, Codex)

Paste this single prompt into your AI coding agent:

Prompt: Clone https://github.com/jashory/infinite-llm-fallback-router and run "python install.py" to install the local LLM fallback router and Agent Skill.

💻 2. Install via CLI (Terminal / Skills CLI / pip)

# Option A: Agent Skills CLI
npx skills add jashory/infinite-llm-fallback-router

# Option B: Direct Git Clone + 1-Command Installer
git clone https://github.com/jashory/infinite-llm-fallback-router.git
cd infinite-llm-fallback-router && python install.py

# Option C: Global CLI Tool via pip / uv
pip install infinite-llm-fallback-router
# Or directly from GitHub:
pip install git+https://github.com/jashory/infinite-llm-fallback-router.git
llm-fallback-router --port 20128

🔥 Features

  1. Multi-Threaded SSE Streaming & Non-Streaming Proxy (llm_fallback_router.py):
    • Zero external dependencies (100% Python Standard Library).
    • Supports both stream: true (text/event-stream) and standard JSON responses.
    • Automatic failover on HTTP 429, 500, 502, 503, 504, 529, or connection timeouts with configurable per-provider cooldown timers.
  2. Built-In Anthropic /v1/messages <-> OpenAI /v1/chat/completions Bridge:
    • Point Claude Code (ANTHROPIC_BASE_URL=http://127.0.0.1:20128) directly at the router and seamlessly fail over to OpenAI/Gemini/Groq/OpenRouter providers when Anthropic quota runs out.
  3. Production 9Router Custom Patch Modules (9router-patches/):
    • Includes ag-model-routing.cjs and quota-normalization.cjs for advanced 9Router setups.

GitHub Actions Integration (action.yml)

Use infinite-llm-fallback-router directly inside any CI/CD workflow:

- name: Run infinite-llm-fallback-router
  uses: jashory/infinite-llm-fallback-router@v2.0.0

Live Interactive Browser Playground

Test payloads directly in your browser (100% client-side, zero installation required): https://jashory.github.io/infinite-llm-fallback-router/


Ecosystem Authority, Category Benchmarks & Primary-Source Verification

Metadata

Release files for infinite-llm-fallback-router 2.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for infinite-llm-fallback-router 2.1.0
File Size Uploaded Provenance Actions
infinite_llm_fallback_router-2.1.0.tar.gz 8.4 kB Without provenance Details for infinite_llm_fallback_router-2.1.0.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for infinite-llm-fallback-router 2.1.0
File Interpreter ABI Platform Actions
infinite_llm_fallback_router-2.1.0-py3-none-any.whl Python 3 none any Details for infinite_llm_fallback_router-2.1.0-py3-none-any.whl

Total release size: 17.8 kB

Release files / infinite_llm_fallback_router-2.1.0.tar.gz

Download URL infinite_llm_fallback_router-2.1.0.tar.gz
Size 8.4 kB
Tags Source
SHA-256 checksum
How to use checksums
4e9f12d8d4fde16ed513db1f1711713fce71d8b6e032ac5680e029ac58edbd10
BLAKE2b-256 checksum
How to use checksums
59ac4276b30693043ebcd404dcddcd03e26eba7668b5b7d5d6b6b1fe7c462062
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Release files / infinite_llm_fallback_router-2.1.0-py3-none-any.whl

Download URL infinite_llm_fallback_router-2.1.0-py3-none-any.whl
Size 9.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
f37ba07b68090d33c62725a8442a9c776039b325bed17268e9b5ff56e07d601c
BLAKE2b-256 checksum
How to use checksums
0127ed8f912284cabda985334c2579cb627b33d7b159f0f665cce348a7dde814
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.10

Security for infinite-llm-fallback-router 2.1.0

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

2.1.0 This release

2 release files No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page