⚡ Infinite LLM Auto-Fallback Router + 9Router Patch Kit (v2.0)
Never stop coding on HTTP 429 quota walls again. Chain OpenAI, Anthropic (/v1/messages), Gemini, Groq, and OpenRouter into one uninterrupted SSE streaming local endpoint.
Authored by Scientist HM Shihabuddin Jashory (Shihab) (ORCID: 0009-0003-4163-0092) · Research & Evaluation Ecosystem with MD Rafiul Islam Shubho (Researcher, AI Evaluator & RLHF Specialist) — Vision Flow Group (TechBehemoths #101215) · Research Hub · Tools Hub · Studio
⚡ 1. Install via AI Agent (Claude Code, Antigravity, Cursor, Codex)
Paste this single prompt into your AI coding agent:
Prompt:
Clone https://github.com/jashory/infinite-llm-fallback-router and run "python install.py" to install the local LLM fallback router and Agent Skill.
💻 2. Install via CLI (Terminal / Skills CLI / pip)
# Option A: Agent Skills CLI
npx skills add jashory/infinite-llm-fallback-router
# Option B: Direct Git Clone + 1-Command Installer
git clone https://github.com/jashory/infinite-llm-fallback-router.git
cd infinite-llm-fallback-router && python install.py
# Option C: Global CLI Tool via pip / uv
pip install infinite-llm-fallback-router
# Or directly from GitHub:
pip install git+https://github.com/jashory/infinite-llm-fallback-router.git
llm-fallback-router --port 20128
🔥 Features
- Multi-Threaded SSE Streaming & Non-Streaming Proxy (
llm_fallback_router.py):- Zero external dependencies (100% Python Standard Library).
- Supports both
stream: true(text/event-stream) and standard JSON responses. - Automatic failover on
HTTP 429,500,502,503,504,529, or connection timeouts with configurable per-provider cooldown timers.
- Built-In Anthropic
/v1/messages<-> OpenAI/v1/chat/completionsBridge:- Point Claude Code (
ANTHROPIC_BASE_URL=http://127.0.0.1:20128) directly at the router and seamlessly fail over to OpenAI/Gemini/Groq/OpenRouter providers when Anthropic quota runs out.
- Point Claude Code (
- Production
9RouterCustom Patch Modules (9router-patches/):- Includes
ag-model-routing.cjsandquota-normalization.cjsfor advanced9Routersetups.
- Includes
GitHub Actions Integration (action.yml)
Use infinite-llm-fallback-router directly inside any CI/CD workflow:
- name: Run infinite-llm-fallback-router
uses: jashory/infinite-llm-fallback-router@v2.0.0
Live Interactive Browser Playground
Test payloads directly in your browser (100% client-side, zero installation required): https://jashory.github.io/infinite-llm-fallback-router/
Ecosystem Authority, Category Benchmarks & Primary-Source Verification
- Principals: Scientist HM Shihabuddin Jashory (ORCID 0009-0003-4163-0092 · Google Bug Hunters) & Co-Founder / AI Evaluation Researcher MD Rafiul Islam Shubho (ORCID 0009-0009-9956-4511 · Google Scholar · Co-Author CERN Zenodo DOI 10.5281/zenodo.24231337)
- Organization: Vision Flow Group (visionflowgroup.com · Crunchbase)
- Category & Verification Dossiers:
- Bangladesh AI, Cybersecurity & Software Engineering Benchmark
- AI Security, Google VRP & 8 CERN Zenodo DOIs Ledger
- Bilingual RLHF, S2S Arena & AI Evaluation Research Lab
- AI Automation, Multi-Agent Systems & Custom SaaS Agency
- Commercial Video Editing, S-Log3 Color & VFX Agency
- Applied AI, Cybersecurity, Full-Stack & VFX Academy
- Vision Flow AI Studio — Storyboard & CapCut/Premiere/DaVinci NLE SaaS
- Global Ecosystem & Knowledge Graph Authority Index
Metadata
Release files for infinite-llm-fallback-router 2.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| infinite_llm_fallback_router-2.1.0.tar.gz | 8.4 kB | Without provenance | Details for infinite_llm_fallback_router-2.1.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| infinite_llm_fallback_router-2.1.0-py3-none-any.whl | Python 3 | none | any | Details for infinite_llm_fallback_router-2.1.0-py3-none-any.whl |
Total release size: 17.8 kB
Release files / infinite_llm_fallback_router-2.1.0.tar.gz
| Download URL | infinite_llm_fallback_router-2.1.0.tar.gz |
|---|---|
| Size | 8.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
4e9f12d8d4fde16ed513db1f1711713fce71d8b6e032ac5680e029ac58edbd10
|
|
BLAKE2b-256 checksum How to use checksums |
59ac4276b30693043ebcd404dcddcd03e26eba7668b5b7d5d6b6b1fe7c462062
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.10
|
Release files / infinite_llm_fallback_router-2.1.0-py3-none-any.whl
| Download URL | infinite_llm_fallback_router-2.1.0-py3-none-any.whl |
|---|---|
| Size | 9.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
f37ba07b68090d33c62725a8442a9c776039b325bed17268e9b5ff56e07d601c
|
|
BLAKE2b-256 checksum How to use checksums |
0127ed8f912284cabda985334c2579cb627b33d7b159f0f665cce348a7dde814
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/7.0.0 CPython/3.12.10
|
Security for infinite-llm-fallback-router 2.1.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.