NexusAI-Client ⚡

An ultra-lightweight, strictly-typed, asynchronous Python gateway for multi-provider AI APIs.
Unify Cerebras, Cohere, DeepSeek, Google Gemini (Free & Pro), Groq, Mistral, Nvidia NIM, and OpenRouter behind a single, elegant interface with zero heavy SDK dependencies.

---

💡 Why NexusAI-Client?

Integrating multiple AI providers in modern Python applications usually requires installing 8 or 9 separate proprietary SDKs (google-genai, openai, groq, cohere, mistralai, etc.). This creates dozens of transitive dependencies, version conflicts, memory overhead, and fragmented codebases.

NexusAI-Client solves this at the core:

• 🪶 Zero Heavyweight Dependencies — powered purely by httpx and python-dotenv.
• ⚡ Native Asynchronous & SSE Streaming — stream responses token-by-token in real time via stream_text() and stream_chat().
• 🔄 Zero-Cost-First Smart Fallback — automatic progression from 100% free tiers (Gemini, Groq, Cerebras, Cohere, Nvidia, OpenRouter, Mistral) to paid backups with AIGateway.auto_fallback().
• 🚀 World-Record Hardware Accelerators — native support for Groq LPUs and Cerebras CS-3 wafer-scale engines (2,000+ tokens/sec).
• 🧠 Enterprise Reasoning & Search Models — native Cohere Command R+ and DeepSeek R1 support.
• 🎯 Guaranteed JSON Outputs — native json_mode=True across all supported providers.
• 💰 Live Account & Budget Inspection — inspect real-time balances (USD, NGC credits) and rate limits (RPM, TPM, RPD).
• 🔍 670+ Models Discovered Live — automatic detection of free-tier models (:free) and accurate per-million-token pricing.
• 👁️ Multimodal Vision — analyze images, charts, and documents with automatic vision-model resolution via analyze_image() and AIGateway.auto_fallback_vision().

---

🌟 Spotlight: Zero-Cost-First Smart Fallback Routing

Why pay for AI calls when you can leverage high-throughput free tiers first, with seamless automatic fallback to paid commercial models?

NexusAI-Client automatically prioritizes zero-cost models before touching your wallet:

  ┌────────────────────────────────────────────────────────────────────────────────────────────────────────┐
  │                                       100% FREE ZERO-COST TIERS                                        │
  ├──────────────┬──────────────┬──────────────────┬──────────────┬──────────────┬──────────────┬──────────┤
  │ 1. Gemini    │ 2. Groq LPU  │ 3. Cerebras CS-3 │ 4. Nvidia    │ 5. OpenRouter│ 6. Cohere    │ 7.Mistral│
  │ (1M Context) │ (Ultra-Fast) │ (2000+ tok/s)    │ (1k Credits) │ (Free Hub)   │ (Command R+) │ (Dev Free│
  └──────┬───────┴──────┬───────┴────────┬─────────┴──────┬───────┴──────┬───────┴──────┬───────┴────┬─────┘
         │              │                │                │              │              │            │
         ▼ (If Rate-Limited / 429 Quota Exceeded / Network Outage / Timeout) ────────────────────────▼
  ┌────────────────────────────────────────────────────────────────────────────────────────────────────────┐
  │                                   ULTRA-LOW-COST PAID BACKUP TIERS                                     │
  ├────────────────────────────────────────────────────┬───────────────────────────────────────────────────┤
  │ 8. DeepSeek ($0.27 / 1M tokens)                    │ 9. Gemini Pro (Enterprise GCP)                    │
  └────────────────────────────────────────────────────┴───────────────────────────────────────────────────┘

1-Line Zero-Cost Failover in Your Code

import asyncio
from nexusai_client import AIGateway

async def main():
    # Automatically discovers active keys in .env and routes: Free -> Free -> Paid
    async with AIGateway.auto_fallback() as client:
        response = await client.generate_text("Explain quantum computing in 2 sentences.")
        print(f"✅ Served by [{response.provider}] with zero downtime:")
        print(response.text)

if __name__ == "__main__":
    asyncio.run(main())

---

🎯 Supported Providers Matrix

Provider	Identifier (provider)	Tier	Protocol	Default Model	Live Budget & Quota Detection
Cerebras	"cerebras" (or "cerebras_free")	Free (CS-3)	OpenAI Chat API	gpt-oss-120b	Quotas: 30 RPM | 60k TPM | 1M tok/day
Cohere	"cohere" (or "cohere_free")	Free Trial	Cohere V2 REST	command-r-plus-08-2024	Quotas: 20 RPM | 1,000 calls/month
DeepSeek	"deepseek"	Paid	OpenAI Chat API	deepseek-chat	Real-time USD Balance (GET /user/balance)
Gemini Free	"gemini_free"	Free (AI Studio)	Gemini REST	gemini-2.5-flash	Quotas: 15 RPM | 1M TPM | 1,500 RPD
Gemini Pro	"gemini_pro"	Paid	Gemini REST	gemini-2.5-pro	Google Cloud Pay-as-you-go Billing
Groq	"groq" (or "groq_free")	Free (LPU)	OpenAI Chat API	llama-3.3-70b-versatile	Quotas: 30 RPM | 14,400 RPD | 30k TPM
Mistral AI	"mistral"	Free / Platform	OpenAI Chat API	mistral-small-latest	Free Dev Models (codestral-latest, etc.)
Nvidia NIM	"nvidia_free"	Free (NGC)	OpenAI Chat API	meta/llama-3.1-8b-instruct	1,000 Free GPU Inference Credits (NGC)
OpenRouter	"openrouter"	Free & Paid	OpenAI Chat API	openrouter/free	19 Free models live + 390 Commercial models

---

🚀 Quickstart (1 Minute)

1. Installation

# With pip
pip install nexusai-client

# With uv (Recommended)
uv add nexusai-client

# With poetry
poetry add nexusai-client

2. Configure API Keys (.env)

No configuration code needed: as soon as you import nexusai_client, the package automatically loads the .env file found in your current working directory (via python-dotenv). Real environment variables always take precedence.

Create a .env file at the root of your project with only the keys you have — every provider is optional:

# ── Free Tiers (Priority 1) ────────────────────────────────────────────────
GEMINI_FREE_API_KEY=your_google_ai_studio_key
GROQ_API_KEY=gsk_your_groq_key
CEREBRAS_API_KEY=csk-your_cerebras_key
COHERE_API_KEY=your_cohere_key
NVIDIA_API_KEY=nvapi-your_nvidia_nim_key
OPENROUTER_API_KEY=sk-or-v1-your_openrouter_key
MISTRAL_API_KEY=your_mistral_api_key

# ── Paid Tiers (Backup Priority 2) ─────────────────────────────────────────
DEEPSEEK_API_KEY=sk-your_deepseek_key
GEMINI_PRO_API_KEY=your_gemini_pro_key

Where to get each API key

Provider	Environment Variable	Get a key
Gemini Free	GEMINI_FREE_API_KEY	Google AI Studio
Gemini Pro	GEMINI_PRO_API_KEY	Google AI Studio / GCP
Groq	GROQ_API_KEY	console.groq.com/keys
Cerebras	CEREBRAS_API_KEY	cloud.cerebras.ai
Cohere	COHERE_API_KEY	dashboard.cohere.com
Nvidia NIM	NVIDIA_API_KEY	build.nvidia.com
OpenRouter	OPENROUTER_API_KEY	openrouter.ai/keys
Mistral	MISTRAL_API_KEY	console.mistral.ai
DeepSeek	DEEPSEEK_API_KEY	platform.deepseek.com

Notes:

• GEMINI_API_KEY is accepted as a fallback alias for both GEMINI_FREE_API_KEY and GEMINI_PRO_API_KEY.
• You can also pass a key directly in code: AIGateway("groq", api_key="gsk_...") — useful for CI/CD or key rotation without touching .env.

Optional advanced environment variables

Variable	Purpose	Default
DEEPSEEK_DEFAULT_MODEL, GROQ_DEFAULT_MODEL, CEREBRAS_DEFAULT_MODEL, ...	Override the default model of a provider	Provider defaults (see matrix above)
DEEPSEEK_BASE_URL, GROQ_BASE_URL, MISTRAL_BASE_URL, ...	Point a provider at a custom endpoint or proxy	Official provider API URL
NEXUS_DEFAULT_TIMEOUT	Global request timeout in seconds (all providers)	60
OPENROUTER_SITE_URL / OPENROUTER_APP_NAME	App attribution headers sent to OpenRouter	https://github.com/NexusAI-Client / NexusAI-Client

3. Basic Generation

import asyncio
from nexusai_client import AIGateway

async def main():
    async with AIGateway("cerebras") as client:
        response = await client.generate_text("Explain the theory of relativity in 2 sentences.")
        print(response.text)

if __name__ == "__main__":
    asyncio.run(main())

---

🍳 Cookbooks & Common Patterns

1. Real-Time Token Streaming (SSE)

import asyncio
from nexusai_client import AIGateway

async def main():
    async with AIGateway("groq") as client:
        async for chunk in client.stream_text("Write a short poem about lightning fast LPUs."):
            print(chunk, end="", flush=True)

if __name__ == "__main__":
    asyncio.run(main())

2. Custom Fallback Chain (Fine-Grained Strategy)

import asyncio
from nexusai_client import AIGateway

async def main():
    # Priority: Free Gemini -> Free Groq -> Free Cerebras -> Free Cohere -> Paid DeepSeek
    custom_chain = ["gemini_free", "groq", "cerebras", "cohere", "nvidia_free", "openrouter", "deepseek"]
    async with AIGateway.with_fallback(custom_chain) as client:
        res = await client.generate_text("Summarize the key advantages of Python 3.14.")
        print(f"[{res.provider}] {res.text}")

if __name__ == "__main__":
    asyncio.run(main())

3. Multi-Turn Conversation (Chat)

import asyncio
from nexusai_client import AIGateway, ChatMessage

async def main():
    history = [
        ChatMessage(role="system", content="You are a senior algorithms instructor."),
        ChatMessage(role="user", content="How does QuickSort work?"),
    ]
    async with AIGateway("cohere") as client:
        response = await client.chat(history)
        print(response.text)

if __name__ == "__main__":
    asyncio.run(main())

4. Guaranteed Structured JSON Output

import asyncio, json
from nexusai_client import AIGateway

async def main():
    async with AIGateway("groq") as client:
        res = await client.generate_text(
            prompt="Extract profile data: Alice, 28 years old, Software Engineer.",
            json_mode=True,
        )
        data = json.loads(res.text)
        print("Parsed JSON:", data)

if __name__ == "__main__":
    asyncio.run(main())

5. Inspect Real-Time Account Balances & Quotas

import asyncio
from nexusai_client import AIGateway

async def main():
    async with AIGateway("deepseek") as client:
        account = await client.get_account_info()
        print(account.format_summary())
        # Output: "Solde restant: $4.99 | (Offert: $0.00)"

if __name__ == "__main__":
    asyncio.run(main())

6. Multimodal Vision Analysis (Images, Charts, PDFs)

Pass a local file path (Path or str), raw bytes, or web URL:

import asyncio
from nexusai_client import AIGateway

async def main():
    # Automatically selects the best Vision model (Gemini 2.5 Flash, Llama 3.2 Vision, Aya Vision, Pixtral)
    async with AIGateway.auto_fallback_vision() as client:
        res = await client.analyze_image(
            prompt="Extract the invoice total and line items formatted as JSON.",
            image="invoice.png", # or "https://example.com/chart.jpg" or raw bytes
            json_mode=True,
        )
        print(f"[{res.provider} / {res.model}]:")
        print(res.text)

if __name__ == "__main__":
    asyncio.run(main())

---

🛡️ Strongly-Typed Exceptions

All exceptions inherit from NexusAIError for clean error handling:

from nexusai_client import (
    AIGateway,
    NexusAIError,
    MissingAPIKeyError,    # Missing API key in environment
    AuthenticationError,   # Invalid key (HTTP 401/403)
    RateLimitError,        # Quota exceeded (HTTP 429)
    APITimeoutError,       # Network timeout
    APIConnectionError,    # Unreachable provider host
    ProviderNotFoundError, # Unknown provider requested
)

The package ships a py.typed marker (PEP 561): all types are available to your IDE and type checker out of the box.

---

📚 Resources

• Source code: github.com/laurentvv/NexusAI-Client
• Full Integration Guide (FastAPI, background workers, chat sessions): INTEGRATION_GUIDE.md
• Issue tracker: github.com/laurentvv/NexusAI-Client/issues

---

📄 License

This project is licensed under the MIT License. Free for personal and commercial use.