litellm-ainative

AINative provider for litellm — free Llama, Qwen, DeepSeek & Kimi models through litellm's unified interface.

Install

pip install litellm-ainative

Quick Start

import litellm
from litellm_ainative import configure

# Auto-provisions a free API key (no signup required)
configure()

# Use any AINative model through litellm
response = litellm.completion(
    model="ainative/meta-llama/Llama-3.3-70B-Instruct",
    messages=[{"role": "user", "content": "Explain quantum computing in one paragraph."}],
)
print(response.choices[0].message.content)

Available Models

All models are free with tool-calling support:

Configuration

With an existing API key

from litellm_ainative import configure

configure(api_key="your_ainative_api_key")

With environment variable

export AINATIVE_API_KEY=your_key

from litellm_ainative import configure
configure()

Auto-provisioning (default)

If no key is found, configure() auto-provisions a temporary API key via AINative's instant-db endpoint. The key is valid for 72 hours. Claim it for permanent access at https://ainative.studio/claim.

from litellm_ainative import configure
configure()  # auto-provisions if no key found

Disable auto-provisioning

from litellm_ainative import configure
configure(auto_provision=False)  # raises RuntimeError if no key

Convenience Wrapper

For simpler usage without managing litellm directly:

from litellm_ainative import configure
from litellm_ainative.provider import completion

configure()

response = completion(
    model="ainative/kimi-k2",
    messages=[{"role": "user", "content": "Write a haiku about code."}],
    temperature=0.7,
)

Tool Calling

All models support OpenAI-compatible tool calling:

import litellm
from litellm_ainative import configure

configure()

tools = [
    {
        "type": "function",
        "function": {
            "name": "get_weather",
            "description": "Get weather for a location",
            "parameters": {
                "type": "object",
                "properties": {
                    "location": {"type": "string"}
                },
                "required": ["location"],
            },
        },
    }
]

response = litellm.completion(
    model="ainative/qwen3-coder-flash",
    messages=[{"role": "user", "content": "What's the weather in Tokyo?"}],
    tools=tools,
)

How It Works

litellm-ainative registers AINative models with litellm's model registry using the openai provider backend (since AINative exposes an OpenAI-compatible /chat/completions endpoint). When you call litellm.completion(model="ainative/..."), litellm routes the request through the OpenAI provider to AINative's API gateway.

Links

• AINative Studio
• Documentation
• litellm docs