aiclient-llm 0.1.0

A minimal, generic client for AI models (OpenAI, Anthropic, Google, xAI) with middleware support.

aiclient

A minimal, unified, and resilient Python client for modern LLMs.

Supports OpenAI, Anthropic (Claude 3), Google (Gemini), and xAI (Grok) with a single, consistent interface.

Features

• 🦄 Unified Interface: Swap between providers without changing code.
• ⚡ Async & Sync: Native asyncio support for high-performance apps.
• 👁️ Multimodal: Send images and text seamlessly.
• 🛡️ Resilient: Automatic retries with exponential backoff for 429/5xx errors.
• 🤖 Agent Primitives: Built-in ReAct loop for tool-using agents.
• 🛠️ Tool Calling: Standardized function calling across providers.
• 📊 Middleware: Inspect requests, track costs, or log data.

Installation

pip install aiclient

(Note: Not yet on PyPI, install from source/git)

Quick Start

Basic Chat

from aiclient import Client

client = Client(
    api_key_openai="sk-...", 
    api_key_anthropic="sk-ant-..."
)

# Call OpenAI
response = client.chat("gpt-4o").generate("Hello!")
print(response.text)

# Call Claude
response = client.chat("claude-3-opus-20240229").generate("Hello!")
print(response.text)

Multimodal (Vision)

from aiclient.types import UserMessage, Text, Image

msg = UserMessage(content=[
    Text(text="What's in this image?"),
    Image(path="./image.png") # Handles base64 automatically
])

response = client.chat("gpt-4o").generate([msg])
print(response.text)

Agents (Tool Use)

from aiclient.agent import Agent

def get_weather(location: str):
    return "Sunny in " + location

agent = Agent(
    model=client.chat("gpt-4o"),
    tools=[get_weather]
)

print(agent.run("Weather in SF?"))

Streaming

for chunk in client.chat("gpt-4o").stream("Write a poem"):
    print(chunk.text, end="", flush=True)

Configuration

Retries

# Retries up to 3 times with backoff
client = Client(max_retries=3, retry_delay=1.0)

License

MIT