Skip to main content

DrekAI OpenAI Wrapper

A modern, async-first Python wrapper for OpenAI-compatible LLM APIs with built-in tool/function calling support.

Works with OpenAI, Gemini (via proxy), and any OpenAI-compatible endpoint.


✨ Features

  • Async-native – built on httpx / openai async client
  • Tool use – define Python functions as AI-callable tools with automatic sandbox parameter injection
  • Streaming – stream responses token-by-token with a simple callback
  • Sandboxed parameters – keep secrets invisible to the LLM while still passing them to tools
  • Multi-turn chats – conversation history management
  • Image support – send local files, URLs, or base64 images inline
  • Thinking / reasoning – support for extended-thinking models with effort control
  • Gemini compatibility – automatic tool-call shimming for Gemini models behind OpenAI proxies

📦 Installation

pip install drekai

Or install from source:

git clone https://github.com/drek124/drekai.git
cd drekai
pip install .

🚀 Quick Start

import asyncio
from drekai import Model, Chatbot

# 1. Define a model endpoint
model = Model("gpt-4o", "https://api.example.com/v1", api_key="sk-...")

# 2. Create a chatbot
bot = Chatbot(
    name="Helper",
    system_prompt="You are a helpful assistant.",
    parent_model=model,
    temperature=0.7,
)

async def main():
    # One-shot generation
    response = await bot.generate_text("Hello!")
    print(response.choices[0].message.content)

    # Multi-turn chat
    chat = bot.start_chat()
    r1 = await chat.generate_reply("What's the weather in Tokyo?")
    print(r1.choices[0].message.content)
    r2 = await chat.generate_reply("And in London?") # Context retained
    print(r2.choices[0].message.content)

asyncio.run(main())

🛠️ Tool Use

from drekai import Model, Chatbot
from drekai.tools import Tool

model = Model("gpt-4o", "https://api.example.com/v1", api_key="sk-...")
bot = Chatbot("Assistant", "You are a helpful assistant.", model)

async def get_weather(city: str):
    """Get the current weather for a city."""
    # In a real app, call a weather API here
    return f"The weather in {city} is sunny, 25°C."

tools = [
    Tool(
        name="fetch_weather", # Overwrite function name if needed
        callback=get_weather, 
    )
]

async def main():
    chat = bot.start_chat()
    response = await chat.generate_reply(
        "What's the weather in Paris?",
        tools=tools,
    )
    print(response.choices[0].message.content)

asyncio.run(main())

Sandboxed Parameters

Keep secrets like user IDs invisible to the LLM:

async def get_friends(user: User | SandboxParam, limit: int = 50) -> str:
    """Fetch the user's friends list."""
    return str(user.get_friends(limit=limit))

tools = [
    Tool(
        callback=get_friends, # All info about the function name, description & parameters will be taken from the callback.
    )
]

await chat.generate_reply(
    "Who are my friends?",
    tools=tools,
    sandbox_params={"user": current_user},  # injected at call time
)

🖼️ Images

from drekai.messaging import Image

# Local file
await chat.generate_reply(
    "Describe this image.",
    items=[Image("/path/to/photo.jpg")],
)

# URL
await chat.generate_reply(
    "Describe this image.",
    items=[Image("https://example.com/photo.jpg")],
)

# Base64
await chat.generate_reply(
    "Describe this image.",
    items=[Image(base64_data, b64=True)],
)

📖 API Reference

Model(model_id, base_url, *, api_key)

Root model representing an API endpoint.

Chatbot(name, system_prompt, parent_model, *, api_key, temperature, thinking, reasoning_effort)

A named chatbot built on a model.

Chat

Created via chatbot.start_chat(). Manages conversation history.

Method Description
generate_reply(...) Generate the next response
add_message_to_context(content, role) Manually add a message
clear() Reset history (keeps system prompt)
delete_first_message(role) Remove first message with given role
stop_live_generation() Stop an active stream mid-generation

ChatSettings(max_tokens, show_tool_error_type)

Per-chat configuration.

Tool(name, params, callback, sandbox_params)

An AI-callable function.

MessageItem / Image

Chat message attachments.


🧪 Development

# Clone and install in editable mode with dev deps
git clone https://github.com/drek124/drekai.git
cd drekai
pip install -e ".[dev]"

# Lint
ruff check drekai/

# Type check
mypy drekai/

# Test
pytest

📄 License

MIT License. See LICENSE for details.

Release files for drekai 1.2.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for drekai 1.2.0
File Size Uploaded
drekai-1.2.0.tar.gz 9.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for drekai 1.2.0
File Interpreter ABI Platform
drekai-1.2.0-py3-none-any.whl Python 3 none any Details

Total release size: 21.9 kB

Release files / drekai-1.2.0.tar.gz

Download URL drekai-1.2.0.tar.gz
Size 9.7 kB
Tags Source
SHA-256 checksum
How to use checksums
38507768861c9a74e5807242ad5dccea275227f9117cdd671692a76e9721cf22
BLAKE2b-256 checksum
How to use checksums
74db9fc9d14c80f7d6be8c6cb86b6bc244884a25a3dcbecd4a9113e7f0ce6eee
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.14.4

Release files / drekai-1.2.0-py3-none-any.whl

Download URL drekai-1.2.0-py3-none-any.whl
Size 12.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
6002ecb374b79bbab17130061230e7c82d98754be6a51b9b55556ec0ee058534
BLAKE2b-256 checksum
How to use checksums
fa645fa079919c821b63792abf061836b17bf710aace7d285480ad6ce4606130
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.14.4

Release history Release notifications | RSS feed

1.2.1

2 release files

This release

1.2.0 This release

2 release files

1.1.0

2 release files

0.1.3

2 release files

0.1.2

2 release files

0.1.1

2 release files

0.1.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page