Skip to main content

Unified LLM API client for Python - multi-provider support with a single interface

Project description

LLMKit Python

Python bindings for LLMKit - a unified LLM API client library.

Installation

pip install llmkit

Quick Start

from llmkit import LLMKitClient, AsyncLLMKitClient, CompletionRequest, Message

# Sync client - use "provider/model" format
client = LLMKitClient.from_env()
response = client.complete(CompletionRequest(
    model="anthropic/claude-sonnet-4-20250514",
    messages=[Message.user("Hello!")],
))
print(response.text_content())

# Async client
async def main():
    client = AsyncLLMKitClient.from_env()
    response = await client.complete(CompletionRequest(
        model="anthropic/claude-sonnet-4-20250514",
        messages=[Message.user("Hello!")],
    ))
    print(response.text_content())

# Streaming
for chunk in client.complete_stream(request):
    if chunk.text:
        print(chunk.text, end="", flush=True)

Features

  • Unified API for 100+ LLM providers
  • Sync and async clients
  • Streaming support
  • Tool/function calling
  • Extended thinking (reasoning)
  • Prompt caching
  • Structured output (JSON schema)

License

MIT OR Apache-2.0

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

llmkit_python-0.1.0-cp39-abi3-win_amd64.whl (9.6 MB view details)

Uploaded CPython 3.9+Windows x86-64

llmkit_python-0.1.0-cp39-abi3-manylinux_2_39_x86_64.whl (10.0 MB view details)

Uploaded CPython 3.9+manylinux: glibc 2.39+ x86-64

llmkit_python-0.1.0-cp39-abi3-macosx_11_0_arm64.whl (9.2 MB view details)

Uploaded CPython 3.9+macOS 11.0+ ARM64

llmkit_python-0.1.0-cp39-abi3-macosx_10_12_x86_64.whl (9.5 MB view details)

Uploaded CPython 3.9+macOS 10.12+ x86-64

File details

Details for the file llmkit_python-0.1.0-cp39-abi3-win_amd64.whl.

File metadata

File hashes

Hashes for llmkit_python-0.1.0-cp39-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 5aae63effbf2a138364dbdd61228967137f0d7536e14ab5ccdc95cdb89128ce8
MD5 816d0d84dba62c9d9dcfc99c1af93631
BLAKE2b-256 32369c5091b5d2103d1c571ed8ee3c63d4a29bfb74b185312f970a22e7f10add

See more details on using hashes here.

File details

Details for the file llmkit_python-0.1.0-cp39-abi3-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for llmkit_python-0.1.0-cp39-abi3-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 b55b20aa4756913956ca445f2d89ed3784398288de5daf1bb32a7411ba98c677
MD5 cf4d026b79a82b21915bfa47867304f4
BLAKE2b-256 e5b1ba461180342cdfb462d7bed12d8b3bd2f462381e35c84155a91123c635d7

See more details on using hashes here.

File details

Details for the file llmkit_python-0.1.0-cp39-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for llmkit_python-0.1.0-cp39-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 bba26d066e7c6472f587ce167b240f83961619efedb3e0a737297c201f6b47d7
MD5 b883c45089db31aedd2425bca481b5e1
BLAKE2b-256 3203a7f1e13cd6ffe0ecf05d461a713f2b2a4d04890a464e2914709a16c4e7be

See more details on using hashes here.

File details

Details for the file llmkit_python-0.1.0-cp39-abi3-macosx_10_12_x86_64.whl.

File metadata

File hashes

Hashes for llmkit_python-0.1.0-cp39-abi3-macosx_10_12_x86_64.whl
Algorithm Hash digest
SHA256 7da388f12d3ce7b2f7024a78221c572ff1da1e34638b3bb877645ea59c0aef74
MD5 e7dea927eb141f23d63d8db51b4e91c4
BLAKE2b-256 d48153b994db7b92724b2c9db469a1d1e7f5826a519fb6f4f22fd68348e9eda9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page