sik-llms 0.3.21

Lightweight, easy, and consistent LLM-interface across providers and functionality.

sik-llms

• Easy llm interface; eliminates parsing json responses or building up json for functions/tools
  • OpenAI and any OpenAI-compatible API
  • Anthropic
• Sync and Async support
• Functions/Tools
• Structured Output
  • Supports Anthropic models even though structured output is not natively supported in their models
• Reasoning mode in OpenAI and Anthropic
• ReasoningAgent that iteratively reasons and calls tool

See examples

from sik_llms import create_client, user_message, ResponseChunk

model = create_client(
    model_name='gpt-4o-mini',  # or e.g. 'claude-3-7-sonnet-latest'
    temperature=0.1,
)
messages = [
    system_message("You are a helpful assistant."),
    user_message("What is the capital of France?"),
]

# sync
response = model(messages=messages)

# async
response = await model.run_async(messages=messages)

# async streaming
responses = []
summary = None
async for response in model.stream(messages=messages):
    if isinstance(response, TextChunkEvent):
        print(response.content, end="")
        responses.append(response)
    else:
        summary = response

print(summary)

Installation

uv install sik-llms or pip install sik-llms