llm-wrapper-yl 0.1.0

A flexible wrapper for LLM providers with caching, async support, and cost tracking

LLM Wrapper

A flexible wrapper for LLM providers with caching, async support, and cost logging.

Installation

pip install llm-wrapper

Quick Start

from llm_wrapper import OpenAIProvider

# Initialize the provider
provider = OpenAIProvider(model="gpt-4o-mini", api_key="your-api-key")

# Generate a single response
response = provider.generate("What is the capital of France?")

# Generate multiple responses with caching
responses = provider.generate(
    ["What is 2+2?", "What is the weather?"],
    system_prompt="You are a helpful assistant.",
    temperature=0.7
)

# For the second call, you will retrieve responses from cache
responses = provider.generate(
    ["What is 2+2?", "What is the weather?"],
    system_prompt="You are a helpful assistant.",
    temperature=0.7
)

Usage with Local Models

from llm_wrapper import LocalProvider

# Initialize the provider with a local model
provider = LocalProvider(
    model="your-model-name",
    host="your-server-host",
    port=8000
)

# Generate responses
responses = provider.generate(["Your prompt here"])

Testing

# Install local package with test dependencies
uv pip install '.[test]'
# Run tests with output
python -m pytest -s tests

Deploying

hatch build
twine upload dist/*