evalytic-sdk 0.3.3

Zero-throw LLM observability SDK for OpenAI, Anthropic, Gemini, Groq, Mistral, and Cohere

Evalytic Python SDK

Zero-throw LLM observability — one line of code, full visibility into every call.

Install

pip install evalytic-sdk

Quickstart

Set your API key (get one at evalytic-dashboard.vercel.app):

export EVALYTIC_API_KEY=evl_...

from evalytic import wrap
import anthropic

client = wrap(anthropic.Anthropic())
response = client.messages.create(...)  # all calls are automatically logged

That's it. No init, no config, no boilerplate.

Per-user tracking

Pass a user ID to attribute calls to specific users. The dashboard groups calls by user and shows per-user cost, call count, and last-seen time.

from evalytic import wrap
import anthropic

# Attach a user to this client — every call made with it is attributed to that user
client = wrap(anthropic.Anthropic(), user=request.user_id)
response = client.messages.create(...)

# Attach extra context via metadata
client = wrap(anthropic.Anthropic(), user=request.user_id, metadata={"plan": "pro", "env": "production"})

Supported providers

from evalytic import wrap

# Anthropic
import anthropic
client = wrap(anthropic.Anthropic())

# OpenAI
from openai import OpenAI
client = wrap(OpenAI())

# Groq
from groq import Groq
client = wrap(Groq())

# Mistral
from mistralai import Mistral
client = wrap(Mistral(api_key="..."))

# Cohere
import cohere
client = wrap(cohere.Client("..."))

# Google Gemini (new SDK)
from google import genai
client = wrap(genai.Client(api_key="..."))

# Google Gemini (legacy SDK)
import google.generativeai as genai
model = wrap(genai.GenerativeModel("gemini-2.0-flash"))

Server apps

For long-running servers, call configure() once at startup to control batching:

import evalytic
evalytic.configure()  # reads EVALYTIC_API_KEY from env

# Then use wrap() anywhere
from evalytic import wrap
client = wrap(anthropic.Anthropic(), user=user_id)

Config file

Create .evalytic in your project root as an alternative to environment variables:

EVALYTIC_API_KEY=evl_...

Dashboard

evalytic-dashboard.vercel.app