LLM Tracekit - Anthropic
OpenTelemetry instrumentation for the Anthropic Python SDK (Messages API), designed to simplify LLM application development and production tracing and debugging.
Installation
Anthropic
pip install "llm-tracekit-anthropic"
Usage
This section describes how to set up instrumentation for the Anthropic SDK.
Setting up tracing
You can use the setup_export_to_coralogix function to setup tracing and export traces to Coralogix
from llm_tracekit.anthropic import setup_export_to_coralogix
setup_export_to_coralogix(
service_name="ai-service",
application_name="ai-application",
subsystem_name="ai-subsystem",
capture_content=True,
)
Alternatively, you can set up tracing manually:
from opentelemetry import trace
from opentelemetry.exporter.otlp.proto.grpc.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk.resources import SERVICE_NAME, Resource
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry.sdk.trace.export import SimpleSpanProcessor
tracer_provider = TracerProvider(
resource=Resource.create({SERVICE_NAME: "ai-service"}),
)
exporter = OTLPSpanExporter()
span_processor = SimpleSpanProcessor(exporter)
tracer_provider.add_span_processor(span_processor)
trace.set_tracer_provider(tracer_provider)
Activation
To instrument all clients, call the instrument method
from llm_tracekit.anthropic import AnthropicInstrumentor
AnthropicInstrumentor().instrument()
Enabling message content
Message content such as the contents of the prompt, completion, function arguments and return values are not captured by default. To capture message content as span attributes, do one of the following:
- Pass
capture_content=Truewhen callingsetup_export_to_coralogix - Set the environment variable
OTEL_INSTRUMENTATION_GENAI_CAPTURE_MESSAGE_CONTENTtotrue
Most Coralogix AI evaluations will not work without message contents, so it is highly recommended to enable capturing.
Uninstrument
To uninstrument clients, call the uninstrument method:
AnthropicInstrumentor().uninstrument()
Full Example
from llm_tracekit.anthropic import AnthropicInstrumentor, setup_export_to_coralogix
from anthropic import Anthropic
# Optional: Configure sending spans to Coralogix
# Reads Coralogix connection details from the following environment variables:
# - CX_TOKEN
# - CX_ENDPOINT
setup_export_to_coralogix(
service_name="ai-service",
application_name="ai-application",
subsystem_name="ai-subsystem",
capture_content=True,
)
# Activate instrumentation
AnthropicInstrumentor().instrument()
# Example Anthropic Usage
client = Anthropic()
response = client.messages.create(
model="claude-sonnet-4-6",
max_tokens=1024,
messages=[
{"role": "user", "content": "Write a short poem on open telemetry."},
],
)
Changes from OpenTelemetry
General
- Instruments sync and async
messages.create(includingstream=True) andmessages.stream/AsyncMessages.stream. - The
metadata.user_idrequest field is recorded as thegen_ai.request.userattribute. - User prompts and model responses are captured as span attributes instead of log events (see Semantic Conventions below).
Semantic Conventions
| Attribute | Type | Description | Examples |
|---|---|---|---|
gen_ai.prompt.<message_number>.role |
string | Role of message author for user message <message_number> | system, user, assistant, tool |
gen_ai.prompt.<message_number>.content |
string | Contents of user message <message_number> | What's the weather in Paris? |
gen_ai.prompt.<message_number>.tool_calls.<tool_call_number>.id |
string | ID of tool call in user message <message_number> | toolu_01ABC123 |
gen_ai.prompt.<message_number>.tool_calls.<tool_call_number>.type |
string | Type of tool call in user message <message_number> | function |
gen_ai.prompt.<message_number>.tool_calls.<tool_call_number>.function.name |
string | The name of the function used in tool call within user message <message_number> | get_current_weather |
gen_ai.prompt.<message_number>.tool_calls.<tool_call_number>.function.arguments |
string | Arguments passed to the function used in tool call within user message <message_number> | {"location": "Seattle, WA"} |
gen_ai.prompt.<message_number>.tool_call_id |
string | Tool call ID in user message <message_number> (for tool results) | toolu_01ABC123 |
gen_ai.completion.<choice_number>.role |
string | Role of message author for choice <choice_number> in model response | assistant |
gen_ai.completion.<choice_number>.finish_reason |
string | Finish reason for choice <choice_number> in model response | end_turn, tool_use, max_tokens |
gen_ai.completion.<choice_number>.content |
string | Contents of choice <choice_number> in model response | The weather in Paris is rainy and overcast, with temperatures around 57°F |
gen_ai.completion.<choice_number>.tool_calls.<tool_call_number>.id |
string | ID of tool call in choice <choice_number> | toolu_01ABC123 |
gen_ai.completion.<choice_number>.tool_calls.<tool_call_number>.type |
string | Type of tool call in choice <choice_number> | function |
gen_ai.completion.<choice_number>.tool_calls.<tool_call_number>.function.name |
string | The name of the function used in tool call within choice <choice_number> | get_current_weather |
gen_ai.completion.<choice_number>.tool_calls.<tool_call_number>.function.arguments |
string | Arguments passed to the function used in tool call within choice <choice_number> | {"location": "Seattle, WA"} |
gen_ai.request.tools.<tool_number>.type |
string | Type of tool entry in tools list | function |
gen_ai.request.tools.<tool_number>.function.name |
string | The name of the function to use in tool calls | get_current_weather |
gen_ai.request.tools.<tool_number>.function.description |
string | Description of the function | Get the current weather in a given location |
gen_ai.request.tools.<tool_number>.function.parameters |
string | JSON describing the schema of the function parameters | {"type": "object", "properties": {"location": {"type": "string"}}, "required": ["location"]} |
gen_ai.request.user |
string | A unique identifier representing the end-user (from metadata.user_id) |
user@company.com |
Metadata
Release files for llm-tracekit-anthropic 1.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| llm_tracekit_anthropic-1.0.0.tar.gz | 13.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| llm_tracekit_anthropic-1.0.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 30.1 kB
Release files / llm_tracekit_anthropic-1.0.0.tar.gz
| Download URL | llm_tracekit_anthropic-1.0.0.tar.gz |
|---|---|
| Size | 13.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
833a4538e2bcb2bd317b1fc5d6c24771938b48872101a0b09e6c2811e31162a1
|
|
BLAKE2b-256 checksum How to use checksums |
4742003b35e583247c717f8aefffa01005c59873df38d094abc8e0e28d67f694
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|
Release files / llm_tracekit_anthropic-1.0.0-py3-none-any.whl
| Download URL | llm_tracekit_anthropic-1.0.0-py3-none-any.whl |
|---|---|
| Size | 16.9 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
e4704c3edb1124d9df08ccef159fdde8f819087444bda7cab83eb48bc836cf2b
|
|
BLAKE2b-256 checksum How to use checksums |
e6169d207a942c57ac77324452c0009004709e6904dd562f326a6f00a85e89a2
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
uv/0.11.6 {"installer":{"name":"uv","version":"0.11.6","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}
|