OpenInference Anthropic Instrumentation

Python autoinstrumentation library for the Anthropic package

This package implements the following Anthropic clients:

Messages
Completions
AsyncMessages
AsyncCompletions

These traces are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize phoenix.

Installation

pip install openinference-instrumentation-anthropic

Quickstart

Through your terminal, install required packages.

pip install openinference-instrumentation-anthropic anthropic arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

You can start Phoenix with the following terminal command:

python -m phoenix.server.main serve

By default, Phoenix listens on http://localhost:6006. You can visit the app via a browser at the same address. (Phoenix does not send data over the internet. It only operates locally on your machine.)

Try the following code in a Python file.

Set up AnthropicInstrumentor to trace your application and sends the traces to Phoenix.
Then, set your Anthropic API key as an environment variable.
Lastly, create a Anthropic client, make a request, then go see your results in Phoenix at http://localhost:6006!

import os
from anthropic import Anthropic
from openinference.instrumentation.anthropic import AnthropicInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import SimpleSpanProcessor

# Configure AnthropicInstrumentor with Phoenix endpoint
endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))

AnthropicInstrumentor().instrument(tracer_provider=tracer_provider)

os.environ["ANTHROPIC_API_KEY"] = "YOUR_KEY_HERE"

client = Anthropic()

response = client.messages.create(
    max_tokens=1024,
    messages=[
        {
            "role": "user",
            "content": "Tell me about the history of Iceland!",
        }
    ],
    model="claude-3-opus-20240229",
)
print(response)

Now, on the Phoenix UI on your browser, you should see the traces from your Anthropic application. Click on a trace, then the "Attributes" tab will provide you with in-depth information regarding execution!

Metadata

Release files for openinference-instrumentation-anthropic 0.1.8

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for openinference-instrumentation-anthropic 0.1.8
File	Size	Uploaded
openinference_instrumentation_anthropic-0.1.8.tar.gz	13.3 kB	Nov 20, 2024	Details

Built distribution (wheel)

Table of built distributions (wheels) for openinference-instrumentation-anthropic 0.1.8
File	Interpreter	ABI	Platform	Reset
openinference_instrumentation_anthropic-0.1.8-py3-none-any.whl 16.2 kB Nov 20, 2024	Python 3	none	any	Details

Total release size: 29.5 kB

Release files / openinference_instrumentation_anthropic-0.1.8.tar.gz

Download URL	openinference_instrumentation_anthropic-0.1.8.tar.gz
Size	13.3 kB
Tags	Source
SHA-256 checksum How to use checksums	`93c62a190d07dc40c132dc10d01886d259cbbce2e2fb0a0787fac63baa717ff7`
BLAKE2b-256 checksum How to use checksums	`f99d8d5b88a3d45659657b4ee48099e8a4829569afaba7b23ae842b63fef1bc9`
Upload date	Nov 20, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.7`

Release files / openinference_instrumentation_anthropic-0.1.8-py3-none-any.whl

Download URL	openinference_instrumentation_anthropic-0.1.8-py3-none-any.whl
Size	16.2 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`87c1549e6c9973bcc3e7e8c6c401fc98cafeecd7de39144c1ebaced1a608fa90`
BLAKE2b-256 checksum How to use checksums	`f70bdb89a2613da2d08bac9d0bf892a3aa03cdffaf5524473abb43a9df63045c`
Upload date	Nov 20, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.7`