OpenInference Anthropic Instrumentation

Python autoinstrumentation library for the Anthropic package

This package implements the following Anthropic clients:

Messages
Completions
AsyncMessages
AsyncCompletions

These traces are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize phoenix.

Installation

pip install openinference-instrumentation-anthropic

Quickstart

Through your terminal, install required packages.

pip install openinference-instrumentation-anthropic anthropic arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

You can start Phoenix with the following terminal command:

python -m phoenix.server.main serve

By default, Phoenix listens on http://localhost:6006. You can visit the app via a browser at the same address. (Phoenix does not send data over the internet. It only operates locally on your machine.)

Try the following code in a Python file.

Set up AnthropicInstrumentor to trace your application and sends the traces to Phoenix.
Then, set your Anthropic API key as an environment variable.
Lastly, create a Anthropic client, make a request, then go see your results in Phoenix at http://localhost:6006!

import os
from anthropic import Anthropic
from openinference.instrumentation.anthropic import AnthropicInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import SimpleSpanProcessor

# Configure AnthropicInstrumentor with Phoenix endpoint
endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))

AnthropicInstrumentor().instrument(tracer_provider=tracer_provider)

os.environ["ANTHROPIC_API_KEY"] = "YOUR_KEY_HERE"

client = Anthropic()

response = client.messages.create(
    max_tokens=1024,
    messages=[
        {
            "role": "user",
            "content": "Tell me about the history of Iceland!",
        }
    ],
    model="claude-3-opus-20240229",
)
print(response)

Now, on the Phoenix UI on your browser, you should see the traces from your Anthropic application. Click on a trace, then the "Attributes" tab will provide you with in-depth information regarding execution!

Metadata

Release files for openinference-instrumentation-anthropic 0.1.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for openinference-instrumentation-anthropic 0.1.3
File	Size	Uploaded
openinference_instrumentation_anthropic-0.1.3.tar.gz	9.4 kB	Sep 4, 2024	Details

Built distribution (wheel)

Table of built distributions (wheels) for openinference-instrumentation-anthropic 0.1.3
File	Interpreter	ABI	Platform	Reset
openinference_instrumentation_anthropic-0.1.3-py3-none-any.whl 10.5 kB Sep 4, 2024	Python 3	none	any	Details

Total release size: 20.0 kB

Release files / openinference_instrumentation_anthropic-0.1.3.tar.gz

Download URL	openinference_instrumentation_anthropic-0.1.3.tar.gz
Size	9.4 kB
Tags	Source
SHA-256 checksum How to use checksums	`3b89b7e56b8ffd18fe858addde31ea30dd94453f3d902498a8e47f59ba4d558d`
BLAKE2b-256 checksum How to use checksums	`0fd366833e45931b46460f5d463f672007f6c6d2e192767b78beb58347c22f52`
Upload date	Sep 4, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.5`

Release files / openinference_instrumentation_anthropic-0.1.3-py3-none-any.whl

Download URL	openinference_instrumentation_anthropic-0.1.3-py3-none-any.whl
Size	10.5 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`98f1193edca1b01f4ea22906f7fe781de63c8b9d901772c291f605931ffea06d`
BLAKE2b-256 checksum How to use checksums	`e756d2eedd3aaf1e1bfb682595e0d44939f410e52c6ea40686de2a0fee47db99`
Upload date	Sep 4, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.5`