OpenInference Anthropic Instrumentation

Python autoinstrumentation library for the Anthropic package

This package implements the following Anthropic clients:

Messages
Completions
AsyncMessages
AsyncCompletions

These traces are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize phoenix.

Installation

pip install openinference-instrumentation-anthropic

Quickstart

Through your terminal, install required packages.

pip install openinference-instrumentation-anthropic anthropic arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

You can start Phoenix with the following terminal command:

python -m phoenix.server.main serve

By default, Phoenix listens on http://localhost:6006. You can visit the app via a browser at the same address. (Phoenix does not send data over the internet. It only operates locally on your machine.)

Try the following code in a Python file.

Set up AnthropicInstrumentor to trace your application and sends the traces to Phoenix.
Then, set your Anthropic API key as an environment variable.
Lastly, create a Anthropic client, make a request, then go see your results in Phoenix at http://localhost:6006!

import os
from anthropic import Anthropic
from openinference.instrumentation.anthropic import AnthropicInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import SimpleSpanProcessor

# Configure AnthropicInstrumentor with Phoenix endpoint
endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))

AnthropicInstrumentor().instrument(tracer_provider=tracer_provider)

os.environ["ANTHROPIC_API_KEY"] = "YOUR_KEY_HERE"

client = Anthropic()

response = client.messages.create(
    max_tokens=1024,
    messages=[
        {
            "role": "user",
            "content": "Tell me about the history of Iceland!",
        }
    ],
    model="claude-3-opus-20240229",
)
print(response)

Now, on the Phoenix UI on your browser, you should see the traces from your Anthropic application. Click on a trace, then the "Attributes" tab will provide you with in-depth information regarding execution!

Metadata

Release files for openinference-instrumentation-anthropic 0.1.5

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for openinference-instrumentation-anthropic 0.1.5
File	Size	Uploaded
openinference_instrumentation_anthropic-0.1.5.tar.gz	13.2 kB	Oct 28, 2024	Details

Built distribution (wheel)

Table of built distributions (wheels) for openinference-instrumentation-anthropic 0.1.5
File	Interpreter	ABI	Platform	Reset
openinference_instrumentation_anthropic-0.1.5-py3-none-any.whl 16.0 kB Oct 28, 2024	Python 3	none	any	Details

Total release size: 29.2 kB

Release files / openinference_instrumentation_anthropic-0.1.5.tar.gz

Download URL	openinference_instrumentation_anthropic-0.1.5.tar.gz
Size	13.2 kB
Tags	Source
SHA-256 checksum How to use checksums	`cef55594265e4876368fdaa48f708ba5f3041f5443a402cfd790b0b9636eac0a`
BLAKE2b-256 checksum How to use checksums	`eaaf5590908227dcc7aaea063b88df99b93dc15b4d4ac693dcd2bb56e390b754`
Upload date	Oct 28, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.7`

Release files / openinference_instrumentation_anthropic-0.1.5-py3-none-any.whl

Download URL	openinference_instrumentation_anthropic-0.1.5-py3-none-any.whl
Size	16.0 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`fe4c5d0a84ff53d3f8e582e62bdf851361d948110bbc9d04dcd3e3eb8b522c6a`
BLAKE2b-256 checksum How to use checksums	`7c8ce04506706a092109d079ce28114ab8c2df044785effc493a1026e75f556d`
Upload date	Oct 28, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.7`