OpenInference Anthropic Instrumentation

Python autoinstrumentation library for the Anthropic package

This package implements the following Anthropic clients:

Messages
Completions
AsyncMessages
AsyncCompletions

These traces are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize phoenix.

Installation

pip install openinference-instrumentation-anthropic

Quickstart

Through your terminal, install required packages.

pip install openinference-instrumentation-anthropic anthropic arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

You can start Phoenix with the following terminal command:

python -m phoenix.server.main serve

By default, Phoenix listens on http://localhost:6006. You can visit the app via a browser at the same address. (Phoenix does not send data over the internet. It only operates locally on your machine.)

Try the following code in a Python file.

Set up AnthropicInstrumentor to trace your application and sends the traces to Phoenix.
Then, set your Anthropic API key as an environment variable.
Lastly, create a Anthropic client, make a request, then go see your results in Phoenix at http://localhost:6006!

import os
from anthropic import Anthropic
from openinference.instrumentation.anthropic import AnthropicInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import SimpleSpanProcessor

# Configure AnthropicInstrumentor with Phoenix endpoint
endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))

AnthropicInstrumentor().instrument(tracer_provider=tracer_provider)

os.environ["ANTHROPIC_API_KEY"] = "YOUR_KEY_HERE"

client = Anthropic()

response = client.messages.create(
    max_tokens=1024,
    messages=[
        {
            "role": "user",
            "content": "Tell me about the history of Iceland!",
        }
    ],
    model="claude-3-opus-20240229",
)
print(response)

Now, on the Phoenix UI on your browser, you should see the traces from your Anthropic application. Click on a trace, then the "Attributes" tab will provide you with in-depth information regarding execution!

Metadata

Release files for openinference-instrumentation-anthropic 0.1.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for openinference-instrumentation-anthropic 0.1.1
File	Size	Uploaded
openinference_instrumentation_anthropic-0.1.1.tar.gz	9.2 kB	Aug 21, 2024	Details

Built distribution (wheel)

Table of built distributions (wheels) for openinference-instrumentation-anthropic 0.1.1
File	Interpreter	ABI	Platform	Reset
openinference_instrumentation_anthropic-0.1.1-py3-none-any.whl 10.3 kB Aug 21, 2024	Python 3	none	any	Details

Total release size: 19.5 kB

Release files / openinference_instrumentation_anthropic-0.1.1.tar.gz

Download URL	openinference_instrumentation_anthropic-0.1.1.tar.gz
Size	9.2 kB
Tags	Source
SHA-256 checksum How to use checksums	`8595afa2e6b038dc3fa435c74d50ee0c405c6d3c6bd8541a048144f1cc931b51`
BLAKE2b-256 checksum How to use checksums	`78ecad755b3b5aa255f9f5e466e5ad1e5cb92a8d5ec174aeb683074708842fea`
Upload date	Aug 21, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.5`

Release files / openinference_instrumentation_anthropic-0.1.1-py3-none-any.whl

Download URL	openinference_instrumentation_anthropic-0.1.1-py3-none-any.whl
Size	10.3 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`45b9a9881e045df1d5e8d2496176bc147b0854368fd8d0723caa94c7777a986b`
BLAKE2b-256 checksum How to use checksums	`f86c07dcd84746be28049b87d005ce03d6afbc299f42c9feccecc64dcc9454c5`
Upload date	Aug 21, 2024
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/5.1.1 CPython/3.12.5`