OpenInference OpenAI Instrumentation

Python auto-instrumentation library for OpenAI's python SDK.

The traces emitted by this instrumentation are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize Phoenix or Arize AX.

Installation

pip install openinference-instrumentation-openai

Quickstart

In this example we will instrument a small program that uses OpenAI and observe the traces via arize-phoenix.

Install packages.

pip install openinference-instrumentation-openai "openai>=1.26" arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

Start the phoenix server so that it is ready to collect traces. The Phoenix server runs entirely on your machine and does not send data over the internet.

python -m phoenix.server.main serve

In a python file, setup the OpenAIInstrumentor and configure the tracer to send traces to Phoenix.

import openai
from openinference.instrumentation.openai import OpenAIInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import ConsoleSpanExporter, SimpleSpanProcessor

endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
# Optionally, you can also print the spans to the console.
tracer_provider.add_span_processor(SimpleSpanProcessor(ConsoleSpanExporter()))

OpenAIInstrumentor().instrument(tracer_provider=tracer_provider)


if __name__ == "__main__":
    client = openai.OpenAI()
    response = client.chat.completions.create(
        model="gpt-3.5-turbo",
        messages=[{"role": "user", "content": "Write a haiku."}],
        max_tokens=20,
        stream=True,
        stream_options={"include_usage": True},
    )
    for chunk in response:
        if chunk.choices and (content := chunk.choices[0].delta.content):
            print(content, end="")

Since we are using OpenAI, we must set the OPENAI_API_KEY environment variable to authenticate with the OpenAI API.

export OPENAI_API_KEY=your-api-key

Now simply run the python file and observe the traces in Phoenix.

python your_file.py

FAQ

Q: How to get token counts when streaming?

A: To get token counts when streaming, install openai>=1.26 and set stream_options={"include_usage": True} when calling create. See the example shown above. For more info, see here.

More Info

Release files for openinference-instrumentation-openai 0.1.57

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for openinference-instrumentation-openai 0.1.57
File	Size	Uploaded
openinference_instrumentation_openai-0.1.57.tar.gz	23.7 kB	Aug 28, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for openinference-instrumentation-openai 0.1.57
File	Interpreter	ABI	Platform	Reset
openinference_instrumentation_openai-0.1.57-py3-none-any.whl 31.3 kB Aug 28, 2026	Python 3	none	any	Details

Total release size: 55.1 kB

Release files / openinference_instrumentation_openai-0.1.57.tar.gz

Download URL	openinference_instrumentation_openai-0.1.57.tar.gz
Size	23.7 kB
Tags	Source
SHA-256 checksum How to use checksums	`60143b4567fd045cf040585da0c738458e5c98025bf3977a787cdd69103d5796`
BLAKE2b-256 checksum How to use checksums	`03ac26eca6b9b3f64cc16c43820b669fcb56b0935be416ce4a9bdbf8d66c261e`
Upload date	Aug 28, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/7.0.0 CPython/3.13.14`

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/Arize-ai/openinference
Publishing commit: github.com/Arize-ai/openinference/tree/df52c1563279ee9a8cd01a1c314e740914c36f0c

Workflow

Publishing configuration: github.com/Arize-ai/openinference/blob/df52c1563279ee9a8cd01a1c314e740914c36f0c/.github/workflows/publish.yaml
Publishing logs: github.com/Arize-ai/openinference/actions/runs/33142954664/attempts/1

Artifact

Subject: openinference_instrumentation_openai-0.1.57.tar.gz
SHA-256 checksum: 60143b4567fd045cf040585da0c738458e5c98025bf3977a787cdd69103d5796 Verifying attestations

Release files / openinference_instrumentation_openai-0.1.57-py3-none-any.whl

Download URL	openinference_instrumentation_openai-0.1.57-py3-none-any.whl
Size	31.3 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`c4c3c4d48c61f1a48d49367e5c4c95db60726d5e6956bcb1bdc604167cf45068`
BLAKE2b-256 checksum How to use checksums	`8f4891cff0a5feb4a731557835bea55d6381f9be024c46262bbf0e6d892f2ced`
Upload date	Aug 28, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/7.0.0 CPython/3.13.14`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/Arize-ai/openinference
Publishing commit: github.com/Arize-ai/openinference/tree/df52c1563279ee9a8cd01a1c314e740914c36f0c

Workflow

Publishing configuration: github.com/Arize-ai/openinference/blob/df52c1563279ee9a8cd01a1c314e740914c36f0c/.github/workflows/publish.yaml
Publishing logs: github.com/Arize-ai/openinference/actions/runs/33142954664/attempts/1

Artifact

Subject: openinference_instrumentation_openai-0.1.57-py3-none-any.whl
SHA-256 checksum: c4c3c4d48c61f1a48d49367e5c4c95db60726d5e6956bcb1bdc604167cf45068 Verifying attestations