OpenInference Haystack Instrumentation

Python auto-instrumentation library for LLM applications implemented with Haystack.

Haystack Pipelines and Components (ex. PromptBuilder, OpenAIGenerator, etc.) are fully OpenTelemetry-compatible and can be sent to an OpenTelemetry collector for monitoring, such as arize-phoenix.

Installation

pip install openinference-instrumentation-haystack

Quickstart

This quickstart shows you how to instrument your Haystack-orchestrated LLM application

Through your terminal, install required packages.

pip install openinference-instrumentation-haystack haystack-ai arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

You can install Phoenix and start it with the following terminal commands:

pip install arize-phoenix
python -m phoenix.server.main serve

Start Phoenix in the background as a collector. By default, it listens on http://localhost:6006. You can visit the app via a browser at the same address. (Phoenix does not send data over the internet. It only operates locally on your machine.)

Try the following in a Python file.

Set up HaystackInstrumentor to trace your application and sends the traces to Phoenix at the endpoint defined below.

from openinference.instrumentation.haystack import HaystackInstrumentor
from opentelemetry import trace as trace_api
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import SimpleSpanProcessor
import os

# Set your OpenAI API key
os.environ["OPENAI_API_KEY"] = "YOUR_KEY_HERE"

# Set up the tracer, using Arize Phoenix as the endpoint
endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
trace_api.set_tracer_provider(tracer_provider)
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))

# Instrument the Haystack application
HaystackInstrumentor().instrument()

Set up a simple Pipeline with a template using OpenAIGenerator.

from haystack import Pipeline
from haystack.components.generators import OpenAIGenerator

# Initialize the pipeline
pipeline = Pipeline()

# Initialize the OpenAI generator component
llm = OpenAIGenerator(model="gpt-3.5-turbo")

# Add the generator component to the pipeline
pipeline.add_component("llm", llm)

# Define the question
question = "What is the location of the Hanging Gardens of Babylon?"

# Run the pipeline with the question
response = pipeline.run({"llm": {"prompt": question}})

print(response)

Now, on the Phoenix UI on your browser, you should see the traces from your Haystack application. Specifically, you can see attributes from the execution of the OpenAIGenerator.

More Info

Metadata

Release files for openinference-instrumentation-haystack 0.1.34

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for openinference-instrumentation-haystack 0.1.34
File	Size	Uploaded
openinference_instrumentation_haystack-0.1.34.tar.gz	15.8 kB	May 18, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for openinference-instrumentation-haystack 0.1.34
File	Interpreter	ABI	Platform	Reset
openinference_instrumentation_haystack-0.1.34-py3-none-any.whl 17.7 kB May 18, 2026	Python 3	none	any	Details

Total release size: 33.6 kB

Release files / openinference_instrumentation_haystack-0.1.34.tar.gz

Download URL	openinference_instrumentation_haystack-0.1.34.tar.gz
Size	15.8 kB
Tags	Source
SHA-256 checksum How to use checksums	`952ebfb4abe8701374f5131d7b5e156b9fb8601bdbee4bc868eabf383d0f63d7`
BLAKE2b-256 checksum How to use checksums	`b4a68dfddcc7bc17b0151f8539a828b74d5a6f4fe74e4011de54f252d52f29d6`
Upload date	May 18, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.1.0 CPython/3.13.13`

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/Arize-ai/openinference
Publishing commit: github.com/Arize-ai/openinference/tree/01244b3c0757a19d5a93f34a96ab9480cecc63d3

Workflow

Publishing configuration: github.com/Arize-ai/openinference/blob/01244b3c0757a19d5a93f34a96ab9480cecc63d3/.github/workflows/publish.yaml
Publishing logs: github.com/Arize-ai/openinference/actions/runs/26053658176/attempts/1

Artifact

Subject: openinference_instrumentation_haystack-0.1.34.tar.gz
SHA-256 checksum: 952ebfb4abe8701374f5131d7b5e156b9fb8601bdbee4bc868eabf383d0f63d7 Verifying attestations

Release files / openinference_instrumentation_haystack-0.1.34-py3-none-any.whl

Download URL	openinference_instrumentation_haystack-0.1.34-py3-none-any.whl
Size	17.7 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`8884a428ba8dc57a4adbbecf5b1b683f11cb6ad0ec6af178d403b2105e34be89`
BLAKE2b-256 checksum How to use checksums	`f2abffb890aa1160da8a5d45cbe043571aa0bec3eeb46d7f3cfb4b8ef89aadfd`
Upload date	May 18, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.1.0 CPython/3.13.13`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/Arize-ai/openinference
Publishing commit: github.com/Arize-ai/openinference/tree/01244b3c0757a19d5a93f34a96ab9480cecc63d3

Workflow

Publishing configuration: github.com/Arize-ai/openinference/blob/01244b3c0757a19d5a93f34a96ab9480cecc63d3/.github/workflows/publish.yaml
Publishing logs: github.com/Arize-ai/openinference/actions/runs/26053658176/attempts/1

Artifact

Subject: openinference_instrumentation_haystack-0.1.34-py3-none-any.whl
SHA-256 checksum: 8884a428ba8dc57a4adbbecf5b1b683f11cb6ad0ec6af178d403b2105e34be89 Verifying attestations