OpenInference Haystack Instrumentation
Python auto-instrumentation library for LLM applications implemented with Haystack.
Haystack Pipelines and Components (ex. PromptBuilder, OpenAIGenerator, etc.) are fully OpenTelemetry-compatible and can be sent to an OpenTelemetry collector for monitoring, such as arize-phoenix.
Installation
pip install openinference-instrumentation-haystack
Quickstart
This quickstart shows you how to instrument your Haystack-orchestrated LLM application
Through your terminal, install required packages.
pip install openinference-instrumentation-haystack haystack-ai arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp
You can install Phoenix and start it with the following terminal commands:
pip install arize-phoenix
python -m phoenix.server.main serve
Start Phoenix in the background as a collector. By default, it listens on http://localhost:6006. You can visit the app via a browser at the same address. (Phoenix does not send data over the internet. It only operates locally on your machine.)
Try the following in a Python file.
Set up HaystackInstrumentor to trace your application and sends the traces to Phoenix at the endpoint defined below.
from openinference.instrumentation.haystack import HaystackInstrumentor
from opentelemetry import trace as trace_api
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import SimpleSpanProcessor
import os
# Set your OpenAI API key
os.environ["OPENAI_API_KEY"] = "YOUR_KEY_HERE"
# Set up the tracer, using Arize Phoenix as the endpoint
endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
trace_api.set_tracer_provider(tracer_provider)
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
# Instrument the Haystack application
HaystackInstrumentor().instrument()
Set up a simple Pipeline with a template using OpenAIGenerator.
from haystack import Pipeline
from haystack.components.generators import OpenAIGenerator
# Initialize the pipeline
pipeline = Pipeline()
# Initialize the OpenAI generator component
llm = OpenAIGenerator(model="gpt-3.5-turbo")
# Add the generator component to the pipeline
pipeline.add_component("llm", llm)
# Define the question
question = "What is the location of the Hanging Gardens of Babylon?"
# Run the pipeline with the question
response = pipeline.run({"llm": {"prompt": question}})
print(response)
Now, on the Phoenix UI on your browser, you should see the traces from your Haystack application. Specifically, you can see attributes from the execution of the OpenAIGenerator.
More Info
1 maintainer
Metadata
1 maintainer
Release files for openinference-instrumentation-haystack 0.1.28
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| openinference_instrumentation_haystack-0.1.28.tar.gz | 15.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| openinference_instrumentation_haystack-0.1.28-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 32.6 kB
Release files / openinference_instrumentation_haystack-0.1.28.tar.gz
| Download URL | openinference_instrumentation_haystack-0.1.28.tar.gz |
|---|---|
| Size | 15.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5682f42686b55d90f0e7cf85fad5d1b5f9ff11af4ce2775fa0ed33e230c8de3e
|
|
BLAKE2b-256 checksum How to use checksums |
eb627d417338d4507d6c799ceee5fc1c38a410801307050620867b7f5300e48f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.0
|
Release files / openinference_instrumentation_haystack-0.1.28-py3-none-any.whl
| Download URL | openinference_instrumentation_haystack-0.1.28-py3-none-any.whl |
|---|---|
| Size | 17.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
a4c93f7b0093ef1d15ae53e9574645fc2ddbece6b79d88222e9609f1a058ac7c
|
|
BLAKE2b-256 checksum How to use checksums |
c3130a0662b4ce633a1f8eca177cdcc70dc897246dee9e54a4697b213bc1bc92
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.14.0
|
