OpenInference LlamaIndex Instrumentation

Python auto-instrumentation library for LlamaIndex.

These traces are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize Phoenix or Arize AX.

Installation

pip install openinference-instrumentation-llama-index

Compatibility

llama-index version	openinference-instrumentation-llama-index version
>=0.12.3	>=4.0
>=0.11.0	>=3.0
>=0.10.43	>=2.0, <3.0
>=0.10.0, <0.10.43	>=1.0, <0.2
>=0.9.14, <0.10.0	0.1.3

Quickstart

Install packages needed for this demonstration.

python -m pip install --upgrade \
    openinference-instrumentation-llama-index \
    opentelemetry-sdk \
    opentelemetry-exporter-otlp \
    "opentelemetry-proto>=1.12.0" \
    arize-phoenix

Start the Phoenix app in the background as a collector. By default, it listens on http://localhost:6006. You can visit the app via a browser at the same address.

The Phoenix app does not send data over the internet. It only operates locally on your machine.

python -m phoenix.server.main serve

The following Python code sets up the LlamaIndexInstrumentor to trace llama-index and send the traces to Phoenix at the endpoint shown below.

from openinference.instrumentation.llama_index import LlamaIndexInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import SimpleSpanProcessor

endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))

LlamaIndexInstrumentor().instrument(tracer_provider=tracer_provider)

To demonstrate tracing, we'll use LlamaIndex below to query a document.

First, download a text file.

import tempfile
from urllib.request import urlretrieve
from llama_index.core import SimpleDirectoryReader

url = "https://raw.githubusercontent.com/Arize-ai/phoenix-assets/main/data/paul_graham/paul_graham_essay.txt"
with tempfile.NamedTemporaryFile() as tf:
    urlretrieve(url, tf.name)
    documents = SimpleDirectoryReader(input_files=[tf.name]).load_data()

Next, we'll query using OpenAI. To do that you need to set up your OpenAI API key in an environment variable.

import os

os.environ["OPENAI_API_KEY"] = "<your openai key>"

Now we can query the indexed documents.

from llama_index.core import VectorStoreIndex

query_engine = VectorStoreIndex.from_documents(documents).as_query_engine()
print(query_engine.query("What did the author do growing up?"))

Visit the Phoenix app at http://localhost:6006 to see the traces.

More Info

Metadata

Release files for openinference-instrumentation-llama-index 4.5.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for openinference-instrumentation-llama-index 4.5.4
File	Size	Uploaded
openinference_instrumentation_llama_index-4.5.4.tar.gz	69.5 kB	Oct 1, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for openinference-instrumentation-llama-index 4.5.4
File	Interpreter	ABI	Platform	Reset
openinference_instrumentation_llama_index-4.5.4-py3-none-any.whl 32.0 kB Oct 1, 2026	Python 3	none	any	Details

Total release size: 101.5 kB

Release files / openinference_instrumentation_llama_index-4.5.4.tar.gz

Download URL	openinference_instrumentation_llama_index-4.5.4.tar.gz
Size	69.5 kB
Tags	Source
SHA-256 checksum How to use checksums	`a81011ea21965f742862d655e78bc7a3d4c5c243f7a4b9cbe71c05beeabc1f3b`
BLAKE2b-256 checksum How to use checksums	`296e932e21ccac9de6651d5da7ab921228f3eb5294162da752918f72fc9bf257`
Upload date	Oct 1, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/7.0.0 CPython/3.13.14`

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/Arize-ai/openinference
Publishing commit: github.com/Arize-ai/openinference/tree/c7f15ec66b1374ee3e7aafbdba5a55959afacac7

Workflow

Publishing configuration: github.com/Arize-ai/openinference/blob/c7f15ec66b1374ee3e7aafbdba5a55959afacac7/.github/workflows/publish.yaml
Publishing logs: github.com/Arize-ai/openinference/actions/runs/36934725924/attempts/1

Artifact

Subject: openinference_instrumentation_llama_index-4.5.4.tar.gz
SHA-256 checksum: a81011ea21965f742862d655e78bc7a3d4c5c243f7a4b9cbe71c05beeabc1f3b Verifying attestations

Release files / openinference_instrumentation_llama_index-4.5.4-py3-none-any.whl

Download URL	openinference_instrumentation_llama_index-4.5.4-py3-none-any.whl
Size	32.0 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`54f89b864ddf6d62cad03a08a3a720aacfc4e0078dc4c2e98ab21f020e5b7c2d`
BLAKE2b-256 checksum How to use checksums	`1fb711243abda52e5141dc60d4c9feeb00118a37110f49fadf2f8ca5b2343dc3`
Upload date	Oct 1, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/7.0.0 CPython/3.13.14`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/Arize-ai/openinference
Publishing commit: github.com/Arize-ai/openinference/tree/c7f15ec66b1374ee3e7aafbdba5a55959afacac7

Workflow

Publishing configuration: github.com/Arize-ai/openinference/blob/c7f15ec66b1374ee3e7aafbdba5a55959afacac7/.github/workflows/publish.yaml
Publishing logs: github.com/Arize-ai/openinference/actions/runs/36934725924/attempts/1

Artifact

Subject: openinference_instrumentation_llama_index-4.5.4-py3-none-any.whl
SHA-256 checksum: 54f89b864ddf6d62cad03a08a3a720aacfc4e0078dc4c2e98ab21f020e5b7c2d Verifying attestations