respan-instrumentation-replicate 0.1.0

Respan instrumentation plugin for the Replicate Python SDK

Respan Replicate Instrumentation

Trace the official replicate Python SDK with Respan.

The instrumentation patches the Replicate client lifecycle and emits canonical Respan spans for run, async_run, stream, async_stream, prediction creation, prediction waiting, and prediction lookup/cancel operations.

Install

pip install respan-ai respan-instrumentation-replicate replicate

Usage

import os

import replicate
from respan import Respan, workflow
from respan_instrumentation_replicate import ReplicateInstrumentor

respan = Respan(
    api_key=os.environ["RESPAN_API_KEY"],
    instrumentations=[ReplicateInstrumentor()],
)


@workflow(name="replicate_quickstart.workflow")
def run_prediction() -> str:
    output = replicate.run(
        "meta/meta-llama-3-8b-instruct",
        input={"prompt": "Reply with one concise sentence about tracing."},
    )
    return "".join(str(chunk) for chunk in output) if not isinstance(output, str) else output


print(run_prediction())
respan.flush()
respan.shutdown()

Use Respan(..., customer_identifier=..., thread_identifier=..., metadata=...) or respan.propagate_attributes(...) to attach Respan attributes to Replicate spans.