OpenInference smolagents Instrumentation
Python auto-instrumentation library for LLM agents implemented with smolagents
Crews are fully OpenTelemetry-compatible and can be sent to an OpenTelemetry collector for monitoring, such as arize-phoenix.
Installation
pip install openinference-instrumentation-smolagents
Quickstart
This quickstart shows you how to instrument your guardrailed LLM application
Install required packages.
pip install smolagents arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp
Start Phoenix in the background as a collector. By default, it listens on http://localhost:6006. You can visit the app via a browser at the same address. (Phoenix does not send data over the internet. It only operates locally on your machine.)
python -m phoenix.server.main serve
Set up SmolagentsInstrumentor to trace your crew and send the traces to Phoenix at the endpoint defined below.
from opentelemetry import trace
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry.sdk.trace.export import BatchSpanProcessor
from openinference.instrumentation.smolagents import SmolagentsInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk.trace.export import ConsoleSpanExporter, SimpleSpanProcessor
endpoint = "http://0.0.0.0:6006/v1/traces"
trace_provider = TracerProvider()
trace_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
SmolagentsInstrumentor().instrument(tracer_provider=trace_provider)
from smolagents import CodeAgent, DuckDuckGoSearchTool, HfApiModel
agent = CodeAgent(tools=[DuckDuckGoSearchTool()], model=HfApiModel())
agent.run("How many seconds would it take for a leopard at full speed to run through Pont des Arts?")
More Info
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file openinference_instrumentation_smolagents-0.1.0.tar.gz.
File metadata
- Download URL: openinference_instrumentation_smolagents-0.1.0.tar.gz
- Upload date:
- Size: 10.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d86c4821f04396a2d36f19da1532e371fee0c216a8095f2c983f2db5d8e673a4
|
|
| MD5 |
1685ae72f431e6f1e4de6b6a5c690d72
|
|
| BLAKE2b-256 |
bd2b74b6a55035df3448437589324c43914b034e5d81140d4d55080bc4eb56e1
|
File details
Details for the file openinference_instrumentation_smolagents-0.1.0-py3-none-any.whl.
File metadata
- Download URL: openinference_instrumentation_smolagents-0.1.0-py3-none-any.whl
- Upload date:
- Size: 11.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3a1b0f4977422792fbd49b638ad7ccb3d7b0f7623436c50aa10a487d19e9843f
|
|
| MD5 |
53fd81d8693ca3265a96c81b5eac17ce
|
|
| BLAKE2b-256 |
8d09b00c594232c6395c9bdce4bd2de2a96c62445c26e0f574759b41168e2c59
|
