OpenInference Groq Instrumentation
Python autoinstrumentation library for the Groq package
This package implements OpenInference tracing for both Groq and AsyncGroq clients.
These traces are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize phoenix.
Installation
pip install openinference-instrumentation-groq
Quickstart
Through your terminal, install required packages.
pip install openinference-instrumentation-groq groq arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp
You can start Phoenix with the following terminal command:
python -m phoenix.server.main serve
By default, Phoenix listens on http://localhost:6006. You can visit the app via a browser at the same address. (Phoenix does not send data over the internet. It only operates locally on your machine.)
Try the following code in a Python file.
- Set up
GroqInstrumentorto trace your application and sends the traces to Phoenix. - Then, set your Groq API key as an environment variable.
- Lastly, create a Groq client, make a request, then go see your results in Phoenix at
http://localhost:6006!
import os
from groq import Groq
from openinference.instrumentation.groq import GroqInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import SimpleSpanProcessor
# Configure GroqInstrumentor with Phoenix endpoint
endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
GroqInstrumentor().instrument(tracer_provider=tracer_provider)
os.environ["GROQ_API_KEY"] = "YOUR_KEY_HERE"
client = Groq()
chat_completion = client.chat.completions.create(
messages=[
{
"role": "user",
"content": "Explain the importance of low latency LLMs",
}
],
model="llama3-8b-8192",
)
if __name__ == "__main__":
print(chat_completion.choices[0].message.content)
Now, on the Phoenix UI on your browser, you should see the traces from your Groq application. Click on a trace, then the "Attributes" tab will provide you with in-depth information regarding execution!
More Info
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file openinference_instrumentation_groq-0.1.6.tar.gz.
File metadata
- Download URL: openinference_instrumentation_groq-0.1.6.tar.gz
- Upload date:
- Size: 11.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.13.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4364f7dfa0320761d303ffc14c79c92252ec28c92305280eae5254918bed40e6
|
|
| MD5 |
eb338e0cc0741fb9d0990c6e17be2cf8
|
|
| BLAKE2b-256 |
6cffa868ccffa48ad8303eae7876d102f1df7c45b29572fc525751bc600c0285
|
File details
Details for the file openinference_instrumentation_groq-0.1.6-py3-none-any.whl.
File metadata
- Download URL: openinference_instrumentation_groq-0.1.6-py3-none-any.whl
- Upload date:
- Size: 15.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.1.0 CPython/3.13.1
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e5f60a90322962a36930002ce81f22ee8bff5365f84975c810d81560dc708b46
|
|
| MD5 |
449a1c7688d760fdde2af136c896629f
|
|
| BLAKE2b-256 |
1eb7a71322139bc78833a69100b15b0fff6f06a37644fc5ddccc0e94e63bf1d9
|
