Skip to main content

OpenInference Mistral AI Instrumentation

PyPI Version

Python autoinstrumentation library for MistralAI's Python SDK.

The traces emitted by this instrumentation are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize Phoenix or Arize AX.

Compatibility

openinference-instrumentation-mistralai mistralai
<2.0.0 >=1.0.2, <2.0.0
>=2.0.0 >=2.0.0

Installation

pip install openinference-instrumentation-mistralai

Quickstart

In this example we will instrument a small program that uses the MistralAI chat completions API and observe the traces via arize-phoenix.

Install packages.

pip install openinference-instrumentation-mistralai mistralai arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

Start the phoenix server so that it is ready to collect traces. The Phoenix server runs entirely on your machine and does not send data over the internet.

python -m phoenix.server.main serve

In a python file, setup the MistralAIInstrumentor and configure the tracer to send traces to Phoenix.

from mistralai.client import MistralClient
from mistralai.models.chat_completion import ChatMessage
from openinference.instrumentation.mistralai import MistralAIInstrumentor
from opentelemetry import trace as trace_api
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import ConsoleSpanExporter, SimpleSpanProcessor

endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
# Optionally, you can also print the spans to the console.
tracer_provider.add_span_processor(SimpleSpanProcessor(ConsoleSpanExporter()))
trace_api.set_tracer_provider(tracer_provider)

MistralAIInstrumentor().instrument()


if __name__ == "__main__":
    client = MistralClient()
    response = client.chat(
        model="mistral-large-latest",
        messages=[
            ChatMessage(
                content="Who won the World Cup in 2018?",
                role="user",
            )
        ],
    )
    print(response.choices[0].message.content)

Since we are using MistralAI, we must set the MISTRAL_API_KEY environment variable to authenticate with the MistralAI API.

export MISTRAL_API_KEY=[your_key_here]

Now simply run the python file and observe the traces in Phoenix.

python your_file.py

More Info

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file openinference_instrumentation_mistralai-2.0.6.tar.gz.

File metadata

File hashes

Hashes for openinference_instrumentation_mistralai-2.0.6.tar.gz
Algorithm Hash digest
SHA256 352be13dda9ffc70e81fa94fe671e430f205bee07dc71d29e4fae9711267ba31
MD5 6b136ad0ff73ef722e4ed7c34376a0de
BLAKE2b-256 281c1b54427069cd07ee8db2eea16ff745ca8811759380d1d6c3e1417d098113

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_mistralai-2.0.6.tar.gz:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file openinference_instrumentation_mistralai-2.0.6-py3-none-any.whl.

File metadata

File hashes

Hashes for openinference_instrumentation_mistralai-2.0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 768d17e7927cd3c04c7958d22ce4c9832662285206258acf7a2cc8f7ad59c929
MD5 b3beb5dde8395ccfd77964f1cc5b196b
BLAKE2b-256 59787103a931c8c48d85695dba608293a1323f7d84e30cfdfd06f397c99d8387

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_mistralai-2.0.6-py3-none-any.whl:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page