Skip to main content

OpenInference Mistral AI Instrumentation

PyPI Version

Python autoinstrumentation library for MistralAI's Python SDK.

The traces emitted by this instrumentation are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize Phoenix or Arize AX.

Compatibility

openinference-instrumentation-mistralai mistralai
<2.0.0 >=1.0.2, <2.0.0
>=2.0.0 >=2.0.0

Installation

pip install openinference-instrumentation-mistralai

Quickstart

In this example we will instrument a small program that uses the MistralAI chat completions API and observe the traces via arize-phoenix.

Install packages.

pip install openinference-instrumentation-mistralai mistralai arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

Start the phoenix server so that it is ready to collect traces. The Phoenix server runs entirely on your machine and does not send data over the internet.

python -m phoenix.server.main serve

In a python file, setup the MistralAIInstrumentor and configure the tracer to send traces to Phoenix.

from mistralai.client import MistralClient
from mistralai.models.chat_completion import ChatMessage
from openinference.instrumentation.mistralai import MistralAIInstrumentor
from opentelemetry import trace as trace_api
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import ConsoleSpanExporter, SimpleSpanProcessor

endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
# Optionally, you can also print the spans to the console.
tracer_provider.add_span_processor(SimpleSpanProcessor(ConsoleSpanExporter()))
trace_api.set_tracer_provider(tracer_provider)

MistralAIInstrumentor().instrument()


if __name__ == "__main__":
    client = MistralClient()
    response = client.chat(
        model="mistral-large-latest",
        messages=[
            ChatMessage(
                content="Who won the World Cup in 2018?",
                role="user",
            )
        ],
    )
    print(response.choices[0].message.content)

Since we are using MistralAI, we must set the MISTRAL_API_KEY environment variable to authenticate with the MistralAI API.

export MISTRAL_API_KEY=[your_key_here]

Now simply run the python file and observe the traces in Phoenix.

python your_file.py

More Info

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file openinference_instrumentation_mistralai-2.0.5.tar.gz.

File metadata

File hashes

Hashes for openinference_instrumentation_mistralai-2.0.5.tar.gz
Algorithm Hash digest
SHA256 d602f1032ae3b4660cd279880063c5ec1a3cf29c00b8348c49e56a43007c3c62
MD5 d968e9a0652ef26d0d093a065cd474c2
BLAKE2b-256 30dfcc96c071029d624aef1c84b564f1279e693e3cdabe45c6dfd129b978ce8a

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_mistralai-2.0.5.tar.gz:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file openinference_instrumentation_mistralai-2.0.5-py3-none-any.whl.

File metadata

File hashes

Hashes for openinference_instrumentation_mistralai-2.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 43792418e21e76387863058aead9b8b9c67aa51f6ca2622cf324532150b0b06a
MD5 4b775600861809b5fa410dbc9c6f69bc
BLAKE2b-256 5a5cc846833dd667507b4cd516a33dece3dc8890f7fde77fb4e5635477acb1b5

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_mistralai-2.0.5-py3-none-any.whl:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page