Skip to main content

OpenInference Mistral AI Instrumentation

PyPI Version

Python autoinstrumentation library for MistralAI's Python SDK.

The traces emitted by this instrumentation are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize Phoenix or Arize AX.

Compatibility

openinference-instrumentation-mistralai mistralai
<2.0.0 >=1.0.2, <2.0.0
>=2.0.0 >=2.0.0

Installation

pip install openinference-instrumentation-mistralai

Quickstart

In this example we will instrument a small program that uses the MistralAI chat completions API and observe the traces via arize-phoenix.

Install packages.

pip install openinference-instrumentation-mistralai mistralai arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

Start the phoenix server so that it is ready to collect traces. The Phoenix server runs entirely on your machine and does not send data over the internet.

python -m phoenix.server.main serve

In a python file, setup the MistralAIInstrumentor and configure the tracer to send traces to Phoenix.

from mistralai.client import Mistral
from mistralai.models.chat_completion import ChatMessage
from openinference.instrumentation.mistralai import MistralAIInstrumentor
from opentelemetry import trace as trace_api
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import ConsoleSpanExporter, SimpleSpanProcessor

endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
# Optionally, you can also print the spans to the console.
tracer_provider.add_span_processor(SimpleSpanProcessor(ConsoleSpanExporter()))
trace_api.set_tracer_provider(tracer_provider)

MistralAIInstrumentor().instrument()


if __name__ == "__main__":
    client = Mistral()
    response = client.chat(
        model="mistral-large-latest",
        messages=[
            ChatMessage(
                content="Who won the World Cup in 2018?",
                role="user",
            )
        ],
    )
    print(response.choices[0].message.content)

Since we are using MistralAI, we must set the MISTRAL_API_KEY environment variable to authenticate with the MistralAI API.

export MISTRAL_API_KEY=[your_key_here]

Now simply run the python file and observe the traces in Phoenix.

python your_file.py

More Info

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file openinference_instrumentation_mistralai-2.1.0.tar.gz.

File metadata

File hashes

Hashes for openinference_instrumentation_mistralai-2.1.0.tar.gz
Algorithm Hash digest
SHA256 4f1f9d9f41602037b9c3b1bbc15cccd2550950beed985efe39c97559ff610f10
MD5 e7548fd4fe741fb3d4099ab66eee59f4
BLAKE2b-256 5cda48e6d3b36cf2d67b9417a7915fb74be7030cc568cfbd5080b04a83e3cd26

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_mistralai-2.1.0.tar.gz:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file openinference_instrumentation_mistralai-2.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for openinference_instrumentation_mistralai-2.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 2dbdb3ef78ea8d70be6c8e2259d18773b49f9ce7fdef335c6363384bcf83c31c
MD5 08908ac5268ee8080ebc07bd5875c78c
BLAKE2b-256 3d7ecd05bd7443ca1a92028110028c10461953507ba81dc12e826968bea26a1d

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_mistralai-2.1.0-py3-none-any.whl:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page