Skip to main content

OpenInference Mistral AI Instrumentation

PyPI Version

Python autoinstrumentation library for MistralAI's Python SDK.

The traces emitted by this instrumentation are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize Phoenix or Arize AX.

Compatibility

openinference-instrumentation-mistralai mistralai
<2.0.0 >=1.0.2, <2.0.0
>=2.0.0 >=2.0.0

Installation

pip install openinference-instrumentation-mistralai

Quickstart

In this example we will instrument a small program that uses the MistralAI chat completions API and observe the traces via arize-phoenix.

Install packages.

pip install openinference-instrumentation-mistralai mistralai arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

Start the phoenix server so that it is ready to collect traces. The Phoenix server runs entirely on your machine and does not send data over the internet.

python -m phoenix.server.main serve

In a python file, setup the MistralAIInstrumentor and configure the tracer to send traces to Phoenix.

from mistralai.client import Mistral
from mistralai.models.chat_completion import ChatMessage
from openinference.instrumentation.mistralai import MistralAIInstrumentor
from opentelemetry import trace as trace_api
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import ConsoleSpanExporter, SimpleSpanProcessor

endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
# Optionally, you can also print the spans to the console.
tracer_provider.add_span_processor(SimpleSpanProcessor(ConsoleSpanExporter()))
trace_api.set_tracer_provider(tracer_provider)

MistralAIInstrumentor().instrument()


if __name__ == "__main__":
    client = Mistral()
    response = client.chat(
        model="mistral-large-latest",
        messages=[
            ChatMessage(
                content="Who won the World Cup in 2018?",
                role="user",
            )
        ],
    )
    print(response.choices[0].message.content)

Since we are using MistralAI, we must set the MISTRAL_API_KEY environment variable to authenticate with the MistralAI API.

export MISTRAL_API_KEY=[your_key_here]

Now simply run the python file and observe the traces in Phoenix.

python your_file.py

More Info

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file openinference_instrumentation_mistralai-2.1.6.tar.gz.

File metadata

File hashes

Hashes for openinference_instrumentation_mistralai-2.1.6.tar.gz
Algorithm Hash digest
SHA256 e34ed6188e2ecf4a3c8998bd2e4c27ed433fceff30c67ab76f077f377e34fb15
MD5 676e2c908b0ba7c38240d0be24533102
BLAKE2b-256 098f58ef818a321a18428653c66967374b6ee7101e285a5d4e0f56cc6afa0cbf

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_mistralai-2.1.6.tar.gz:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file openinference_instrumentation_mistralai-2.1.6-py3-none-any.whl.

File metadata

File hashes

Hashes for openinference_instrumentation_mistralai-2.1.6-py3-none-any.whl
Algorithm Hash digest
SHA256 a0580be5c226477c9bb54f5919a8dfe26a684a2d4b033ccd29bb6f9d5c81e656
MD5 902ed8634ac9fe72b372e3972bc9e98c
BLAKE2b-256 1b0efa52c5bbdaf6e507c2620484fe8fcb444116a79db09dbb023cc8442e2db5

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_mistralai-2.1.6-py3-none-any.whl:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

This release

2.1.6 This release

2 files

2.1.5

2 files

2.1.4

2 files

2.1.3

2 files

2.1.2

2 files

2.1.1

2 files

2.1.0

2 files

2.0.6

2 files

2.0.5

2 files

2.0.4

2 files

2.0.3

2 files

2.0.2

2 files

2.0.1

2 files

2.0.0

2 files

1.4.0

2 files

1.3.4

2 files

1.3.3

2 files

1.3.2

2 files

1.3.1

2 files

1.3.0

2 files

1.2.0

2 files

1.1.2

2 files

1.1.1

2 files

1.1.0

2 files

1.0.0

2 files

0.0.10

2 files

0.0.9

2 files

0.0.8

2 files

0.0.7

2 files

0.0.6

2 files

0.0.5

2 files

0.0.4

2 files

0.0.3

2 files

0.0.2

2 files

0.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page