Skip to main content

OpenInference Mistral AI Instrumentation

PyPI Version

Python autoinstrumentation library for MistralAI's Python SDK.

The traces emitted by this instrumentation are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize Phoenix or Arize AX.

Compatibility

openinference-instrumentation-mistralai mistralai
<2.0.0 >=1.0.2, <2.0.0
>=2.0.0 >=2.0.0

Installation

pip install openinference-instrumentation-mistralai

Quickstart

In this example we will instrument a small program that uses the MistralAI chat completions API and observe the traces via arize-phoenix.

Install packages.

pip install openinference-instrumentation-mistralai mistralai arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

Start the phoenix server so that it is ready to collect traces. The Phoenix server runs entirely on your machine and does not send data over the internet.

python -m phoenix.server.main serve

In a python file, setup the MistralAIInstrumentor and configure the tracer to send traces to Phoenix.

from mistralai.client import Mistral
from mistralai.models.chat_completion import ChatMessage
from openinference.instrumentation.mistralai import MistralAIInstrumentor
from opentelemetry import trace as trace_api
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import ConsoleSpanExporter, SimpleSpanProcessor

endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))
# Optionally, you can also print the spans to the console.
tracer_provider.add_span_processor(SimpleSpanProcessor(ConsoleSpanExporter()))
trace_api.set_tracer_provider(tracer_provider)

MistralAIInstrumentor().instrument()


if __name__ == "__main__":
    client = Mistral()
    response = client.chat(
        model="mistral-large-latest",
        messages=[
            ChatMessage(
                content="Who won the World Cup in 2018?",
                role="user",
            )
        ],
    )
    print(response.choices[0].message.content)

Since we are using MistralAI, we must set the MISTRAL_API_KEY environment variable to authenticate with the MistralAI API.

export MISTRAL_API_KEY=[your_key_here]

Now simply run the python file and observe the traces in Phoenix.

python your_file.py

More Info

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

File details

Details for the file openinference_instrumentation_mistralai-2.1.1.tar.gz.

File metadata

File hashes

Hashes for openinference_instrumentation_mistralai-2.1.1.tar.gz
Algorithm Hash digest
SHA256 3b0f865fa321bd73ff642ba3694970cfc6aa4c1b737932f3505b32ded5a4d82d
MD5 e587b159bd24121558864b0c3c9a03cc
BLAKE2b-256 6144d12e7e965b96ed1d7f3d704a396b82266ee96ab853d008a365ccca73a968

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_mistralai-2.1.1.tar.gz:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file openinference_instrumentation_mistralai-2.1.1-py3-none-any.whl.

File metadata

File hashes

Hashes for openinference_instrumentation_mistralai-2.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 cacaae441f6a1e0886392b58fb4ae6d1471636b22dc2a4b18a316d68e05805d2
MD5 add85ae0aeda864f76533ae21e029ef7
BLAKE2b-256 4b3852896a56678e79a3083b14f0a7f738cdf14beabe51a203aa98c21f17f482

See more details on using hashes here.

Provenance

The following attestation bundles were made for openinference_instrumentation_mistralai-2.1.1-py3-none-any.whl:

Publisher: publish.yaml on Arize-ai/openinference

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

2.1.2

2 files

This release

2.1.1 This release

2 files

2.1.0

2 files

2.0.6

2 files

2.0.5

2 files

2.0.4

2 files

2.0.3

2 files

2.0.2

2 files

2.0.1

2 files

2.0.0

2 files

1.4.0

2 files

1.3.4

2 files

1.3.3

2 files

1.3.2

2 files

1.3.1

2 files

1.3.0

2 files

1.2.0

2 files

1.1.2

2 files

1.1.1

2 files

1.1.0

2 files

1.0.0

2 files

0.0.10

2 files

0.0.9

2 files

0.0.8

2 files

0.0.7

2 files

0.0.6

2 files

0.0.5

2 files

0.0.4

2 files

0.0.3

2 files

0.0.2

2 files

0.0.1

2 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page