mlflow

The Open Source AI Engineering Platform for Agents, LLMs & Models

MLflow is the largest open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data. With over 60 million monthly downloads, thousands of organizations rely on MLflow each day to ship AI to production with confidence.

MLflow's comprehensive feature set for agents and LLM applications includes production-grade observability, evaluation, prompt management, prompt optimization and an AI Gateway for managing costs and model access. Learn more at MLflow for LLMs and Agents.

Website · Try Demo · Docs · News · Events

Get Started in 3 Simple Steps

From zero to full-stack LLMOps in minutes. No complex setup or major code changes required. Get Started →

Fastest start — set up tracing with our CLI
uvx mlflow@latest agent setup
One command installs the MLflow skills and launches your coding agent of choice to add tracing to your app. Prefer to wire it up yourself? Follow the three steps below.

1. Start MLflow Server

uvx mlflow server

2. Enable Logging

import mlflow

mlflow.set_tracking_uri("http://localhost:5000")
mlflow.openai.autolog()

3. Run Your Code

from openai import OpenAI

client = OpenAI()
client.responses.create(
    model="gpt-5.4-mini",
    input="Hello!",
)

Explore traces and metrics in the MLflow UI at http://localhost:5000.

LLMs & Agents

MLflow provides everything you need to build, debug, evaluate, and deploy production-quality LLM applications and AI agents. Supports Python, TypeScript/JavaScript, Java and any other programming language. MLflow also natively integrates with OpenTelemetry and MCP.

Observability Capture complete traces of your LLM applications and agents for deep behavioral insights. Built on OpenTelemetry, supporting any LLM provider and agent framework. Monitor production quality, costs, and safety. Getting Started → Try Demo →	Evaluation Run systematic evaluations, track quality metrics over time, and catch regressions before they reach production. Choose from 50+ built-in metrics and LLM judges, or define your own. Getting Started → Try Demo →
Prompts & Optimization Version, test, and deploy prompts with full lineage tracking. Automatically optimize prompts with state-of-the-art algorithms to improve performance. Getting Started → Try Demo →	AI Gateway Unified API gateway for all LLM providers. Route requests, manage rate limits, handle fallbacks, and control costs through an OpenAI-compatible interface with built-in credential management, guardrails and traffic splitting for A/B testing. Getting Started →

Model Training

For machine learning and deep learning model development, MLflow provides a full suite of tools to manage the ML lifecycle:

Experiment Tracking — Track models, parameters, metrics, and evaluation results across experiments
Model Evaluation — Automated evaluation tools integrated with experiment tracking
Model Registry — Collaboratively manage the full lifecycle of ML models
Deployment — Deploy models to batch and real-time scoring on Docker, Kubernetes, Azure ML, AWS SageMaker, and more

Learn more at MLflow for Model Training.

Integrations

MLflow supports all agent frameworks, LLM providers, tools, and programming languages. We offer one-line automatic tracing for more than 60 frameworks. See the full integrations list.

OpenTelemetry

_{OpenTelemetry}

Agent Frameworks (Python)

_LangChain	_LangGraph	_{OpenAI Agent}	_DSPy	_PydanticAI	_{Google ADK}
_{Microsoft Agent}	_CrewAI	_LlamaIndex	_AutoGen	_Strands	_{LiveKit Agents}
_Agno	_{Bedrock AgentCore}	_Smolagents	_{Semantic Kernel}	_DeepAgent	_AG2
_Haystack	_Koog	_txtai	_Pipecat	_Watsonx

Agent Frameworks (TypeScript)

_LangChain

_LangGraph

_{Vercel AI SDK}

_Mastra

_VoltAgent

Agent Frameworks (Java)

_{Spring AI}

_{Quarkus LangChain4j}

Model Providers

_OpenAI	_Anthropic	_Databricks	_Gemini	_{Amazon Bedrock}	_LiteLLM
_Mistral	_{xAI / Grok}	_Ollama	_Groq	_DeepSeek	_Qwen
_{Moonshot AI}	_Cohere	_BytePlus	_{Novita AI}	_FireworksAI	_{Together AI}

Gateways

_Databricks	_{LiteLLM Proxy}	_{Vercel AI Gateway}	_OpenRouter	_Portkey
_Helicone	_{Kong AI Gateway}	_{PydanticAI Gateway}	_TrueFoundry

Tools & No-Code

_Instructor	_{Claude Code}	_Opencode	_Langfuse	_{Arize / Phoenix}	_Goose
_Langflow

Hosting MLflow

MLflow can be used in a variety of environments, including your local environment, on-premises clusters, cloud platforms, and managed services. Being an open-source platform, MLflow is vendor-neutral — whether you're building AI agents, LLM applications, or ML models, you have access to MLflow's core capabilities.

_Databricks

_{Amazon SageMaker}

_{Azure ML}

_Nebius

_{Red Hat OpenShift AI}

_Self-Hosted

💭 Support

For help or questions about MLflow usage (e.g. "how do I do X?") visit the documentation.
In the documentation, you can ask the question to our AI-powered chat bot. Click on the "Ask AI" button at the right bottom.
Join the virtual events like office hours and meetups.
To report a bug, file a documentation issue, or submit a feature request, please open a GitHub issue.
For release announcements and other discussions, please subscribe to our mailing list (mlflow-users@googlegroups.com) or join us on Slack.

🤝 Contributing

We happily welcome contributions to MLflow!

Submit bug reports and feature requests
Contribute for good-first-issues and help-wanted
Writing about MLflow and sharing your experience

Please see our contribution guide to learn more about contributing to MLflow.

⭐️ Star History

✏️ Citation

If you use MLflow in your research, please cite it using the "Cite this repository" button at the top of the GitHub repository page, which will provide you with citation formats including APA and BibTeX.

👥 Core Members

MLflow is currently maintained by the following core members with significant contributions from hundreds of exceptionally talented community members.

Release files for mlflow 3.16.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for mlflow 3.16.1
File	Size	Uploaded
mlflow-3.16.1.tar.gz	10.8 MB	Sep 16, 2026	Details

Built distribution (wheel)

Table of built distributions (wheels) for mlflow 3.16.1
File	Interpreter	ABI	Platform	Reset
mlflow-3.16.1-py3-none-any.whl 11.7 MB Sep 16, 2026	Python 3	none	any	Details

Total release size: 22.5 MB

Release files / mlflow-3.16.1.tar.gz

Download URL	mlflow-3.16.1.tar.gz
Size	10.8 MB
Tags	Source
SHA-256 checksum How to use checksums	`044bd17d49ed216d3e38a537436622154daa5197ea41c1f3dedf155cbd8f40c0`
BLAKE2b-256 checksum How to use checksums	`6530a7105a50760f31aa5a6514e18d32e9087011c1bcb4ad56e0cfcc1e356f8c`
Upload date	Sep 16, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.1.0 CPython/3.13.14`

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/mlflow/releases
Publishing commit: github.com/mlflow/releases/tree/b47d1c0faf456cf8043a9e18ec8330a0022cb598

Workflow

Publishing configuration: github.com/mlflow/releases/blob/b47d1c0faf456cf8043a9e18ec8330a0022cb598/.github/workflows/python.yml
Publishing logs: github.com/mlflow/releases/actions/runs/35151029094/attempts/1

Artifact

Subject: mlflow-3.16.1.tar.gz
SHA-256 checksum: 044bd17d49ed216d3e38a537436622154daa5197ea41c1f3dedf155cbd8f40c0 Verifying attestations

Release files / mlflow-3.16.1-py3-none-any.whl

Download URL	mlflow-3.16.1-py3-none-any.whl
Size	11.7 MB
Tags	Python 3
SHA-256 checksum How to use checksums	`e4dfe69ceae31dfc7b8480e76ffe6a7f36752bdfac30e058e6430ade1fb5920b`
BLAKE2b-256 checksum How to use checksums	`2a375a0bffe04625c906be3c3482915ba0b9d824c48c53f8963cfdcfb9251547`
Upload date	Sep 16, 2026
Uploaded using Trusted Publishing? What is trusted publishing?	Yes
Uploaded via	`twine/6.1.0 CPython/3.13.14`

Provenance

Identity

Publishing platform: GitHub Actions
Publishing repository: github.com/mlflow/releases
Publishing commit: github.com/mlflow/releases/tree/b47d1c0faf456cf8043a9e18ec8330a0022cb598

Workflow

Publishing configuration: github.com/mlflow/releases/blob/b47d1c0faf456cf8043a9e18ec8330a0022cb598/.github/workflows/python.yml
Publishing logs: github.com/mlflow/releases/actions/runs/35151029094/attempts/1

Artifact

Subject: mlflow-3.16.1-py3-none-any.whl
SHA-256 checksum: e4dfe69ceae31dfc7b8480e76ffe6a7f36752bdfac30e058e6430ade1fb5920b Verifying attestations