MLOpus
A collection of MLOps tools for AI/ML/DS research and development.
Main features:
-
Agnostic experiment tracking and model registry:
- Compatible with any "MLflow-like" provider through plugins.
- Search entities in MongoDB Query Language with predicate push-down to the MLflow provider.
- Local cache for artifacts and entity metadata.
- Offline mode to work with local cache only.
- Support for nested tags/params/metrics and JSON-encoded tags/params for non-scalar types.
- Not dependent on env vars, global vars or a single global active run.
-
Artifact Schemas:
- Packaging framework for models and datasets.
- Can be used with or without MLflow and/or Kedro.
- Schemas can be registered by alias at the experiment, run, model or model version.
- Artifacts catalog for type-safe, configuration-based artifact loading/downloading in serving applications.
-
Extended Kedro support:
- Dynamic pipeline and hook evaluation with direct access to the Kedro config loader.
- Artifact Schemas can be used in the Kedro datasets catalog.
- Extend the Kedro CLI with project-specific options, callbacks and param modifiers.
- Artifacts hook to set up pipeline inputs and/or collect outputs (optionally schema-aware).
- Highly customizable MLflow tracker hook for storing any pipeline information in experiment runs.
Check the tutorials for a friendly walkthrough of (almost) everything you can do with MLOpus.
Have a look at the architecture guide for an overview of how these and other features work.
A minimal API reference is also available here.
Installation
Recommended software:
- Rclone CLI (required for artifact transfer from/to cloud storage)
Optional extras:
mlflow: Enables support for the default MLflow plugin, which handles communication with open-source MLflow servers.search: Enables searching entities with MongoDB query syntaxkedro: Enables Kedro tools (e.g.: hooks, datasets, CLI extensions, etc)
Using pip:
pip install mlopus[mlflow,kedro,search]
Using Poetry:
poetry add mlopus --extras "mlflow,kedro,search"
Using UV:
uv add mlopus --extra mlflow --extra kedro --extra search
Metadata
Release files for mlOpus 1.6.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| mlopus-1.6.3.tar.gz | 95.4 kB | Details |
Release files / mlopus-1.6.3.tar.gz
| Download URL | mlopus-1.6.3.tar.gz |
|---|---|
| Size | 95.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
53bec4e9072c0c5b618e9bae9df85f862ea3cb52795fc0bfe1ba3f26adcbcf03
|
|
BLAKE2b-256 checksum How to use checksums |
31c2ea0ebcef73d86f4e61dd4191209a37b16c829a45f85d8851f3cd0e02c612
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.10.20
|