Skip to main content

riffdb-mlflow

riffdb-mlflow (0.2.1) is a compiled RiffDB tracking-store and model-registry plugin for MLflow 3.15.1 targeting RiffDB 0.2.1. It is an out-of-tree integration: no MLflow-specific code, vocabulary, routes, or schemas belong in the RiffDB repository.

Supported MLflow 3.15.1 Surface

The package registers the riffdb scheme in both official MLflow plugin groups:

  • mlflow.tracking_store → riffdb_mlflow.store:RiffDBTrackingStore
  • mlflow.model_registry_store → riffdb_mlflow.registry_store:RiffDBModelRegistryStore
MLflow 3.15.1 Domain Status Notes
Experiments & Runs (AbstractStore) Supported Atomic experiment/run creation with tags, lifecycle transitions, =, !=, LIKE, ILIKE, IS NULL, and IS NOT NULL experiment search (including MLflow 3.15 UI gateway-tag filters), bounded atomic log_batch (IEEE-754 metrics, parameters, tags), get_metric_history, log_inputs, log_outputs, and record_logged_model.
Traces & Out-of-Order Spans (TraceInfo, Span) Supported start_trace, get_trace_info, batch_get_traces, log_spans, log_spans_async, ingest_spans_out_of_order, search_traces, delete_traces, set_trace_tag, delete_trace_tag, link_traces_to_run, unlink_traces_from_run, and link_prompts_to_trace.
Assessments (Feedback, Expectation) Supported create_assessment, get_assessment, update_assessment, and delete_assessment.
Columnar Trace Metrics & Rollups (query_trace_metrics) Supported Contract-declared scalar columnar projections (TraceAnalytics, SpanAnalytics, AssessmentAnalytics) and event-driven rollups (SpanModelRollup) queried via source projected in RiffQL. Cold projections report ready on fresh RiffDB 0.2.1+ databases prior to first analytical query.
Logged Models (LoggedModel) Supported create_logged_model, get_logged_model, delete_logged_model, finalize_logged_model, set_logged_model_tags, delete_logged_model_tag, log_logged_model_params, and search_logged_models.
Model Registry (mlflow.model_registry_store) Supported All 21 abstract methods on mlflow.store.model_registry.AbstractStore: registered models, model versions, stages, aliases, tags, and download URIs. Works automatically when --registry-store-uri defaults to --backend-store-uri riffdb://<db>.
Prompt Registry (create_prompt, search_prompts, etc.) Supported All 16 concrete Prompt Registry methods on mlflow.store.model_registry.AbstractStore backed by RiffDBModelRegistryStore registered-model and model-version primitives.
Registry Webhooks (create_webhook, list_webhooks, etc.) Supported All 6 webhook lifecycle and event-filtering methods on RiffDBModelRegistryStore.
MCP Server Registry (MCPServerRegistryMixin) Supported Implemented on RiffDBTrackingStore (create_mcp_server, search_mcp_servers, versions, aliases, tags, and access endpoints), backing /ajax-api/3.0/mlflow/mcp-servers and the MLflow 3.15 MCP Registry UI.
UI-Managed AI Gateway (GatewayStoreMixin) Unsupported (Upstream SQL check) Upstream mlflow.server.gateway_api._validate_store rejects any non-SqlAlchemyStore tracking backend. Use the standalone config-based gateway via riffdb-mlflow[gateway] (mlflow gateway start --config-path ...).
Server-Side Job Runner (mlflow.server.jobs) Unsupported (Upstream SQL check) Upstream MLflow server job execution requires a SQLAlchemy database URI (postgresql://, sqlite://, etc.) and disables background server jobs (such as server-side judge/scorer runs) when started with riffdb://<db>.

Python Version Boundary & Optional Extras

  • Tracking Server / Direct riffdb:// Store Process (Python 3.13+): The compiled RiffDB driver wheel targets cp313-abi3, so any process that loads riffdb-mlflow directly (such as mlflow server or a client using MlflowClient(tracking_uri="riffdb://<db>")) must run Python 3.13 or newer.
  • HTTP Tracking Clients (Python 3.10–3.13): Standard MLflow training and serving workloads that connect to the tracking server over HTTP/HTTPS (MLFLOW_TRACKING_URI=http://...) do not install riffdb-mlflow and can run on any Python version supported by MLflow (3.10+).

Optional MLflow feature dependencies can be layered into the locked environment using package extras:

# Install with standalone AI Gateway, GenAI, extras, or AWS artifact support:
uv sync --extra gateway
# or via pip:
pip install "riffdb-mlflow[gateway,genai,extras,aws]"

Deploying the Application & Provisioning Credentials

Deploy the compiled application lock to a RiffDB 0.2.1+ server and provision the MLflowTrackingServer role. When running from a read-only checkout or installed package environment, pass --deployment-dir and --credential-output so deployment state and mode-0600 role credentials are written to an external path rather than .riffdb/deployments/ inside the working directory:

riffdb application deploy \
  --endpoint https://riffdb.internal:8443 \
  --database mlflow \
  --provision-role MLflowTrackingServer \
  --tls-trust-root /etc/riffdb/ca.pem \
  --tls-server-name riffdb.internal \
  --credential-file /etc/riffdb/bootstrap-admin.credential \
  --deployment-dir /var/lib/riffdb-mlflow/deployments \
  --credential-output /etc/riffdb-mlflow/tracking-server.credential

Connection Configuration (RIFFDB_MLFLOW_*)

The tracking and registry URI is riffdb://<database>. It never contains credentials or TLS parameters. All connection settings are read from environment variables and validated at store startup before opening a RiffDB transport:

Environment Variable Validation Rules
RIFFDB_MLFLOW_ENDPOINT Required. Must be https://<host>[:<port>] with an explicit host and no path, query, fragment, or userinfo.
RIFFDB_MLFLOW_SERVER_NAME Required. Must be a valid hostname or IP that exactly matches the host in RIFFDB_MLFLOW_ENDPOINT.
RIFFDB_MLFLOW_TRUST_ROOT Required. Must be an absolute path to an existing, readable regular PEM file containing -----BEGIN CERTIFICATE-----.
RIFFDB_MLFLOW_CREDENTIAL_FILE Required. Must be an absolute path to a non-empty regular file (not a symlink), owned by the current OS user, with permissions 0600 or 0400.

If any variable is missing or violates these rules, RiffDBTrackingStore and RiffDBModelRegistryStore immediately raise an MlflowException (INVALID_PARAMETER_VALUE) naming the exact setting and rule.

Running the MLflow Server & Clients

export RIFFDB_MLFLOW_ENDPOINT="https://riffdb.internal:8443"
export RIFFDB_MLFLOW_SERVER_NAME="riffdb.internal"
export RIFFDB_MLFLOW_TRUST_ROOT="/etc/riffdb/ca.pem"
export RIFFDB_MLFLOW_CREDENTIAL_FILE="/etc/riffdb-mlflow/tracking-server.credential"

mlflow server \
  --backend-store-uri riffdb://mlflow \
  --default-artifact-root s3://example/mlflow-artifacts

When using MlflowClient(tracking_uri="riffdb://mlflow") directly without specifying an artifact root, the store defaults the artifact root to _MLFLOW_SERVER_ARTIFACT_ROOT if set, or ./mlruns in the current working directory (matching MLflow's SQLite/FileStore fallback).

Artifact Storage & Backup Coordination

By design, riffdb-mlflow stores tracking, tracing, and registry metadata in RiffDB while artifact bytes (logged models, plots, files) remain in MLflow's configured artifact repository (s3://, gs://, abfss://, or local filesystem). Consistent disaster-recovery backups require coordinating RiffDB database backups with backups of the underlying artifact storage.

Development & Verification

uv sync --locked
make check
make conformance

RiffDB Compatibility CI

This adapter owns its RiffDB compatibility checks. Pull requests compile the application sources and verify existing locks and generated artifacts against the full commit in .github/riffdb-revision. To upgrade, update the pin, run riffdb application lock --write and riffdb generate, and verify with make check and make conformance.

Metadata

Release files for riffdb-mlflow 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for riffdb-mlflow 0.2.1
File Size Uploaded Provenance Actions
riffdb_mlflow-0.2.1.tar.gz 406.7 kB Without provenance Details for riffdb_mlflow-0.2.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for riffdb-mlflow 0.2.1
File Interpreter ABI Platform Actions
riffdb_mlflow-0.2.1-py3-none-any.whl Python 3 none any Details for riffdb_mlflow-0.2.1-py3-none-any.whl

Total release size: 522.4 kB

Release files / riffdb_mlflow-0.2.1.tar.gz

Download URL riffdb_mlflow-0.2.1.tar.gz
Size 406.7 kB
Tags Source
SHA-256 checksum
How to use checksums
85b62dcebf6adcd17b739806ed3a5055ffcd8206930984019a22f0fe2d54162d
BLAKE2b-256 checksum
How to use checksums
d9332909c0498cfbfb850ab317a82864ebb50bb7c156bc08796d46a037d7f486
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Release files / riffdb_mlflow-0.2.1-py3-none-any.whl

Download URL riffdb_mlflow-0.2.1-py3-none-any.whl
Size 115.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
dc0474bb3c6ea0ec4390b10dcbc7fc5d9c69edadffb9402fdd0d6097f5cf15b6
BLAKE2b-256 checksum
How to use checksums
5710c5bac9479a295b449a5fcefea94ca47efe751fed28937f908739399084c5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/7.0.0 CPython/3.12.3

Security for riffdb-mlflow 0.2.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page