Skip to main content

The NannyML library, monitoring model performance since 2020.

Project description

PyPI - License

WebsiteDocsCommunity Slack

Basic overview

NannyML helps you monitor your ML models in production by:

  • estimating performance in absence of ground truth
  • calculating realized performance metrics
  • detecting data drift on model inputs, model outputs and targets

Installing the latest stable release

pip install nannyml

Installing the latest development version

python -m pip install git+

Getting started

import nannyml as nml
import pandas as pd

# Load some data
reference_data, analysis_data, _ = nml.load_synthetic_sample()
data = pd.concat([reference_data, analysis_data])
metadata = nml.extract_metadata(reference_data)

# Estimate performance
estimator = nml.CBPE(metadata).fit(reference_data)
estimates = estimator.estimate(data)



Development setup

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

nannyml-0.3.2.tar.gz (5.7 MB view hashes)

Uploaded Source

Built Distribution

nannyml-0.3.2-py3-none-any.whl (5.8 MB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page