Skip to main content

Automated failure pattern detection and root-cause analysis for ML workflows

Project description

failprint

failprint is an MLOps-first diagnostic tool that performs automatic root cause analysis on your ML model's failure patterns.

It segments, clusters, and correlates failed predictions with input data features — surfacing which features are contributing to failure, which data segments fail the most, and how drift or imbalance may be related to model degradation.

Installation

pip install etsi-failprint

Quick Start

import pandas as pd
from etsi.failprint import analyze

# Sample inputs
X = pd.DataFrame({
    "feature1": [1, 2, 2, 3, 3, 3, 4],
    "feature2": [10, 15, 14, 13, 12, 13, 20],
    "category": ["A", "B", "B", "B", "C", "C", "A"]
})
y_true = pd.Series([1, 1, 1, 0, 0, 1, 0])
y_pred = pd.Series([1, 1, 0, 0, 0, 1, 1])

# Analyze misclassifications
report = analyze(X, y_true, y_pred, output="markdown", cluster=True)
print(report)

What It Does

  • Segments failures by input feature values (numerical/categorical)
  • Highlights overrepresented values in failure cases
  • Clusters similar failure samples for pattern recognition
  • Writes log files and markdown reports for audit or CI/CD
  • Compatible with MLOps tools (like MLflow, DVC, Airflow, Watchdog)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etsi_failprint-0.1.2.tar.gz (5.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etsi_failprint-0.1.2-py3-none-any.whl (6.2 kB view details)

Uploaded Python 3

File details

Details for the file etsi_failprint-0.1.2.tar.gz.

File metadata

  • Download URL: etsi_failprint-0.1.2.tar.gz
  • Upload date:
  • Size: 5.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.4

File hashes

Hashes for etsi_failprint-0.1.2.tar.gz
Algorithm Hash digest
SHA256 9e1200f148f955261809ee0e563f168ade21f65f8e85df271f90f042372ba7a7
MD5 c73fbd965d411c21feb006c626e94446
BLAKE2b-256 ae318d24d3e302c85792a6501e3cd749f7b6e294d8d0783542aa374fc24b4fb4

See more details on using hashes here.

File details

Details for the file etsi_failprint-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: etsi_failprint-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 6.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.4

File hashes

Hashes for etsi_failprint-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 575f3cb1a8606fecbf4b026569edba4fb056498eb5126e9c303d5a94d3964cfc
MD5 fdbcc1855428541cfbcf037d9de2376c
BLAKE2b-256 54d1adf7d6924d894138471a8c6f432bbbb3ab9d99def4409582a3fa073fe66d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page