Skip to main content

Automated failure pattern detection and root-cause analysis for ML workflows

Project description

failprint

failprint is an MLOps-first diagnostic tool that performs automatic root cause analysis on your ML model's failure patterns.

It segments, clusters, and correlates failed predictions with input data features — surfacing which features are contributing to failure, which data segments fail the most, and how drift or imbalance may be related to model degradation.

Installation

pip install etsi-failprint

Quick Start

import pandas as pd
from etsi.failprint import analyze

# Sample inputs
X = pd.DataFrame({
    "feature1": [1, 2, 2, 3, 3, 3, 4],
    "feature2": [10, 15, 14, 13, 12, 13, 20],
    "category": ["A", "B", "B", "B", "C", "C", "A"]
})
y_true = pd.Series([1, 1, 1, 0, 0, 1, 0])
y_pred = pd.Series([1, 1, 0, 0, 0, 1, 1])

# Analyze misclassifications
report = analyze(X, y_true, y_pred, output="markdown", cluster=True)
print(report)

What It Does

  • Segments failures by input feature values (numerical/categorical)
  • Highlights overrepresented values in failure cases
  • Clusters similar failure samples for pattern recognition
  • Writes log files and markdown reports for audit or CI/CD
  • Compatible with MLOps tools (like MLflow, DVC, Airflow, Watchdog)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

etsi_failprint-0.1.1.tar.gz (5.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

etsi_failprint-0.1.1-py3-none-any.whl (6.1 kB view details)

Uploaded Python 3

File details

Details for the file etsi_failprint-0.1.1.tar.gz.

File metadata

  • Download URL: etsi_failprint-0.1.1.tar.gz
  • Upload date:
  • Size: 5.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.4

File hashes

Hashes for etsi_failprint-0.1.1.tar.gz
Algorithm Hash digest
SHA256 bf5cde45a169bcd4ef9809df61e6f92ffa37a4314c12c14983b946d5fe083473
MD5 4d607fab47aaf4aadaa5490c03a6298f
BLAKE2b-256 6fa6c4899caacc80859b04609dffc5ac7de8caedba163054d7e09405bec77a30

See more details on using hashes here.

File details

Details for the file etsi_failprint-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: etsi_failprint-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 6.1 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.4

File hashes

Hashes for etsi_failprint-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 1da4ca48552f598c488680261eb2ad4cb3dfc698cf6aaff7698a9b08976b2da9
MD5 377d40627b26f4996da43ad27b28b327
BLAKE2b-256 085b1c0a6a1d6feff05572b501df2e55651500e6e62ee347b45ed37c642d05b6

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page