Skip to main content

Audita modelos de ML: contradições vs regras de negócio, comparação multi-modelo, drift de explicação e fairness — via SHAP

Project description

modelcheck

Valida modelos de ML contra regras de negócio, detecta drift de explicação e fairness — tudo via SHAP.

Por quê?

Seu modelo pode ter boa acurácia e ainda assim decidir pelo motivo errado.

Instalação

pip install -e .

Uso

from modelcheck.guard import ModelGuard
from modelcheck.report import summary

guard = ModelGuard(models, X, rules_path="rules.yaml",
                   sensitive_features=["idade"])
report = guard.run(X)
print(summary(report))

# monitorar drift depois:
report2 = guard.run(X_novo, baseline_snapshots=report["snapshots"])

Features

  • Contradições: modelo vs regras de negócio (raro no mercado)
  • Comparação multi-modelo: onde XGBoost e LogReg discordam
  • Drift de explicação: alerta se o "porquê" das previsões mudou
  • Fairness: features sensíveis pesando demais
  • RuleLearner: aprende regras dos dados automaticamente
from modelcheck.rules.rule_learner import RuleLearner
learner = RuleLearner()
learner.to_yaml(learner.learn(X, y), "rules.yaml")

Regras (rules.yaml)

rules:
  - feature: price
    expected_direction: negative
    description: "Preço alto reduz venda"

Testes

pytest tests/

Licença

MIT

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

modelguard_ml-0.5.0.tar.gz (23.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

modelguard_ml-0.5.0-py3-none-any.whl (23.6 kB view details)

Uploaded Python 3

File details

Details for the file modelguard_ml-0.5.0.tar.gz.

File metadata

  • Download URL: modelguard_ml-0.5.0.tar.gz
  • Upload date:
  • Size: 23.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.7

File hashes

Hashes for modelguard_ml-0.5.0.tar.gz
Algorithm Hash digest
SHA256 3497098598440fde1f919def84f0cb7280b6b1bade9928d22c77b8a578b88e81
MD5 ea44f3fee3f2f78f0adb7db47d6d3c6a
BLAKE2b-256 45a6d19d634bf7253f696deaefd26ecbcb61f85cb24cf0f1eede5329d06bbe6f

See more details on using hashes here.

File details

Details for the file modelguard_ml-0.5.0-py3-none-any.whl.

File metadata

  • Download URL: modelguard_ml-0.5.0-py3-none-any.whl
  • Upload date:
  • Size: 23.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.11.7

File hashes

Hashes for modelguard_ml-0.5.0-py3-none-any.whl
Algorithm Hash digest
SHA256 0f0c42a65b5b66e002971f65682253c96924c317e6a3d933f2c04335492f3902
MD5 d0b5c2443d56feed21789752013567fa
BLAKE2b-256 43fc8d530340ede3648e8d7918ee44734c101a5bb50b7fdd51510feced7d017f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page