validation-suite 0.2.1

A unified framework for consistent validation across multiple projects and use cases.

MRMU Validation Suite

A unified framework for consistent validation across multiple projects and use cases.

• GitHub | PyPI | Documentation
• Created by Cristian C. Sarmiento | GitHub @ccsarmientot | PyPI @ccsarmientot
• MIT License

Features

• compare_dataframes — Benchmarking / Dry Run vs Model Owner
• vif_check — Test de multicolinealidad (supuestos de regresión)
• psi_check — Population Stability Index (estabilidad de inputs)
• csi_check — Characteristic Stability Index (estabilidad por segmento)
• backtesting_report — Discriminación, calibración y traffic light

Documentation

Documentation is built with Zensical and deployed to GitHub Pages.

• Live site: https://ccsarmientot.github.io/validation-suite/
• Preview locally: just docs-serve (serves at http://localhost:8000)
• Build: just docs-build

API documentation is auto-generated from docstrings using mkdocstrings.

Docs deploy automatically on push to main via GitHub Actions. To enable this, go to your repo's Settings > Pages and set the source to GitHub Actions.

Development

To set up for local development:

# Clone your fork
git clone [e-mail]:ccsarmientot/validation-suite.git
cd validation-suite

# Install in editable mode with live updates
uv tool install --editable .

This installs the CLI globally but with live updates - any changes you make to the source code are immediately available when you run validation_suite.

Run tests:

uv run pytest

Run quality checks (format, lint, type check, test):

just qa

Author

MRMU Validation Suite was created in 2026 by Cristian C. Sarmiento.

Built with Cookiecutter and the audreyfeldroy/cookiecutter-pypackage project template.