model-diagnostics
| CI/CD | |
| Docs | |
| Package | |
| Meta |
Tools for diagnostics and assessment of (machine learning) models
Highlights:
- All common point predictions covered: mean, median, quantiles, expectiles.
- Assess model calibration with identification functions (generalized residuals), compute_bias and compute_marginal.
- Assess calibration and bias graphically
- reliability diagrams for auto-calibration
- bias plots for conditional calibration
- marginal plots for average
y_obs,y_predand partial dependence for one feature
- Assess the predictive performance of models
- strictly consistent, homogeneous scoring functions
- score decomposition into miscalibration, discrimination and uncertainty
- Choose your plot backend, either matplotlib or plotly, e.g., via set_config.
:rocket: To our knowledge, this is the first python package to offer reliability diagrams for quantiles and expectiles and a score decomposition, both made available by an internal implementation of isotonic quantile/expectile regression. :rocket:
Read more in the documentation.
This package relies on the giant shoulders of, among others, polars, matplotlib, scipy and scikit-learn.
Installation
pip install model-diagnostics
Contributions
Contributions are warmly welcome! When contributing, you agree that your contributions will be subject to the MIT License.
Release files for model-diagnostics 1.5.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| model_diagnostics-1.5.0.tar.gz | 3.2 MB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| model_diagnostics-1.5.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 3.3 MB
Release files / model_diagnostics-1.5.0.tar.gz
| Download URL | model_diagnostics-1.5.0.tar.gz |
|---|---|
| Size | 3.2 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
9375b8864f0d4d10eb5f6f7c8533b34b10d4f517eea02326f03a5253e2be55dc
|
|
BLAKE2b-256 checksum How to use checksums |
e80ce0ccbd324d78ed601f8fcf5258899a0a9407824ccaa5f359eb8aa84754f5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
Hatch/1.16.5 cpython/3.14.4 HTTPX/0.28.1
|
Release files / model_diagnostics-1.5.0-py3-none-any.whl
| Download URL | model_diagnostics-1.5.0-py3-none-any.whl |
|---|---|
| Size | 101.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
155042d758fd0a0ca70198f65fe608389183f778ac4fd595738d3fb2a9ee364b
|
|
BLAKE2b-256 checksum How to use checksums |
ff68087d2d7b2ef1991bcfda31659a514d6f6a61d1fe0878a400cb4e003e61e3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
Hatch/1.16.5 cpython/3.14.4 HTTPX/0.28.1
|