A library of tools for easier evaluation of ML models.
Project description
# MLLytics
## Installation instructions `pip install MLLytics` or `python setup.py install`
## Update pypi instructions (for me) Creates the package `python setup.py sdist bdist_wheel` Upload package `twine upload --repository pypi *version_files*`
## Future ### Improvements and cleanup * Allow figure size and font sizes to be passed into plotting functions * Comment all functions and classes * Add type hinting to all functions and classes (https://mypy.readthedocs.io/en/latest/cheat_sheet_py3.html) * Example guides for each function in jupyter notebooks
### Cosmetic * Fix size of confusion matrix * Check works with matplotlib 3 * Tidy up legends and annotation text on plots * Joy plots * Brier score for calibration plot
### Big push * Cross Validation and plots (also repeated cross-validation) * Scoring functions * MultiClassMetrics class to inherit from ClassMetrics and share common functions * More output stats in overviews * Update reliability plot https://machinelearningmastery.com/calibrated-classification-model-in-scikit-learn/ * Tests * Switch from my metrics to sklearn metrics where it makes sense? aka `fpr, tpr, thresholds = roc_curve(y[test], probas_[:, 1])` and more general macro/micro average metrics from: https://scikit-learn.org/stable/modules/generated/sklearn.metrics.recall_score.html#sklearn.metrics.recall_score
## Contributing Authors * Scott Clay * David Sullivan
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Hashes for MLLytics-0.1.7-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a4b96e14c004116a9ea31bed0c3da9ed362ad390e7c7bbbbe9f2caf87ae90520 |
|
MD5 | 31d7892c5df7bd09f0596beac9920fc5 |
|
BLAKE2b-256 | 92d007facb258a82812f201491c4b80d46bf6c29c95c2eb838fd8231c075ade0 |