Light-weight experiment tracker
Project description
🔬 ERM: Experiment Results Manager
Light-weight alternative to mlflow
experiment tracking that doesn't require kubernetes. Useful tool to compare metrics between training attempts in your model training workflow
✨ Features
- 📈 Track plots, metrics, & other data
- 👀 Side-by-side comparison
- 💾 Experiment registry
- ⛅️ Supports S3, GCS, Azure and others (via
fsspec
)
🚀 Examples & Demos
- Quick and easy: serialize_and_deserialize.ipynb
- Practical but more involved: compare_runs.ipynb
- Browse the registry: browse_registry.ipynb
✅ Get Started
Installation
pip install experiment-results-manager \
gcsfs \
s3fs
# install s3fs if you plan to store data in s3
# install gcsfs if you plan to store data in google cloud storage
Basic Usage
import experiment_results_manager as erm
# Create an experiment run
er = erm.ExperimentRun(
experiment_id="my_experiment",
variant_id="main"
)
# Log relevant data
er.log_param("objective", "rmse")
er.log_metric("rmse", "0.9")
er.log_figure(mpl_fig, "ROC Curve")
er.log_text("lorem ipsum...", "text")
# Display the report (if you are in a notebook)
html = erm.compare_runs(er)
display(HTML(html))
# Save to registry
saved_path = erm.save_run_to_registry(er, "s3://erm-registry")
Made with ❤️ in Berlin
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for experiment-results-manager-0.1.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2c56bc3bcd4a22742ddf59bad26fabb774f5e376e93c3bb4eb91218d742278f2 |
|
MD5 | 0b667546c4b7ad01a222b9347dd07308 |
|
BLAKE2b-256 | 26f535a3d238f177efbb61ba8ea86924c54dcf45db32e8ce675b1caac6ce8ed3 |
Close
Hashes for experiment_results_manager-0.1.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 70a4c573835fe291eecc85099af4ec5f60a963bcebda03aecc74b51bd1f7f2c9 |
|
MD5 | 146ede254226c700ffefb0250a4b9f0b |
|
BLAKE2b-256 | 9164a3b7fbbc491ab40be9177c30f8fb019afb48dd9715360d742e62f39d0fd9 |