Experiment collection
Project description
Experiment collection
A set of utilities for storing and organizing experiments
Install
pip install experiment-collection
You can find another versions at releases or pypi.
Usage_example
Experiment
- structure with experiment data;
ExperimentCollectionLocal
- local experiment storage;
ExperimentCollectionRemote
- remote experiment storage;
could combine data from multiply sources.
from experiment_collection.experiments import Experiment, ExperimentCollectionLocal, ExperimentCollectionRemote
exps1 = ExperimentCollectionLocal('exp_test.db')
exps2 = ExperimentCollectionRemote('http://127.0.0.1/', 'exp_test')
for i in range(10):
exp = Experiment('name_{}'.format(i))
exp.set_metrics({'lr': 0.1})
exp.set_params({'auc': 0.5})
exps1.add_experiment(exp)
exps2.add_experiment(exp)
assert exps1.check_experiment(exp)
assert exps2.check_experiment(exp)
# Delete latest experiment
exps1.delete_experiment(exp)
exps2.delete_experiment(exp)
assert not exps1.check_experiment(exp)
assert not exps2.check_experiment(exp)
View all results. All metrics and params auto flatten into single columns.
exps1.get_experiments()
name time params_auc metrics_lr
0 name_0 2020-09-30 23:56:39.932871 0.5 0.1
1 name_1 2020-09-30 23:56:40.216424 0.5 0.1
2 name_2 2020-09-30 23:56:40.620029 0.5 0.1
3 name_3 2020-09-30 23:56:40.916781 0.5 0.1
4 name_4 2020-09-30 23:56:41.240535 0.5 0.1
5 name_5 2020-09-30 23:56:41.567865 0.5 0.1
6 name_6 2020-09-30 23:56:41.861890 0.5 0.1
7 name_7 2020-09-30 23:56:42.177155 0.5 0.1
8 name_8 2020-09-30 23:56:42.507883 0.5 0.1
9 name_9 2020-09-30 23:56:42.818714 0.5 0.1
License
MIT License
Copyright (c) 2020 AsciiShell (Aleksey Podchezertsev)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for experiment_collection-0.2.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 172af3f740025b944db6419e8b683bb9a5b788ac8610b0f1950d41a2257e0ab6 |
|
MD5 | 9e14b897d1ccd99e79d117b8f7002e63 |
|
BLAKE2b-256 | 0aa1e8e638a9dafe546f48f0ab3e870cef72c190fb8b660197a2b5aa029150d9 |
Close
Hashes for experiment_collection-0.2.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7995972e1cea5f98eba75e51f080fd9ad9975515276ef0c1133c5fac65e8cf36 |
|
MD5 | 09b1cfdcec08c94ae8329a13fb47e018 |
|
BLAKE2b-256 | d87f8573382d7bbc2d6a988cc86854378e09f1aaad525ccedcdce24cd75e0e85 |