Powerful Benchmarker
Documentation
Google Colab Examples
See the examples folder for notebooks that show a bit of this library's functionality.
A Metric Learning Reality Check
See supplementary material for the ECCV 2020 paper.
Benchmark results:
Benefits of this library
- Highly configurable:
- Yaml files for organized configuration
- A powerful command line syntax that allows you to merge, override, swap, apply, and delete config options.
- Customizable:
- Benchmark your own losses, miners, datasets etc. with a simple function call.
- Easy hyperparameter optimization:
- Append the ~BAYESIAN~ flag to the names of hyperparameters you want to optimize.
- Extensive logging:
- View experiment data in tensorboard, CSV and SQLite format.
- Reproducible:
- Config files are saved with each experiment and are easily reproduced.
- Trackable changes:
- Keep track of changes to an experiment's configuration.
Installation
pip install powerful-benchmarker
Citing the benchmark results
If you'd like to cite the benchmark results, please cite this paper:
@misc{musgrave2020metric,
title={A Metric Learning Reality Check},
author={Kevin Musgrave and Serge Belongie and Ser-Nam Lim},
year={2020},
eprint={2003.08505},
archivePrefix={arXiv},
primaryClass={cs.CV}
}
Citing the code
If you'd like to cite the powerful-benchmarker code, you can use this bibtex:
@misc{Musgrave2019,
author = {Musgrave, Kevin and Lim, Ser-Nam and Belongie, Serge},
title = {Powerful Benchmarker},
year = {2019},
publisher = {GitHub},
journal = {GitHub repository},
howpublished = {\url{https://github.com/KevinMusgrave/powerful-benchmarker}},
}
Acknowledgements
Thank you to Ser-Nam Lim at Facebook AI, and my research advisor, Professor Serge Belongie. This project began during my internship at Facebook AI where I received valuable feedback from Ser-Nam, and his team of computer vision and machine learning engineers and research scientists.
1 maintainer
Metadata
1 maintainer
Release files for powerful-benchmarker 0.9.33
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| powerful-benchmarker-0.9.33.tar.gz | 37.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| powerful_benchmarker-0.9.33-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 101.2 kB
Release files / powerful-benchmarker-0.9.33.tar.gz
| Download URL | powerful-benchmarker-0.9.33.tar.gz |
|---|---|
| Size | 37.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
de41a435a140d71cb938518958d906b68a450a60a36682f5e174048c08a9c080
|
|
BLAKE2b-256 checksum How to use checksums |
74cfe4e1a6d31367f71b91e642264c4b3c1609e01eb83461e7f70eb0d2082022
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/49.2.0.post20200714 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.7
|
Release files / powerful_benchmarker-0.9.33-py3-none-any.whl
| Download URL | powerful_benchmarker-0.9.33-py3-none-any.whl |
|---|---|
| Size | 63.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
8ec67e423a8c2c4cfcbc14e9ffd41b6cab4adfd892b85c4edc86e550a951e33c
|
|
BLAKE2b-256 checksum How to use checksums |
bce64c395dddae84980855215a411838282a3fb28e4aeb465bb98a8dd10c1433
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.2.0 pkginfo/1.5.0.1 requests/2.24.0 setuptools/49.2.0.post20200714 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.7.7
|
