A PyTorch library for benchmarking deep metric learning. It's powerful.
Project description
Powerful Benchmarker
Documentation
Google Colab Examples
See the examples folder for notebooks that show a bit of this library's functionality.
A Metric Learning Reality Check
See supplementary material for the ECCV 2020 paper.
Benchmark results:
Benefits of this library
- Highly configurable:
- Yaml files for organized configuration
- A powerful command line syntax that allows you to merge, override, swap, apply, and delete config options.
- Customizable:
- Benchmark your own losses, miners, datasets etc. with a simple function call.
- Easy hyperparameter optimization:
- Append the ~BAYESIAN~ flag to the names of hyperparameters you want to optimize.
- Extensive logging:
- View experiment data in tensorboard, CSV and SQLite format.
- Reproducible:
- Config files are saved with each experiment and are easily reproduced.
- Trackable changes:
- Keep track of changes to an experiment's configuration.
Installation
pip install powerful-benchmarker
Citing the benchmark results
If you'd like to cite the benchmark results, please cite this paper:
@misc{musgrave2020metric,
title={A Metric Learning Reality Check},
author={Kevin Musgrave and Serge Belongie and Ser-Nam Lim},
year={2020},
eprint={2003.08505},
archivePrefix={arXiv},
primaryClass={cs.CV}
}
Citing the code
If you'd like to cite the powerful-benchmarker code, you can use this bibtex:
@misc{Musgrave2019,
author = {Musgrave, Kevin and Lim, Ser-Nam and Belongie, Serge},
title = {Powerful Benchmarker},
year = {2019},
publisher = {GitHub},
journal = {GitHub repository},
howpublished = {\url{https://github.com/KevinMusgrave/powerful-benchmarker}},
}
Acknowledgements
Thank you to Ser-Nam Lim at Facebook AI, and my research advisor, Professor Serge Belongie. This project began during my internship at Facebook AI where I received valuable feedback from Ser-Nam, and his team of computer vision and machine learning engineers and research scientists.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for powerful-benchmarker-0.9.33.dev0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | b4d6e737632f87d1853c1a3776701eacda9b0a37de44ad0364926b9bffc47431 |
|
MD5 | 76475a81670dc128f17f25b98e10b8cd |
|
BLAKE2b-256 | eb6a5209f71c3f474b088d89a1cb82c952aaf1b0f5d9b689df6b5c4c92994e14 |
Hashes for powerful_benchmarker-0.9.33.dev0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e0b34425b2fd76c8237ffd1d90325720e4709e3285047d09afd734b580856fa8 |
|
MD5 | ab0d4c9f328b11364228ab46077bae89 |
|
BLAKE2b-256 | d93a3d9f361a7ecb266e9842eeb611a2b8fc6977dffa46daa0900ed772bd9f5d |