A PyTorch Extension for Learning Rate Warmup
Project description
A PyTorch Extension for Learning Rate Warmup
This library contains PyTorch implementations of the warmup schedules described in On the adequacy of untuned warmup for adaptive optimization.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pytorch-warmup-0.0.3.tar.gz
(310.4 kB
view hashes)
Built Distribution
Close
Hashes for pytorch_warmup-0.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | d10c8704b1e2adf3efa84480cc15572b70b05117b2417d4a8897524c011f4d28 |
|
MD5 | 4873556236e2195b56a25d91ec16144d |
|
BLAKE2b-256 | 398a792ddf9bb209c71dc7ea753d3a2990d924a6c07eb2cc30de4cfacf8d3645 |