TAdam optimizer for Pytorch
Project description
TAdam
The Pytorch implementation of TAdam algorithm in：'A decreasing scaling transition scheme from Adam to SGD' https://arxiv.org/abs/2106.06749
Usage
from tadam import TAdam
...
optimizer = TAdam(model.parameters(), iters=required, lr=1e-3, moment=1/4, up_lr=0.3, low_lr=0.01)
#iters(int, required): iterations
# iters = (testSampleSize / batchSize) * epoch
#
#moment(float, optional): transition moment
# moment = transition_iters / iters
#set default value: moment=1/4, up_lr=0.3, low_lr=0.01
The code will be uploaded as soon as possible
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tadam-0.0.1.tar.gz
(3.4 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
tadam-0.0.1-py3-none-any.whl
(7.9 kB
view details)
File details
Details for the file tadam-0.0.1.tar.gz.
File metadata
- Download URL: tadam-0.0.1.tar.gz
- Upload date:
- Size: 3.4 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.7.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
83cae59f3c0c69ac89430529417cf3206081619d492e3cbb95a86adeea7edcc2
|
|
| MD5 |
a7643ee77486d28d5c03a87370f756bf
|
|
| BLAKE2b-256 |
ed8efd386351c4e7e28826c95049313ad98e4ec1c86f5bd9e5004385bb6006a9
|
File details
Details for the file tadam-0.0.1-py3-none-any.whl.
File metadata
- Download URL: tadam-0.0.1-py3-none-any.whl
- Upload date:
- Size: 7.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.7.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
577aea3aa42a14a57234ea8d07de2ca21b6d178c46fcf3e2185603bb053f5753
|
|
| MD5 |
f13219f490f8e9d57263eaa1744d9c8d
|
|
| BLAKE2b-256 |
433efbe0e7a9048619b5dcf81bf11a85997a2bcc62659da6fc45377cddb3f0c3
|
