Skip to main content

RAdam-Tensorflow

On the Variance of the Adaptive Learning Rate and Beyond

Paper | Official Pytorch code

Usage

from RAdam import RAdamOptimizer

train_op = RAdamOptimizer(learning_rate=0.001, beta1=0.9, beta2=0.999, weight_decay=0.0).minimize(loss)

Algorithm

Result

result

Author

Junho Kim

Metadata

Release files for tf-1.x-rectified-adam 0.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Built distribution (wheel)

Table of built distributions (wheels) for tf-1.x-rectified-adam 0.0.2
File Interpreter ABI Platform
tf_1.x_rectified_adam-0.0.2-py3-none-any.whl Python 3 none any Details

Release files / tf_1.x_rectified_adam-0.0.2-py3-none-any.whl

Download URL tf_1.x_rectified_adam-0.0.2-py3-none-any.whl
Size 4.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
0541a62722ee99ae62044fcfcd685602c8e2d2dee4419dbcf20b85404cf8ed9d
BLAKE2b-256 checksum
How to use checksums
036ee0485e1a6c93bee9105c7dec62ee484dfdd7b1b5e879ca04a2362281d3e9
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.2.0 pkginfo/1.6.1 requests/2.24.0 setuptools/50.3.2 requests-toolbelt/0.9.1 tqdm/4.51.0 CPython/3.6.12

Release history Release notifications | RSS feed

This release

0.0.2 This release

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page