keras-lookahead 0.9.0

Lookahead mechanism for optimizers in Keras

Keras Lookahead

[中文|English]

Unofficial implementation of the lookahead mechanism for optimizers.

Install

pip install keras-lookahead

External Links

• tensorflow/addons:LookAhead

Usage

Arguments:

• optimizer: Original optimizer.
• sync_period: the k in the paper. The synchronization period.
• slow_step: the α in the paper. The step size of slow weights.

from keras_lookahead import Lookahead

optimizer = Lookahead('adam', sync_period=5, slow_step=0.5)

Custom optimizers can also be used:

from keras_radam import RAdam
from keras_lookahead import Lookahead

optimizer = Lookahead(RAdam())