eve-optimizer 0.0.3.6

The EVer Evolving Optimizer

EVE: The EVer Evolving Deep Learning Optimizer

EVE is a new optimizer library built on top of PyTorch that combines the best of multiple state-of-the-art optimizer algorithms into one flexible, infinitely customizable super-optimizer.

The goal of EVE is not to provide one final, static optimizer, but rather an interface to a PyTorch optimizer that will continue to implement the latest, well-tested methods from modern research.

At present, EVE implements (and combines) the following algorithms:

• Adam
• RAdam
• LARS
• LookAhead

We are currently working on adding in the following variants as well:

• LAMB
• DiffGrad
• AdaMod
• DeepMemory
• Marina