8 projects
heavyball
Implementations of various optimizers; mostly focussing on fast _foreach and PaLM versions
truegrad
PyTorch interface for TrueGrad-AdamW
jaxhelper
Basic tools and helpers for Jax
namedtreemap
jax.tree_map, but for all datatypes and with input names
sharedutils
Easy usage of Python's new SharedMemory for reduced memory and CPU cost
tpucare
Automatically take good care of your preemptible TPUs
revlib
Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
perftorch
Native High-Performance PyTorch modules
