9 projects
backpack-for-pytorch
BackPACK: Packing more into backprop
singd
KFAC-like Structured Inverse-Free Natural Gradient Descent
curvlinops-for-pytorch
scipy Linear operators for curvature matrices in PyTorch
wandb-preempt
Code and tutorial on integrating wandb with slurm pre-emption
sirfshampoo
Structured inverse- and root-free Shampoo
unfoldNd
N-dimensional unfold (im2col) and fold (col2im) in PyTorch
einconv
Convolutions as tensor contractions (einsums) for PyTorch
vivit-for-pytorch
ViViT: Curvature access through the generalized Gauss-Newton\'s low-rank structure
cockpit-for-pytorch
A Practical Debugging Tool for Training Deep Neural Networks.