Frame Averaging
Project description
Frame Averaging - Pytorch (wip)
Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network. This technique was recently adopted by Prescient Design in AbDiffuser
Install
$ pip install frame-averaging-pytorch
Usage
import torch
from frame_averaging_pytorch import FrameAverage
# contrived neural network
net = torch.nn.Linear(3, 3)
# wrap the network with FrameAverage
net = FrameAverage(
net,
dim = 3, # defaults to 3 for spatial, but can be any value
stochastic = True # whether to use stochastic variant from FAENet (one frame sampled at random)
)
# pass your input to the network as usual
points = torch.randn(4, 1024, 3)
mask = torch.ones(4, 1024).bool()
out = net(points, frame_average_mask = mask)
out.shape # (4, 1024, 3)
# frame averaging is automatically taken care of, as though the network were unwrapped
Citations
@article{Puny2021FrameAF,
title = {Frame Averaging for Invariant and Equivariant Network Design},
author = {Omri Puny and Matan Atzmon and Heli Ben-Hamu and Edward James Smith and Ishan Misra and Aditya Grover and Yaron Lipman},
journal = {ArXiv},
year = {2021},
volume = {abs/2110.03336},
url = {https://api.semanticscholar.org/CorpusID:238419638}
}
@article{Duval2023FAENetFA,
title = {FAENet: Frame Averaging Equivariant GNN for Materials Modeling},
author = {Alexandre Duval and Victor Schmidt and Alex Hernandez Garcia and Santiago Miret and Fragkiskos D. Malliaros and Yoshua Bengio and David Rolnick},
journal = {ArXiv},
year = {2023},
volume = {abs/2305.05577},
url = {https://api.semanticscholar.org/CorpusID:258564608}
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
frame_averaging_pytorch-0.0.11.tar.gz
(220.2 kB
view hashes)
Built Distribution
Close
Hashes for frame_averaging_pytorch-0.0.11.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 36ee07a91069b9a723de1fa090ec2f9fe96ba37b459a7ebe6d1e74a901f1e222 |
|
MD5 | 08b269b633e92415c24d3cd1ca870949 |
|
BLAKE2b-256 | 1a5ccea8ea99b808ebe0e00d0e076acaeefc0560d47322bb6d4ca67d72dd7249 |
Close
Hashes for frame_averaging_pytorch-0.0.11-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4aea796a2596f23a8f6769f5d6887ea6c758fb92c8dfd1d4a3f8c31d2980bdfe |
|
MD5 | 217e011d6e67065a6f610a22fb90feb2 |
|
BLAKE2b-256 | 411b1f9351af149ababce95bb1cb03b6952c38031d918f85342f5987ed8590f1 |