tf-lambda-resnet 0.1.4

LambdaResNet implementation in TensorFlow 2.2

LambdaResNet - TensorFlow

All credit goes to lucidrains for sharing the initial pytorch implementation. This repo takes majority of contents from his original repo here.

Implementation of λ-ResNet.

Yannic Kilcher's paper review

Install

$ pip install tf-lambda-resnet

Usage

LambdaResNet uses localized context as explained in the video.

import tensorflow as tf
from tf_lambda_resnet import LambdaResnet18

model = LambdaResnet18()
out = model(tf.ones([10, 224, 224, 3]))
print(out)

Credits

All the code is taken from the below resources. I have assembled them in a proper manner to make it work for TF2.2

• tfkeras.py by shinel94
• TensorFlow2.0 ResNet by calmisential

References

Thanks to PistonY for sharing a gist here - lambda_net.py

Citations

@inproceedings{
    anonymous2021lambdanetworks,
    title={LambdaNetworks: Modeling long-range Interactions without Attention},
    author={Anonymous},
    booktitle={Submitted to International Conference on Learning Representations},
    year={2021},
    url={https://openreview.net/forum?id=xTJEN-ggl1b},
    note={under review}
}