gau-tensorflow 0.0.1

Tensorflow implementation of Gated Attention Unit

GAU - TensorFlow

Gated Attention Unit (TensorFlow implementation)

Originally from the paper Transformer Quality in Linear Time

REPO UNDER DEVELOPMENT

Citations

@article{Hua2022TransformerQI,

    title   = {Transformer Quality in Linear Time},

    author  = {Weizhe Hua and Zihang Dai and Hanxiao Liu and Quoc V. Le},

    journal = {ArXiv},

    year    = {2022},

    volume  = {abs/2202.10447}

}