Extra activation functions for Trax
Project description
Trax Extra Activation Functions
Extra activation functions for Trax
pip install trax-extra-activation
How to use
You can use activation functions in the same way as that ones implemented in Trax.
from trax_extra_activation import TanhExp
model = tl.Serial(
tl.Embedding(vocab_size=8192, d_feature=256),
tl.Mean(axis=1),
tl.Dense(2),
TanhExp()
)
Activations
- HardShrink
HardShrink(lmbda: float = 0.5) -> PureLayer
- HardSwish
HardSwish() -> PureLayer
- LogSigmoid
LogSigmoid() -> PureLayer
- Relu6
Relu6() -> PureLayer
- Celu
Celu(a: float = 1.0) -> PureLayer
- Silu
Silu() -> PureLayer
- Mish
Mish() -> PureLayer
- SoftShrink
SoftShrink(lmbda: float = 0.5) -> PureLayer
- SoftSign
SoftSign() -> PureLayer
- TanhShrink
TanhShrink() -> PureLayer
- TanhExp
TanhExp() -> PureLayer
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for trax-extra-activation-0.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | cdf7d9a5a604431153bb2e2d4a36c600187a9b4bb0d08db85f533cf0e4f48eb5 |
|
MD5 | 6d50c2d2b7be1f0041c2024379749640 |
|
BLAKE2b-256 | f6bb4979c23817706806afc48601ea9c24a59f712492b2b78a7d793a056d8e7b |
Close
Hashes for trax_extra_activation-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e4183a992ee544c4a4189307e2a25a194861bf256696a0d7e2e56e86294ffa41 |
|
MD5 | 80c7c77c3dc152a0758e5924cec74a5a |
|
BLAKE2b-256 | d3f5b2e5a15f02e081b10c2402ef3ef4245ea2b3c7372237d275e49dc6f7ed59 |