A collection of PyTorch implementations of neural network architectures and layers.
Project description
LabML Neural Networks
This is a collection of simple PyTorch implementations of neural networks and related algorithms. These implementations are documented with explanations,
The website renders these as side-by-side formatted notes. We believe these would help you understand these algorithms better.
We are actively maintaining this repo and adding new implementations almost weekly. for updates.
Modules
✨ Transformers
Transformers module contains implementations for multi-headed attention and relative multi-headed attention.
- GPT Architecture
- kNN-LM: Generalization through Memorization
- Feedback Transformer
- Switch Transformer
✨ Recurrent Highway Networks
✨ LSTM
✨ HyperNetworks - HyperLSTM
✨ Capsule Networks
✨ Generative Adversarial Networks
✨ Sketch RNN
✨ Reinforcement Learning
- Proximal Policy Optimization with Generalized Advantage Estimation
- Deep Q Networks with with Dueling Network, Prioritized Replay and Double Q Network.
✨ Optimizers
Installation
pip install labml_nn
Citing LabML
If you use LabML for academic research, please cite the library using the following BibTeX entry.
@misc{labml,
author = {Varuna Jayasiri, Nipun Wijerathne},
title = {LabML: A library to organize machine learning experiments},
year = {2020},
url = {https://lab-ml.com/},
}
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for labml_nn-0.4.80-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5d86f17a87cab0c0b045cc0531597f73a9d6b99228e6f38b2f7b0c76d38c343e |
|
MD5 | af4a01022aadcf97803d4ad7eb8cbe50 |
|
BLAKE2b-256 | 59cb756d0d3daa0e4dd8f3ee3b4ed06d3d625d74f9bb46a347e2d247422dff4a |