Replication of "Recurrent models of visual attention", Mnih et al. 2014
Project description
Recurrent Models of Visual Attention
Replication in Tensorflow of the following paper:
Mnih, Volodymyr, Nicolas Heess, and Alex Graves.
"Recurrent models of visual attention."
Advances in neural information processing systems. 2014.
https://papers.nips.cc/paper/5542-recurrent-models-of-visual-attention
Based in part on the following implementations:
- https://github.com/torch/rnn/blob/master/examples/recurrent-visual-attention.lua
- https://github.com/seann999/tensorflow_mnist_ram
- https://github.com/kevinzakka/recurrent-visual-attention
installation
$ pip install thrillington
(thrillington
because there is already a ram
on PyPI,
and because https://en.wikipedia.org/wiki/Thrillington)
usage
The library can be run from the command line with a config file.
$ ram train ./RAM_config-2018-10-21.ini
...
0%| | 0/10000 [00:00<?, ?it/s]
config.train.resume is False,
will save new model and optimizer to checkpoint: /home/you/data/ram_output/results_20181021/checkpoints/ckpt
Epoch: 1/200 - learning rate: 0.001000
282.5s - hybrid loss: 1.690 - acc: 6.000: 100%|██████████| 10000/10000 [04:42<00:00, 35.65it/s]
0%| | 0/10000 [00:00<?, ?it/s]
mean accuracy: 9.97
mean losses: LossTuple(loss_reinforce=-1.1296023, loss_baseline=0.09972435, loss_action=2.3005059, loss_hybrid=1.2706277)
Epoch: 2/200 - learning rate: 0.001000
282.8s - hybrid loss: 1.223 - acc: 10.000: 100%|██████████| 10000/10000 [04:42<00:00, 35.50it/s]
0%| | 0/10000 [00:00<?, ?it/s]
...
For a detailed explanation of the config file format, please see here
CHANGELOG
To see past changes and work in progress, please check out the CHANGELOG.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for thrillington-0.0.2a1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f9dd417d9df70a324b96e7d77b5c70248df0624496c7ea7637d4f34c65dc0fe9 |
|
MD5 | 34a99948292e25a7d9efc8464e7e8d87 |
|
BLAKE2b-256 | d18f9c5e0fab0a7ce3b869777d7dcdade4bb6280389d6339a0dfd4b8440e2a1a |