Visualisation toolkit for neural networks in PyTorch
Visualisation toolkit implemented in PyTorch for inspecting what neural networks learn in image recognition tasks (feature visualisation).
The project is very much work in progress, and I would appreciate your feedback!
It currently supports visualisation of saliancy maps for all the models available under torchvision.models.
$ pip install flashtorch
Notebook: Image handling
- Notebook also available on Google Colab - probably the best way to play around quickly, as there is no need for setting up the environment!
Saliency in human visual perception is a subjective quality that makes certain things within the field of view stand out from the rest and grabs our attention.
Saliency maps in computer vision provide indications of the most salient regions within images. By creating a saliency map for neural networks, we can gain some intuition on "where the network is paying the most attention to" in an imput image.
Great gray owl (class index 24): The network is focusing on the sunken eyes and the round head for this owl.
Peacock (class index 84): But it doesn't always focus on the eyes and head of an animal. In its world's view, what makes peacok a peacok is the eyespots on its tail!
Toucan (class index 96): And in case of a toucan, the network is paying an intense attention on its beak.
Do you agree? :robot:
Insignts on transfer learning
In the example above, we've visualised saliency maps for a network that has been trained on ImageNet and used images of objects which it already knows.
We can take a step further and investigate how the network's perception changes before and after the training, when presented by a new object.
With no additional training, and just by swapping out the last fully-connected layer, the model performs very poorly (0.1% test accuracy). By plotting the gradients, we can see that the network is mainly focusing on the shape of the flower.
Foxgloves as an example:
With training, the model now achieves 98.7% test accuracy. But why? What is it that it's seeing now, that it wasn't before?
The network has learnt to shift its focus on the mottle patten within flower cups! In it's world's view, that is the most distinguishing things about this object, which I think closely align with what we deem the most unique trait of this flower.
Talks on FlashTorch
Papers on feature visualisation
Introduction and overview of feature visualisation: Feature Visualization
Latest development in feature visualisation: Exploring Neural Networks with Activation Atlases
Using backpropagation for gradient visualisation: Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Guided backprobagation: Striving for Simplicity: The All Convolutional Net
Release history Release notifications | RSS feed
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.