Skip to main content

A library for deep learning with spiking neural networks

Project description

Norse

A library to do deep learning with spiking neural networks.

Test Status

The purpose of this library is to exploit the advantages of bio-inspired neural components, who are sparse and event-driven - a fundamental difference from artificial neural networks. Norse expands PyTorch with primitives for bio-inspired neural components, bringing you two advantages: a modern and proven infrastructure based on PyTorch and deep learning-compatible spiking neural network components.

Documentation: https://norse.github.io/norse/build/html/index.html

Example usage: template tasks

Norse comes packed with a few example tasks, such as MNIST, but is generally meant for use in specific deep learning tasks (see below section on long short-term spiking neural networks):

python run_mnist.py

Getting Started

Norse is a machine learning library that builds on the PyTorch infrastructure. While we have a few tasks included, it is meant to be used in designing and evaluating experiments involving biologically realistic neural networks.

This readme explains how to install norse and apply it in your own experiments.

Installation

Note that this guide assumes you are on a terminal friendly environment with access to the pip, python and git commands. Python version 3.7+ is required.

Installing from PyPi

pip install norse

Installing from source

git clone https://github.com/norse/norse
cd norse
python setup.py install

The primary dependencies of this project are torch, tensorboard and OpenAI gym. A more comprehensive list of dependencies can be found in requirements.txt.

Running examples

The directory norse/task contains three example experiments, serving as short, self contained, correct examples (SSCCE). You can execute them by invoking the run_*.py scripts from the base directory.

  • To train an MNIST classification network, invoke
    python run_mnist.py
    
  • To train a CIFAR classification network, invoke
    python run_cifar.py
    
  • To train the cartpole balancing task with Policy gradient, invoke
    python run_gym.py
    

The default choices of hyperparameters are meant as reasonable starting points.

Example on using the library: Long short-term spiking neural networks

long short-term spiking neural networks from the paper by G. Bellec, D. Salaj, A. Subramoney, R. Legenstein, and W. Maass is one interesting way to apply norse:

from norse.torch.module import LSNNLayer, LSNNCell
# LSNNCell with 2 inputs and 10 outputs
layer = LSNNLayer(LSNNCell, 2, 10)
# 5 batch size running on CPU
state = layer.initial_state(5, "cpu") 
# Generate data of shape [5, 2, 10]
data  = torch.zeros(2, 5, 2)
# Tuple of output data and layer state
output, new_state = layer.forward(data, state) 

Similar work

A number of projects exist that attempts to leverage the strength of bio-inspired neural networks, however none of them are fully integrated with modern machine-learning libraries such as Torch or Tensorflow. Norse was created for two reasons: to 1) apply findings from decades of research in practical settings, and to 2) accelerate our own research within bio-inspired learning.

The below list of projects serves to illustrate the state of the art, while explaining our own incentives to create and use norse.

  • SNN toolbox
    • This toolbox `automates the conversion of pre-trained analog to spiking neural networks'. The tool is solely for already trained networks and omits the (possibly platform specific) training.
  • Neuron Simulation Toolkit (NEST)
    • NEST constructs and evaluates highly detailed simulations of spiking neural networks. This is useful in a medical/biological sense but maps poorly to large datasets and deep learning.
  • Nengo DL
    • Nengo is a neuron simulator, and Nengo-DL is a deep learning network simulator that optimised spike-based neural networks based on an approximation method suggested by Hunsberger and Eliasmith (2016). This approach maps to, but does not build on, the deep learning framework Tensorflow, which is fundamentally different from incorporating the spiking constructs into the framework itself.

Contributing

Please refer to the contributing.md

Credits

Norse is created by

License

LGPLv3. See LICENSE for license details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

norse-0.0.1.tar.gz (25.5 kB view details)

Uploaded Source

File details

Details for the file norse-0.0.1.tar.gz.

File metadata

  • Download URL: norse-0.0.1.tar.gz
  • Upload date:
  • Size: 25.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.2 CPython/3.7.3

File hashes

Hashes for norse-0.0.1.tar.gz
Algorithm Hash digest
SHA256 6f6837e84e75fd2e4648652d82e7b333b2c07c0b2866fb0d5234bde1b04187de
MD5 c6c3e8ec12c275080830347f5de68b53
BLAKE2b-256 3715ec15a34565f2059241d3fbaebbf90501aa269fafa132f9623629eb7bcf0c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page