Bound propagation in Pytorch
Project description
Bound propagation
Linear and interval bound propagation in Pytorch with easy-to-use API, GPU support, and heavy parallization. Initially made as an alternative to the original CROWN implementation which featured only Numpy, lots of for-loops, and a cumbersome API.
To install:
pip install bound_propagation
Supported bound propagation methods:
For the examples below assume the following network definition:
from torch import nn
from bound_propagation import crown, crown_ibp, ibp
# The decorators _must_ be on a subclass of nn.Sequential
@crown
@crown_ibp
@ibp
class Network(nn.Sequential):
def __init__(self, *args):
if args:
# To support __get_index__ of nn.Sequential when slice indexing
# CROWN (and implicitly CROWN-IBP) is doing this underlying
super().__init__(*args)
else:
in_size = 30
classes = 10
super().__init__(
nn.Linear(in_size, 16),
nn.Tanh(),
nn.Linear(16, 16),
nn.Tanh(),
nn.Linear(16, classes)
)
net = Network()
Alternatively, you can add the functions to your network by calling the functions with an instance of your network:
from torch import nn
from bound_propagation import crown, crown_ibp, ibp
class Network(nn.Sequential):
def __init__(self, *args):
if args:
# To support __get_index__ of nn.Sequential when slice indexing
# CROWN (and implicitly CROWN-IBP) is doing this underlying
super().__init__(*args)
else:
in_size = 30
classes = 10
super().__init__(
nn.Linear(in_size, 16),
nn.Tanh(),
nn.Linear(16, 16),
nn.Tanh(),
nn.Linear(16, classes)
)
# The instance _must_ be an nn.Sequential or a subclass thereof
net = crown(crown_ibp(ibp(Network())))
The method also works with nn.Sigmoid
and nn.ReLU
.
Interval bounds
To get interval bounds for either IBP, CROWN, or CROWN-IBP:
x = rand(100, 30)
epsilon = 0.1
lower, upper = x - epsilon, x + epsilon
ibp_bounds = net.ibp(lower, upper)
crown_bounds = net.crown_interval(lower, upper)
crown_ibp_bounds = net.crown_ibp_interval(lower, upper)
Linear bounds
To get linear bounds for either CROWN or CROWN-IBP:
x = rand(100, 30)
epsilon = 0.1
lower, upper = x - epsilon, x + epsilon
crown_bounds = net.crown_linear(lower, upper)
crown_ibp_bounds = net.crown_ibp_linear(lower, upper)
Authors
- Frederik Baymler Mathiesen - PhD student @ TU Delft
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for bound_propagation-0.1.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0bbe133d8c49ba15f371b2ef3e01276ecbe4e082a9c941569c37df46ad05fa0b |
|
MD5 | 25a9df8a18d261910441f55fff1fc649 |
|
BLAKE2b-256 | 7102669f71b3d1cb93169fd9b882b5ecddce1872a8d931ed6f8fd1a5544df973 |