A collection of DNN test input prioritizers,in particular neuron coverage and surprise adequacy.
Project description
DNN-TIP: Common Test Input Prioritizers Library
Implemented Approaches
- Surprise Adequacies
- Distance-based Surprise Adequacy (DSA)
- Likelihood-based Surprise Adequacy (LSA)
- MultiModal-Likelihood-based Surprise Adequacy (MLSA)
- Mahalanobis-based Surprise Adequacy (MDSA)
- abstract MultiModal Surprise Adequacy
- Surprise Coverage
- Neuron-Activation Coverage (NAC)
- K-Multisection Neuron Coverage (KMNC)
- Neuron Boundary Coverage (NBC)
- Strong Neuron Activation Coverage (SNAC)
- Top-k Neuron Coverage (TKNC)
- Utilities
- APFD calculation
- Coverage-Added and Coverage-Total Prioritization Methods (CAM and CTM)
If you are looking for the uncertainty metrics we also tested (including DeepGini), head over to the sister repository uncertainty-wizard.
If you want to reproduce our exact experiments, there's a reproduction package and docker stuff available at TODO LINK.
Installation
It's as easy as pip install dnn-tip
.
Documentation
Find the documentation at https://testingautomated-usi.github.io/dnn-tip/.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
dnn-tip-0.1.0.tar.gz
(14.1 kB
view hashes)
Built Distribution
dnn_tip-0.1.0-py3-none-any.whl
(15.0 kB
view hashes)