Variational Bayesian Last Layers (VBLL)
VBLL introduces a deterministic variational formulation for training Bayesian last layers in neural networks. This method offers a computationally efficient approach to improving uncertainty estimation in deep learning models. By leveraging this technique, VBLL can be trained and evaluated with quadratic complexity in last layer width, making it nearly computationally free to add to standard architectures. Our work focuses on enhancing predictive accuracy, calibration, and out-of-distribution detection over baselines in both regression and classification.
Installation
The easiest way to install VBLL is with pip:
pip install vbll
You can also install by cloning the GitHub repo:
# Clone the repository
git clone https://github.com/VectorInstitute/vbll.git
# Navigate into the repository directory
cd vbll
# Install required dependencies
pip install -e .
Usage and Tutorials
Documentation is available here.
You can also check out our tutorial colabs:
- Regression:
- Classification:
Contributing
Contributions to the VBLL project are welcome. If you're interested in contributing, please read the contribution guidelines in the repository.
Citation
If you find VBLL useful in your research, please consider citing our paper:
@inproceedings{harrison2024vbll,
title={Variational Bayesian Last Layers},
author={Harrison, James and Willes, John and Snoek, Jasper},
booktitle={International Conference on Learning Representations (ICLR)},
year={2024}
}
2 maintainers
Release files for vbll 0.4.9
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| vbll-0.4.9.tar.gz | 13.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| vbll-0.4.9-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 29.5 kB
Release files / vbll-0.4.9.tar.gz
| Download URL | vbll-0.4.9.tar.gz |
|---|---|
| Size | 13.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
ba6891c5576a6e39e12d7e050356e85670dc4460bb15e4a0f0c36262c2cdbd02
|
|
BLAKE2b-256 checksum How to use checksums |
b63ba9b38c085e87e984920843efd5f6f98fb410ded037b92154e23ad81e1593
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.8.2 CPython/3.9.17 Darwin/24.4.0
|
Release files / vbll-0.4.9-py3-none-any.whl
| Download URL | vbll-0.4.9-py3-none-any.whl |
|---|---|
| Size | 16.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
dc54d78233399f47beebad49a0b98be6e175a2e7aae6538faab442bd8028631c
|
|
BLAKE2b-256 checksum How to use checksums |
078304c1b447d0831e86f3aaa8fa4a35e0255b9e279188ce5e2452f1e131fba9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.8.2 CPython/3.9.17 Darwin/24.4.0
|
