bitnet - Pytorch
Project description
BitNet
Implementation of the "BitNet: Scaling 1-bit Transformers for Large Language Models"
BitLinear = tensor -> layernorm -> Binarize -> abs max quantization
Installation
License
MIT
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
bitnet-0.0.1.tar.gz
(2.9 kB
view hashes)
Built Distribution
bitnet-0.0.1-py3-none-any.whl
(2.9 kB
view hashes)