A PyTorch implementation of BitNet, a network utilizing bit quantization for linear layers.
Project description
BitNet-b158
noteで実装を進めているBitLinear, BitLinearb158のコードとなります。
BitNet&BitNet b158の実装
pip install mybitnetでインストール可能です。example/01_bit_llama_pretraining.ipynbファイルには、bitlinearを用いた事前学習の例があります。
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mybitnet-0.6.0.tar.gz
(9.7 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
mybitnet-0.6.0-py3-none-any.whl
(11.1 kB
view details)
File details
Details for the file mybitnet-0.6.0.tar.gz.
File metadata
- Download URL: mybitnet-0.6.0.tar.gz
- Upload date:
- Size: 9.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.7.1 CPython/3.11.0 Darwin/22.3.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0d7626fde91842a4e8015398b7e47f786c06c5b4f4ae18e87fc136ec371a3a99
|
|
| MD5 |
8d77712a4b93460c0e1cea65a9e975f3
|
|
| BLAKE2b-256 |
44de4e2fc26b6d4d4861a1f453a90045e4feba552842c5fb0b31ad59244eaab4
|
File details
Details for the file mybitnet-0.6.0-py3-none-any.whl.
File metadata
- Download URL: mybitnet-0.6.0-py3-none-any.whl
- Upload date:
- Size: 11.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.7.1 CPython/3.11.0 Darwin/22.3.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
37b549d83e78e4a576710c139053c9d0037d2e19dfe620a7b3a99e3210e19a13
|
|
| MD5 |
5fb21e96233bf667eeb5426870ce9fd9
|
|
| BLAKE2b-256 |
c505db9d728ae2f420c91d7fcc5c4cfc14405d68b79f65160d5d447061e5b3bb
|
