A module for balanced loading of large language models
Project description
niuload
niuload is a Python module for balanced loading of large language models across multiple GPUs. This package can be used during training and inference.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
niuload-0.1.5.tar.gz
(4.7 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file niuload-0.1.5.tar.gz.
File metadata
- Download URL: niuload-0.1.5.tar.gz
- Upload date:
- Size: 4.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
eb0134a8a34fcf84fcef878f76f21566e1e8ac1bbf0cd3758d31bb101c2b6245
|
|
| MD5 |
341578626fb6101cbb8794e2a3b10f91
|
|
| BLAKE2b-256 |
d4be0022beebb8703b9e377a509d7a1578eb3d10dc94e54ec222cae6bbee3268
|
File details
Details for the file niuload-0.1.5-py3-none-any.whl.
File metadata
- Download URL: niuload-0.1.5-py3-none-any.whl
- Upload date:
- Size: 4.9 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
695a3db6cbe80816def7e39ac7d3fbde32d4a12702929c724d96e78c1b3c40cf
|
|
| MD5 |
cd079eff89f661fa5b754140d10da72a
|
|
| BLAKE2b-256 |
55cd5043eae8f8ff76fc0af1816825e48004ef95dc025491e800e34e4ce0aa5d
|
