A module for balanced loading of large language models
Project description
niuload
niuload is a Python module for balanced loading of large language models across multiple GPUs. This package can be used during training and inference.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
niuload-0.1.4.tar.gz
(4.6 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file niuload-0.1.4.tar.gz.
File metadata
- Download URL: niuload-0.1.4.tar.gz
- Upload date:
- Size: 4.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
700567da6f80a3bd2e24f6fcfdd3022625f2d5dd65c9bca9304057b91cd28691
|
|
| MD5 |
c0a8a6f6db3d230432da1497a12a6220
|
|
| BLAKE2b-256 |
eb67c308f95a6b166902c55531326d4e6a0cd7c9c09ead9e7cde58655c68925d
|
File details
Details for the file niuload-0.1.4-py3-none-any.whl.
File metadata
- Download URL: niuload-0.1.4-py3-none-any.whl
- Upload date:
- Size: 4.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.1.1 CPython/3.12.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8ef9ab438dc01b7e15290f8192e69943e0bb267e8ce3732b4fc3d69700a4ad7a
|
|
| MD5 |
c781c98683cd1e0a763f8311d537ccc8
|
|
| BLAKE2b-256 |
33ac01fbfdbd412304c21f95b02da451a9a6621beb485b3875ef9abb97301677
|
