TorchShard is a lightweight engine for slicing a PyTorch tensor into parallel shards. It can reduce GPU memory and scale up the training when the model has massive linear layers (e.g., ViT, BERT and GPT) or huge classes (millions). It has the same API design as PyTorch.
1 maintainer
Metadata
1 maintainer
Release files for torchshard 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| torchshard-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Release files / torchshard-0.1.0-py3-none-any.whl
| Download URL | torchshard-0.1.0-py3-none-any.whl |
|---|---|
| Size | 21.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
9c2b7f82968f9a4cf61bd557e3230b209feb19581381076ccab09c20fa17e64d
|
|
BLAKE2b-256 checksum How to use checksums |
50ee24b7d33845184f389fa48f117c7dcde7d0c41da32b31eaaf24b41a234fe7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/4.0.0 pkginfo/1.4.2 requests/2.22.0 requests-toolbelt/0.9.1 tqdm/4.28.1 CPython/3.6.6
|
