Dataloader with concurrency improvements (from https://github.com/iarai/concurrent-dataloader)
Project description
PytorchConcurrentDataloader
Minimal version of the ConcurrentDataloader repository published to pip.
Setup
pip install pytorch-concurrent-dataloader
Usage
- replace
torch.utils.data.DataLoader
withpytorch_concurrent_dataloader.DataLoader
- pass new parameters for concurrent dataloading
from pytorch_concurrent_dataloader import DataLoader
dataloader = DataLoader(
# pass old parameters as usual
dataset=...,
batch_size=...,
num_workers=...,
# pass new parameters
num_fetch_workers=...,
)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for pytorch_concurrent_dataloader-0.0.7.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | cc243bfb096b33ff2e73ac27f693abc8b6842abdf711bd0d16af512cfe39d122 |
|
MD5 | 004e77cc6cea154a4d1783070369c4f5 |
|
BLAKE2b-256 | abd3b1d399bf6eb47e18a9d706e1b51a95d0bfa599cc1388c4598c1e6c6fd64c |
Close
Hashes for pytorch_concurrent_dataloader-0.0.7-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6088bec0c8eb93424850f55bd2d64f045649861e4fe551c5ad3def04dea44724 |
|
MD5 | da3cb87fe3407e5adc1c0529b9b657c4 |
|
BLAKE2b-256 | 667c2ea8f970189005f4c5675db3369749708b966df3ab989467e4d2985bbabf |