Dataloader with concurrency improvements (from https://github.com/iarai/concurrent-dataloader)
Project description
PytorchConcurrentDataloader
Minimal version of the ConcurrentDataloader repository published to pip.
Setup
pip install pytorch-concurrent-dataloader
Usage
- replace
torch.utils.data.DataLoader
withpytorch_concurrent_dataloader.DataLoader
- pass new parameters for concurrent dataloading
from pytorch_concurrent_dataloader import DataLoader
dataloader = DataLoader(
# pass old parameters as usual
dataset=...,
batch_size=...,
num_workers=...,
# pass new parameters
num_fetch_workers=...,
)
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for pytorch_concurrent_dataloader-0.0.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 99d99493f99455f3e363e1a3c2f0f65caf96032592d61470be5a25f4998e77b4 |
|
MD5 | 1fc3ca163a80e75f9996264cd121b6c0 |
|
BLAKE2b-256 | 1ca95a313e6b375cec778b9dd911d29c1587b277f9bb7dbe1382b3efe7262503 |
Close
Hashes for pytorch_concurrent_dataloader-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a696d2fd36bc84cb9be05d1520b52bf17f04fa36fdc4c5d9412aec41dac1f745 |
|
MD5 | aaeb32901972e9e669b79b960edbc0c2 |
|
BLAKE2b-256 | b5df22a069f5b107d77dc58b2e3ac3dcc20f1ab275d89e0b430cecec466e357c |