SPDL
SPDL (Scalable and Performant Data Loading) is a library and project to explore the design of performant data loading.
It provides flexible pipeline abstraction and a set of operations used for processing array data.
Documentation
Please checkout the documentation.
License
SPDL is BSD 2-Clause licensed, as found in the LICENSE file.
Citation
Please use the following BibTex for citing our project if you find it useful.
@misc{hira2025scalableperformantdataloading,
title={Scalable and Performant Data Loading},
author={Moto Hira and Christian Puhrsch and Valentin Andrei and Roman Malinovskyy and Gael Le Lan and Abhinandan Krishnan and Joseph Cummings and Miguel Martin and Gokul Gunasekaran and Yuta Inoue and Alex J Turner and Raghuraman Krishnamoorthi},
year={2025},
eprint={2504.20067},
archivePrefix={arXiv},
primaryClass={cs.DC},
url={https://arxiv.org/abs/2504.20067},
}
1 maintainer
Metadata
1 maintainer
Release files for spdl-core 0.7.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| spdl_core-0.7.0-py3-none-any.whl | Python 3 | none | any | Details |
Release files / spdl_core-0.7.0-py3-none-any.whl
| Download URL | spdl_core-0.7.0-py3-none-any.whl |
|---|---|
| Size | 366.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
4ac2cfde2dccaf3fef71d57590db47b2df2c2cdc79a1587f2aa10f95ffa9e742
|
|
BLAKE2b-256 checksum How to use checksums |
c1b8aa1db32883193f91eaf1988f794a3ff232911de7bb0c9df4bf0dd50fc50f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.1.0 CPython/3.12.11
|
