IOWarp Core: High-performance distributed I/O and task execution runtime
Project description
IOWarp Core
High-performance distributed I/O and task execution runtime for scientific computing and HPC workloads.
Overview
IOWarp Core is a PyPI package that provides automated installation and build management for the complete IOWarp ecosystem. It orchestrates the compilation and installation of four core C++ components:
- Context Transport Primitives - High-performance shared memory library with IPC-safe containers and synchronization primitives
- Runtime - Distributed task execution runtime with microsecond-level latencies
- Context Transfer Engine - Multi-tiered, heterogeneous-aware I/O buffering system
- Context Assimilation Engine - Data ingestion and processing engine for heterogeneous storage systems
All components are built from source using CMake with minimalistic dependencies (no CUDA, ROCm, compression, or encryption by default).
Features
- Automated Build Process: Clones, builds, and installs all components in the correct dependency order
- CMake Integration: Seamlessly integrates C++ CMake projects with Python packaging
- Minimalistic Dependencies: Built without optional features (CUDA, ROCm, MPI, ZMQ) for easier deployment
- Performance-Oriented: All components optimized for HPC and scientific computing workloads
Requirements
System Requirements
- CMake ≥ 3.10
- C++17 compatible compiler (GCC ≥9, Clang ≥10, MSVC ≥2019)
- Git (for cloning component repositories)
- Python ≥ 3.8
Operating Systems
- Linux (Ubuntu 20.04+, CentOS 8+, or similar)
Installation
From PyPI
pip install iowarp-core
License
BSD License - See LICENSE file for details.
Note: Individual IOWarp components may have different licenses (typically BSD-3-Clause). Please refer to each component's repository for specific licensing information.
Links
- GitHub Organization: https://github.com/iowarp
- Issue Tracker: https://github.com/iowarp/iowarp/issues
Credits
Developed by the Gnosis Research Center at Illinois Institute of Technology and the IOWarp community.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file iowarp_core-0.0.3.tar.gz.
File metadata
- Download URL: iowarp_core-0.0.3.tar.gz
- Upload date:
- Size: 14.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6c41aaf037c3a3f3ba4ff280e2df5b63bce4ae40acc45015c0b4566174c6b580
|
|
| MD5 |
467d13e997af181c736116035df8fe4d
|
|
| BLAKE2b-256 |
ed92606eb93d124c3f2e46f0766b1aa6f88d97600d7d71811696e611a8ec6f8b
|
File details
Details for the file iowarp_core-0.0.3-cp313-cp313-manylinux2014_x86_64.whl.
File metadata
- Download URL: iowarp_core-0.0.3-cp313-cp313-manylinux2014_x86_64.whl
- Upload date:
- Size: 62.4 MB
- Tags: CPython 3.13
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7e204477406e70cbad0f60c151f0303365d0718aa87b439cee26a9cbb641a29d
|
|
| MD5 |
677bbbc5fd8c31f64deeb4b4d7fdabe7
|
|
| BLAKE2b-256 |
67e89c897b9ca7a8196c41a3fe95ac9b35ff9fb8164b87be6eae950312d95efe
|
File details
Details for the file iowarp_core-0.0.3-cp313-cp313-manylinux2014_aarch64.whl.
File metadata
- Download URL: iowarp_core-0.0.3-cp313-cp313-manylinux2014_aarch64.whl
- Upload date:
- Size: 62.0 MB
- Tags: CPython 3.13
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
85fcc43dceb4a89f0b3d9487f86c4c5a8501a31f850c5bf1251030e5061122a7
|
|
| MD5 |
de08f6577c5487cb8e710cfb8028523a
|
|
| BLAKE2b-256 |
b32f84a4fb1005c033c51fcd8e758b580285cd24b498128ee3afcc3786342552
|
File details
Details for the file iowarp_core-0.0.3-cp312-cp312-manylinux2014_x86_64.whl.
File metadata
- Download URL: iowarp_core-0.0.3-cp312-cp312-manylinux2014_x86_64.whl
- Upload date:
- Size: 62.6 MB
- Tags: CPython 3.12
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
cad56018a33238494218c8335fc859430e2e427a435acd7e160f1d742e34cc93
|
|
| MD5 |
c0d346aa8541a717159f442045405c1b
|
|
| BLAKE2b-256 |
b06ee26427fce7876e9a0bcffa87b980649a54c6f5b73dec365e34253d8366e6
|
File details
Details for the file iowarp_core-0.0.3-cp312-cp312-manylinux2014_aarch64.whl.
File metadata
- Download URL: iowarp_core-0.0.3-cp312-cp312-manylinux2014_aarch64.whl
- Upload date:
- Size: 62.0 MB
- Tags: CPython 3.12
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
ba721303ab299cf882093c37af5ce71b088621ae60ef27dc74cb32d31c8a8515
|
|
| MD5 |
3dd4c11f06d31a5c951b67c2c8dbbb3b
|
|
| BLAKE2b-256 |
f7e25a62e7ed28ce09ee4fa574a5cbfa2d2805ec900324a56493b61239fcac45
|
File details
Details for the file iowarp_core-0.0.3-cp311-cp311-manylinux2014_x86_64.whl.
File metadata
- Download URL: iowarp_core-0.0.3-cp311-cp311-manylinux2014_x86_64.whl
- Upload date:
- Size: 62.6 MB
- Tags: CPython 3.11
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fcd668a804ee176c0ecb35feb68ea3e1826ecc2c45c90c6f224e71f0d7b60ac0
|
|
| MD5 |
d5cd7739607bf5b1ef673963f1241dc0
|
|
| BLAKE2b-256 |
47e2fe48bfdcca438576e262ce4719d450d55c11a7011d9c137726d656de646a
|
File details
Details for the file iowarp_core-0.0.3-cp311-cp311-manylinux2014_aarch64.whl.
File metadata
- Download URL: iowarp_core-0.0.3-cp311-cp311-manylinux2014_aarch64.whl
- Upload date:
- Size: 62.0 MB
- Tags: CPython 3.11
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
5ba58c423fb33de72a81377a53caf643a4c972e1c6ba9641368a971cccb22ddb
|
|
| MD5 |
d9f3b63780401cf761fe6b1919a48130
|
|
| BLAKE2b-256 |
be9e8d9d2cffba36bd3456ca8ff90d2014ac34a74aa1acd13ac9c9741b6bd339
|
File details
Details for the file iowarp_core-0.0.3-cp310-cp310-manylinux2014_x86_64.whl.
File metadata
- Download URL: iowarp_core-0.0.3-cp310-cp310-manylinux2014_x86_64.whl
- Upload date:
- Size: 62.6 MB
- Tags: CPython 3.10
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0397cb49d8705e74097c08ec93d67c6edf210970b66568aaf20b382f7de7cf61
|
|
| MD5 |
0d47c56ccac0ef84a4dd4855f48e3464
|
|
| BLAKE2b-256 |
a4715aa3c03f68ff70240bae2e1ee0ee59023ea6017b9b003ef27826ba2fffe4
|
File details
Details for the file iowarp_core-0.0.3-cp310-cp310-manylinux2014_aarch64.whl.
File metadata
- Download URL: iowarp_core-0.0.3-cp310-cp310-manylinux2014_aarch64.whl
- Upload date:
- Size: 62.0 MB
- Tags: CPython 3.10
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
61ee7ca87964b67ce6e7602f4947419d9f61667ffd19dde335d13803d2008d66
|
|
| MD5 |
5de187331bd3f63e3ce8b2564e90acd5
|
|
| BLAKE2b-256 |
97f1c03b5d5631f2760cad3f19c83a1a90fa8d59527e9d9aa1b368f8e1c3545a
|
