Skip to main content

IOWarp Core: High-performance distributed I/O and task execution runtime

Project description

IOWarp Core

High-performance distributed I/O and task execution runtime for scientific computing and HPC workloads.

Overview

IOWarp Core is a PyPI package that provides automated installation and build management for the complete IOWarp ecosystem. It orchestrates the compilation and installation of four core C++ components:

  1. Context Transport Primitives - High-performance shared memory library with IPC-safe containers and synchronization primitives
  2. Runtime - Distributed task execution runtime with microsecond-level latencies
  3. Context Transfer Engine - Multi-tiered, heterogeneous-aware I/O buffering system
  4. Context Assimilation Engine - Data ingestion and processing engine for heterogeneous storage systems

All components are built from source using CMake with minimalistic dependencies (no CUDA, ROCm, compression, or encryption by default).

Features

  • Automated Build Process: Clones, builds, and installs all components in the correct dependency order
  • CMake Integration: Seamlessly integrates C++ CMake projects with Python packaging
  • Minimalistic Dependencies: Built without optional features (CUDA, ROCm, MPI, ZMQ) for easier deployment
  • Performance-Oriented: All components optimized for HPC and scientific computing workloads

Requirements

System Requirements

  • CMake ≥ 3.10
  • C++17 compatible compiler (GCC ≥9, Clang ≥10, MSVC ≥2019)
  • Git (for cloning component repositories)
  • Python ≥ 3.8

Operating Systems

  • Linux (Ubuntu 20.04+, CentOS 8+, or similar)

Installation

From PyPI

pip install iowarp-core

License

BSD License - See LICENSE file for details.

Note: Individual IOWarp components may have different licenses (typically BSD-3-Clause). Please refer to each component's repository for specific licensing information.

Links

Credits

Developed by the Gnosis Research Center at Illinois Institute of Technology and the IOWarp community.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

iowarp_core-0.0.2.tar.gz (13.8 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

iowarp_core-0.0.2-cp313-cp313-manylinux_2_39_x86_64.whl (9.4 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.39+ x86-64

iowarp_core-0.0.2-cp313-cp313-manylinux_2_39_aarch64.whl (9.3 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.39+ ARM64

iowarp_core-0.0.2-cp312-cp312-manylinux_2_39_x86_64.whl (9.4 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.39+ x86-64

iowarp_core-0.0.2-cp312-cp312-manylinux_2_39_aarch64.whl (9.3 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.39+ ARM64

iowarp_core-0.0.2-cp311-cp311-manylinux_2_39_x86_64.whl (9.4 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.39+ x86-64

iowarp_core-0.0.2-cp311-cp311-manylinux_2_39_aarch64.whl (9.3 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.39+ ARM64

iowarp_core-0.0.2-cp310-cp310-manylinux_2_39_x86_64.whl (9.4 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.39+ x86-64

iowarp_core-0.0.2-cp310-cp310-manylinux_2_39_aarch64.whl (9.3 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.39+ ARM64

File details

Details for the file iowarp_core-0.0.2.tar.gz.

File metadata

  • Download URL: iowarp_core-0.0.2.tar.gz
  • Upload date:
  • Size: 13.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for iowarp_core-0.0.2.tar.gz
Algorithm Hash digest
SHA256 338d327948ab7f6f04bea25e9242ad443d70e653816a96dadd6f4f18f12d3db8
MD5 cdf4b30a4299935d490dd0d72dba16b5
BLAKE2b-256 246a7922ccf47f0eac23eb480da2369f9f8d2d11b7fca683ada3ce3f018d12ed

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.2-cp313-cp313-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.2-cp313-cp313-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 48f9cdcbf15992fa04ec954e34d53a135f4d84e3e07eef7716607365ab6300eb
MD5 72b29d9663d90fb1680354e0bc5f0540
BLAKE2b-256 5b32bf8be12800d7d751fd772182ac78cfad3b63cdbc6a27f34d40bcaff2b5fd

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.2-cp313-cp313-manylinux_2_39_aarch64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.2-cp313-cp313-manylinux_2_39_aarch64.whl
Algorithm Hash digest
SHA256 559cd7b34242554a5c2ad1ce864c64a4394a614684210a749fb4277446875192
MD5 a50ec70f5de3fc48ba31d485c703fc44
BLAKE2b-256 fc03ef2057abda5507bd6fe933430a6c5a232d8e846305e88ddf59a9023688fe

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.2-cp312-cp312-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.2-cp312-cp312-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 8aa9231bb11a7ba6b04434819b955a4d63f37f4cc1d902c4bf0a87c0c6ee00ed
MD5 39579bbc02dba21ec17c189a26e93dca
BLAKE2b-256 f59ea8b45255c293fa99ba355a23559ca78dd2442950fac8a44942b55c2fd145

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.2-cp312-cp312-manylinux_2_39_aarch64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.2-cp312-cp312-manylinux_2_39_aarch64.whl
Algorithm Hash digest
SHA256 cae0a90ad5a2999dd276d6954da2cd7fbc5cdcd7e036826a558cbeeeabe317d0
MD5 ce8e3a6b0bcac14bb2ab8dccc1d3de8e
BLAKE2b-256 3c96ab4ec63600e94a8cf5f28f7c92ccdf0a7188a1f91e680fd9d72dbf69c2e5

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.2-cp311-cp311-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.2-cp311-cp311-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 3830c3a1535ce4f5966b1099813a33ac166ce8283aa02fedef33ee289ba61c9a
MD5 53cea00950773e28c59e487de551789e
BLAKE2b-256 cc2dc9e14ae1659f27fe02ba6277004b8105fdd33ca97254b73467b74beeca59

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.2-cp311-cp311-manylinux_2_39_aarch64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.2-cp311-cp311-manylinux_2_39_aarch64.whl
Algorithm Hash digest
SHA256 19ba9a3427a41e103110c5f85e19208a1d2e3fc22a3d54b539ce363237e8cf87
MD5 a6551cd74a9a2afccbdf593680ed1115
BLAKE2b-256 3a7e2ad664555a1b95f5668c5fc9ce16e6e8cf1607f408c77c047ed0b1524513

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.2-cp310-cp310-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.2-cp310-cp310-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 a289846ca21240cf14fcf79773077774effc54a170a3214c6ff28900af020d48
MD5 86d259e2eb70939d2934012ba3913172
BLAKE2b-256 44f3f366cd3bdfc58fb8d247b6f8cb3aafe98eb34aafb182f61b61c55db56282

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.2-cp310-cp310-manylinux_2_39_aarch64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.2-cp310-cp310-manylinux_2_39_aarch64.whl
Algorithm Hash digest
SHA256 56f44e7f0b001ea204e8b3aabc589b9be3185b0598b8d7e1335141c1815b3f5b
MD5 58cb4bb42f52a6b9b3e3aeaf8ab064bc
BLAKE2b-256 7d5bf58af2b2eafccdaafeb261df05e7b688a6efe1621857637b61d265c314fb

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page