Skip to main content

IOWarp Core: High-performance distributed I/O and task execution runtime

Project description

IOWarp Core

High-performance distributed I/O and task execution runtime for scientific computing and HPC workloads.

Overview

IOWarp Core is a PyPI package that provides automated installation and build management for the complete IOWarp ecosystem. It orchestrates the compilation and installation of four core C++ components:

  1. Context Transport Primitives - High-performance shared memory library with IPC-safe containers and synchronization primitives
  2. Runtime - Distributed task execution runtime with microsecond-level latencies
  3. Context Transfer Engine - Multi-tiered, heterogeneous-aware I/O buffering system
  4. Context Assimilation Engine - Data ingestion and processing engine for heterogeneous storage systems

All components are built from source using CMake with minimalistic dependencies (no CUDA, ROCm, compression, or encryption by default).

Features

  • Automated Build Process: Clones, builds, and installs all components in the correct dependency order
  • CMake Integration: Seamlessly integrates C++ CMake projects with Python packaging
  • Minimalistic Dependencies: Built without optional features (CUDA, ROCm, MPI, ZMQ) for easier deployment
  • Performance-Oriented: All components optimized for HPC and scientific computing workloads

Requirements

System Requirements

  • CMake ≥ 3.10
  • C++17 compatible compiler (GCC ≥9, Clang ≥10, MSVC ≥2019)
  • Git (for cloning component repositories)
  • Python ≥ 3.8

Operating Systems

  • Linux (Ubuntu 20.04+, CentOS 8+, or similar)

Installation

From PyPI

pip install iowarp-core

License

BSD License - See LICENSE file for details.

Note: Individual IOWarp components may have different licenses (typically BSD-3-Clause). Please refer to each component's repository for specific licensing information.

Links

Credits

Developed by the Gnosis Research Center at Illinois Institute of Technology and the IOWarp community.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

iowarp_core-0.0.1.tar.gz (12.5 kB view details)

Uploaded Source

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

iowarp_core-0.0.1-cp313-cp313-manylinux_2_39_x86_64.whl (9.4 MB view details)

Uploaded CPython 3.13manylinux: glibc 2.39+ x86-64

iowarp_core-0.0.1-cp312-cp312-manylinux_2_39_x86_64.whl (9.4 MB view details)

Uploaded CPython 3.12manylinux: glibc 2.39+ x86-64

iowarp_core-0.0.1-cp311-cp311-manylinux_2_39_x86_64.whl (9.4 MB view details)

Uploaded CPython 3.11manylinux: glibc 2.39+ x86-64

iowarp_core-0.0.1-cp310-cp310-manylinux_2_39_x86_64.whl (9.4 MB view details)

Uploaded CPython 3.10manylinux: glibc 2.39+ x86-64

File details

Details for the file iowarp_core-0.0.1.tar.gz.

File metadata

  • Download URL: iowarp_core-0.0.1.tar.gz
  • Upload date:
  • Size: 12.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for iowarp_core-0.0.1.tar.gz
Algorithm Hash digest
SHA256 bf322e0ea204705eea58ca5cb4ad8ce8479eb644283440d1b5123214469c571b
MD5 267f7462e04877fd4cbbffe5d886c4dd
BLAKE2b-256 be4537c4023996116f38034f834c9e3aa5bba6555ca3413d7b1f86825e98c47e

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.1-cp313-cp313-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.1-cp313-cp313-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 5297f1ce9c1fc3de3a2e038541f8ee41534aff740b0b3fc7a79ea7ca297888bc
MD5 5916fae3ade145222e33bcb2469a6178
BLAKE2b-256 614d7e6dc0aba935a30b6e39f7cab468664fca5f2f188c6f0a622c214b8727cd

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.1-cp312-cp312-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.1-cp312-cp312-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 796bb0d800ae85b7b4b0bf7b9061310fa6b756b443e7b7164e5cbf707b8fbd65
MD5 8eba030b5ee15aeeee2a57ef72dba8bb
BLAKE2b-256 0b23b914143427cb5c194c20da6f1e9a82b6a7dab3a57dbd6e29662f30056d79

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.1-cp311-cp311-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.1-cp311-cp311-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 4c11ab08c66786faf0a7487f7483cc0df0a74fa53b0319c660edbcde28ce7d62
MD5 c00688344bd57243403be9137356ed9d
BLAKE2b-256 44615e5b5e4fb411ca0839dbd19c5ae46253bf2be2745f2246f05764aedb92e1

See more details on using hashes here.

File details

Details for the file iowarp_core-0.0.1-cp310-cp310-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for iowarp_core-0.0.1-cp310-cp310-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 a3f67eded1be9d105fa83736ceb0f291d3decd2cde5000158aafc9d340fe8406
MD5 a297e5afadeca990d4e448f0d42fab5c
BLAKE2b-256 4768c5446dd12e75c1b8e0569ba72f975d1f5f2a27156185b72d312e6c7e45b5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page