Skip to main content

Distributed_compy is a distributed computing library that offers multi-threading, heterogeneous (CPU + mult-GPU), and multi-node (hybrid cluster -- more than one machine with CPU+GPUs) paradigms to leverage the processing power of a cluster. Cython is used to generate glue code for the core C/C++ functions and provide wrappers to call from Python. Requires numpy, CUDA toolkit>=2.0, OpenMP, and OpenMPI. Note: this library does not use the popular mpi4py library.

Features:

  • Get/set/configure bandwidths of local node or entire cluster whether by supplied numpy array or from binary data files
  • Code generator to write temporary binary data files or python files that are to be executed on each node
  • Execute mpirun command from master node with default env var or configurable hostfile
  • Reduction sum with functionality scaling such as python naive sum, multi-thread reduction sum, multi-gpu reduction sum, heterogeneous reduction sum, and hybrid heterogeneous reduction sum.

Additional features such as other reduction operations, dot product, matrix multiplication, image processing kernels, neural networks, and finite element method functions are under consideration for future releases.

Metadata

Release files for distributed-compy 1.0.50

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for distributed-compy 1.0.50
File Size Uploaded
distributed_compy-1.0.50.tar.gz 825.2 kB Details

Release files / distributed_compy-1.0.50.tar.gz

Download URL distributed_compy-1.0.50.tar.gz
Size 825.2 kB
Tags Source
SHA-256 checksum
How to use checksums
f6dfcdaa6a3c923bb30ab04e798072f55659977c22421e2820f5e473b03eb7a5
BLAKE2b-256 checksum
How to use checksums
f9d5d22fac485dfc6d94236515d7a91bf8c98a4c6f1e44fdeb0979b637230fea
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.10.12

Release history Release notifications | RSS feed

This release

1.0.50 This release

1 release file

1.0.49

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page