Skip to main content

Embarrasingly distributed parallel loop on clusters of computers

Build status Coverage status Code Health

The goal of this library is to ease the creation, launch and management of embarassingly parallel jobs on supercomputer such as SLURM. Some basic primitives (pure python NO-SQL database) to work in distributed memory architecture are provided.

Aims: simple, pure python

If you want to parallelize your python jobs in shared memory architecture, I advise you to use joblib.

Getting the latest code

To get the latest code using git, simply type:

git clone git://github.com/clusterlib/clusterlib.git

If you don’t have git installed, you can download a zip or tarball of the latest code: https://github.com/clusterlib/clusterlib/archive/master.zip

Installing

As any Python packages, to install clusterlib, simply do:

python setup.py install

in the source code directory.

How to contribute?

To contribute to clusterlib, first create a github account. Then you can fork the clusterlib repository. Once this is done, you can make clone of your fork, make your changes and whenever you are happy, send us a pull request to the main repository.

Running the test suite

To run the test suite, you need nosetests and the coverage modules. Run the test suite using:

nosetests

from the root of the project.

Documentation

For making the documentation, Sphinx==1.2.2 and sphinx-bootstrap-theme==0.4.0 are needed. Then, you can do

make doc

Metadata

Release files for clusterlib 0.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for clusterlib 0.1
File Size Uploaded Provenance Actions
clusterlib-0.1.tar.gz 1.1 MB Without provenance Details for clusterlib-0.1.tar.gz

Release files / clusterlib-0.1.tar.gz

Download URL clusterlib-0.1.tar.gz
Size 1.1 MB
Tags Source
SHA-256 checksum
How to use checksums
2d117a44834bec5d7097490cb923e7b05726553fe3d0e717ec63faa5e9cb8fad
BLAKE2b-256 checksum
How to use checksums
9ff587de149a71f480b3a36f4f9b34c3f36f6e1268fe16f7ebbc0408baa94bd0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Security for clusterlib 0.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release

0.1 This release

1 release file No provenance

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page