Skip to main content

ClusterShell library and tools

Project description

ClusterShell is an event-driven open source Python library, designed to run local or distant commands in parallel on server farms or on large Linux clusters. It will take care of common issues encountered on HPC clusters, such as operating on groups of nodes, running distributed commands using optimized execution algorithms, as well as gathering results and merging identical outputs, or retrieving return codes. ClusterShell takes advantage of existing remote shell facilities already installed on your systems, like SSH.

User tools

ClusterShell also provides clush, clubak and nodeset, three convenient command-line tools that allow traditional shell scripts to benefit from some of the library features:

  • clush: issue commands to cluster nodes and format output

Example of use:

$ clush -abL uname -r
node[32-49,51-71,80,82-150,156-159]: 2.6.18-164.11.1.el5
node[3-7,72-79]: 2.6.18-164.11.1.el5_lustre1.10.0.36
node[2,151-155]: 2.6.31.6-145.fc11.2.x86_64

See man clush for more details.

  • clubak: improved dshbak to gather and sort dsh-like outputs

See man clubak for more details.

  • nodeset (or cluset): compute advanced nodeset/nodegroup operations

Examples of use:

$ echo node160 node161 node162 node163 | nodeset -f
node[160-163]

$ nodeset -f node[0-7,32-159] node[160-163]
node[0-7,32-163]

$ nodeset -e node[160-163]
node160 node161 node162 node163

$ nodeset -f node[32-159] -x node33
node[32,34-159]

$ nodeset -f node[32-159] -i node[0-7,20-21,32,156-159]
node[32,156-159]

$ nodeset -f node[33-159] --xor node[32-33,156-159]
node[32,34-155]

$ nodeset -l
@oss
@mds
@io
@compute

$ nodeset -e @mds
node6 node7

See man nodeset (or man cluset) for more details.

Please visit the ClusterShell website.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ClusterShell-1.7.91.tar.gz (352.5 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page