Skip to main content

ClusterShell library and tools

Project description

ClusterShell is an event-driven open source Python library, designed to run local or distant commands in parallel on server farms or on large Linux clusters. It will take care of common issues encountered on HPC clusters, such as operating on groups of nodes, running distributed commands using optimized execution algorithms, as well as gathering results and merging identical outputs, or retrieving return codes. ClusterShell takes advantage of existing remote shell facilities already installed on your systems, like SSH.

User tools

ClusterShell also provides clush, clubak and nodeset, three convenient command-line tools that allow traditional shell scripts to benefit from some of the library features:

  • clush: issue commands to cluster nodes and format output

Example of use:

$ clush -abL uname -r
node[32-49,51-71,80,82-150,156-159]: 2.6.18-164.11.1.el5
node[3-7,72-79]: 2.6.18-164.11.1.el5_lustre1.10.0.36
node[2,151-155]: 2.6.31.6-145.fc11.2.x86_64

See man clush for more details.

  • clubak: improved dshbak to gather and sort dsh-like outputs

See man clubak for more details.

  • nodeset: compute advanced nodeset/nodegroup operations

Examples of use:

$ echo node160 node161 node162 node163 | nodeset -f
node[160-163]

$ nodeset -f node[0-7,32-159] node[160-163]
node[0-7,32-163]

$ nodeset -e node[160-163]
node160 node161 node162 node163

$ nodeset -f node[32-159] -x node33
node[32,34-159]

$ nodeset -f node[32-159] -i node[0-7,20-21,32,156-159]
node[32,156-159]

$ nodeset -f node[33-159] --xor node[32-33,156-159]
node[32,34-155]

$ nodeset -l
@oss
@mds
@io
@compute

$ nodeset -e @mds
node6 node7

See man nodeset for more details.

Please visit the ClusterShell website.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

clustershell-1.7.1.tar.gz (336.2 kB view details)

Uploaded Source

File details

Details for the file clustershell-1.7.1.tar.gz.

File metadata

  • Download URL: clustershell-1.7.1.tar.gz
  • Upload date:
  • Size: 336.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for clustershell-1.7.1.tar.gz
Algorithm Hash digest
SHA256 1d15430d74d88283120b53562d063b3698044c11162f69b0c52ffa0d2d849d9f
MD5 feb73182bbc7468517c7b79f10b2ac33
BLAKE2b-256 f00d794c0beffa3e4c1e57f6b61e625763185de1ce9a592ed68110dc12426001

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page