Skip to main content

ClusterShell library and tools

Project description

ClusterShell is an event-driven open source Python library, designed to run local or distant commands in parallel on server farms or on large Linux clusters. It will take care of common issues encountered on HPC clusters, such as operating on groups of nodes, running distributed commands using optimized execution algorithms, as well as gathering results and merging identical outputs, or retrieving return codes. ClusterShell takes advantage of existing remote shell facilities already installed on your systems, like SSH.

User tools

ClusterShell also provides clush, clubak and nodeset, three convenient command-line tools that allow traditional shell scripts to benefit from some of the library features:

  • clush: issue commands to cluster nodes and format output

Example of use:

$ clush -abL uname -r
node[32-49,51-71,80,82-150,156-159]: 2.6.18-164.11.1.el5
node[3-7,72-79]: 2.6.18-164.11.1.el5_lustre1.10.0.36
node[2,151-155]: 2.6.31.6-145.fc11.2.x86_64

See man clush for more details.

  • clubak: improved dshbak to gather and sort dsh-like outputs

See man clubak for more details.

  • nodeset: compute advanced nodeset/nodegroup operations

Examples of use:

$ echo node160 node161 node162 node163 | nodeset -f
node[160-163]

$ nodeset -f node[0-7,32-159] node[160-163]
node[0-7,32-163]

$ nodeset -e node[160-163]
node160 node161 node162 node163

$ nodeset -f node[32-159] -x node33
node[32,34-159]

$ nodeset -f node[32-159] -i node[0-7,20-21,32,156-159]
node[32,156-159]

$ nodeset -f node[33-159] --xor node[32-33,156-159]
node[32,34-155]

$ nodeset -l
@oss
@mds
@io
@compute

$ nodeset -e @mds
node6 node7

See man nodeset for more details.

Please visit the ClusterShell website.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
clustershell-1.7-1.tar.gz (345.9 kB) Copy SHA256 hash SHA256 Source None

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page