Simple script which can be used to monitor and log CPU and RAM usage of submitted cluster jobs
Project description
ClusterMonitor
A very simple python script which monitors and records the CPU and RAM consumption of submitted cluster jobs.
Usage
To start recording use the cpu_ram_log.py
script. This script requires 3 arguments:
-u
which corresponds to your username.-o
which specifies the output file (in tsv format)--interval
which specifies the time (in seconds) over which the CPU and RAM usage gets averaged
Example:
python cpu_ram_log.py -u nickhir -o cpu_ram.log --interval 5
The script can simply be included in your cluster job submittion like this:
#!/bin/bash
#SBATCH --job-name=Example_run
sambamba sort -t 20 some_bam.bam &
MainScript=$!
python cpu_ram_log.py -u nickhir -o cpu_ram.log --interval 5 &
wait $MainScript
pkill -P $$
Afterwards the resulting log file can be plotted (for that matplotlib
is needed).
For that use the visualize_log.py
script which needs 2 arguments:
-i
which specifies the path to the log file which was created withcpu_ram_log.py
-o
which specifies the path to the resulting PDF which contains a plot for the CPU and RAM usage.
Example:
python visualize_log.py -i cpu_ram.log -o cpu_ram_visualization.pdf
The resulting plots will look somewhat like this:
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ClusterMonitor-0.0.4.tar.gz
(3.8 kB
view hashes)
Built Distribution
Close
Hashes for ClusterMonitor-0.0.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 78013b7c8ffb6ffe142e32bb847f98cf4a20fb198e961289ff3253abfa016532 |
|
MD5 | fa40510bbb263e4702eb1c9ead7f365c |
|
BLAKE2b-256 | 40b44f185d4addf2a148fdc167793229bb55a814ab4c3dfb853722584d334509 |