Python tool for reformatting and plotting/graphing NMON output
Project description
A tool for parsing and reshuffeling nmon’s output into “normal” csv format. Nmon puts out a long file with a system-info header at the beginning, followed by a continuous stream of time stamped readings. This format makes it difficult for analysis by standard Spreadsheet viewers without a fair amount of preprocessing. The pyNmonAnalyzer aims to make this simpler, faster and more effective. In one sweep the pyNmonAnalyzer creates CSV files and two HTML-based reports, one with static graphs and one with interactive graphs powered by dygraphs. This project is currently a work-in-progress and therefore will hopefully improve in functionality and usability. If you have questions, find a bug or have feature requests, please do file an issues here
Example Reports:
Goals:
make nmon log file analysis easier and faster
create HTML based reports with embedded graphs
create CSV files for more indepth data analysis
interactive graphs for hands on analysis, perhaps using dygraph.js
Getting started:
Installation:
If you’d like to mess with the source, please feel free to fork this github repo and contribute back changes.
Dependencies:
Usage:
usage: pyNmonAnalyzer [-h] [-x] [-d] [--force] [-i INPUT_FILE] [-o OUTDIR] [-c] [-b] [-t REPORTTYPE] [-r CONFFNAME] [--dygraphLocation DYGRAPHLOC] [--defaultConfig] [-l LOGLEVEL] nmonParser converts NMON monitor files into time-sorted CSV/Spreadsheets for easier analysis, without the use of the MS Excel Macro. Also included is an option to build an HTML report with graphs, which is configured through report.config. optional arguments: -h, --help show this help message and exit -x, --overwrite overwrite existing results (Default: False) -d, --debug debug? (Default: False) --force force using of config (Default: False) -i INPUT_FILE, --inputfile INPUT_FILE Input NMON file -o OUTDIR, --output OUTDIR Output dir for CSV (Default: ./report/) -c, --csv CSV output? (Default: False) -b, --buildReport report output? (Default: False) -t REPORTTYPE, --reportType REPORTTYPE Should we be generating a "static" or "interactive" report (Default: interactive) -r CONFFNAME, --reportConfig CONFFNAME Report config file, if none exists: we will write the default config file out (Default: ./report.config) --dygraphLocation DYGRAPHLOC Specify local or remote location of dygraphs library. This only applies to the interactive report. (Default: http://dygraphs.com/dygraph-dev.js) --defaultConfig Write out a default config file -l LOGLEVEL, --log LOGLEVEL Logging verbosity, use DEBUG for more output and showing graphs (Default: INFO)
Example Usage:
First generate a report config, most likely the default is all you need. This creates ./report.config $> pyNmonAnalyzer --defaultConfig
Configuration:
To control which items get graphed(CPU, MEM etc) you need to configure the report.config file. This is especially important for AIX NMON systems. To get a sense of what the config file should look like, run pyNmonAnalyzer --defaultConfig this will generate “report.config” in your local directory. It contians two examples, one for Linux and one for AIX systems. Adjust them according to your device names, for Linux you’ll want to set DISKBUSY to your sda1 or sdb1 or what ever. You should be able to use any nmon performance stats, so DISKBUSY, DISKREAD, CPU1, CPU2 etc.
Troubleshooting:
It crashes or my graphs don’t show anything! Have you looked at your current report.config? Is it customized to your device names?
My interactive report will not display! What did I do wrong? Since the interactive report uses javascript to load CSV files, your browser needs to be allowed to read local files(if you are viewing locally). Firefox has been the most reliable for me, chrome currently does not allow JS to access local files.
Any other problems, file an issue or send me an email.
License:
Copyright (c) 2012-2017 Matthias Lee, matthias.a.lee[]gmail.com Last edited: December 23rd 2017 This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program. If not, see <http://www.gnu.org/licenses/>.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.