Skip to main content

Python tool for reformatting and plotting/graphing NMON output

Project description

pyNmonAnalyzer
========

A tool for parsing and reshuffeling nmon's output into "normal" csv format.
Nmon puts out a long file with a system-info header at the beginning, followed
by a continuous stream of time stamped readings. This format makes it difficult
for analysis by standard Spreadsheet viewers without a fair amount of preprocessing.
The pyNmonAnalyzer aims to make this simpler, faster and more effective. In one
sweep the pyNmonAnalyzer creates CSV files and two HTML-based reports, one with static
graphs and one with interactive graphs powered by [dygraphs](http://dygraphs.com). This
project is currently a work-in-progress and therefore will hopefully improve in
functionality and usability. If you have questions, find a bug or have feature requests, please do
file an issues [here](https://github.com/madmaze/pyNmonAnalyzer/issues)

**Example Reports:**
---------------
- [Static Report](http://matthiaslee.com/scratch/pyNmonAnalyzer/data/report.html)
- [Interactive Report](http://matthiaslee.com/scratch/pyNmonAnalyzer/interactiveReport.html)


Goals:
-----
- make nmon log file analysis easier and faster
- create HTML based reports with embedded graphs
- create CSV files for more indepth data analysis
- interactive graphs for hands on analysis, perhaps using dygraph.js

Getting started:
-----
- [Python Nmon Analyzer: moving away from excel macros](http://matthiaslee.com/?q=node/38)

Installation:
-----
pyNmonAnalyzer is now available through pip and easy_install.
If you have pip:
```$> sudo pip install pyNmonAnalyzer```

If you'd like to mess with the source, please feel free to fork
this github repo and contribute back changes.


Usage:
-----
```
usage: pyNmonAnalyzer [-h] [-x] [-d] [--force] [-i INPUT_FILE] [-o OUTDIR]
[-c] [-b] [-t REPORTTYPE] [-r CONFFNAME]
[--dygraphLocation DYGRAPHLOC] [--defaultConfig]
[-l LOGLEVEL]

nmonParser converts NMON monitor files into time-sorted CSV/Spreadsheets for
easier analysis, without the use of the MS Excel Macro. Also included is an
option to build an HTML report with graphs, which is configured through
report.config.

optional arguments:
-h, --help show this help message and exit
-x, --overwrite overwrite existing results (Default: False)
-d, --debug debug? (Default: False)
--force force using of config (Default: False)
-i INPUT_FILE, --inputfile INPUT_FILE
Input NMON file
-o OUTDIR, --output OUTDIR
Output dir for CSV (Default: ./report/)
-c, --csv CSV output? (Default: False)
-b, --buildReport report output? (Default: False)
-t REPORTTYPE, --reportType REPORTTYPE
Should we be generating a "static" or "interactive"
report (Default: interactive)
-r CONFFNAME, --reportConfig CONFFNAME
Report config file, if none exists: we will write the
default config file out (Default: ./report.config)
--dygraphLocation DYGRAPHLOC
Specify local or remote location of dygraphs library.
This only applies to the interactive report. (Default:
http://dygraphs.com/dygraph-dev.js)
--defaultConfig Write out a default config file
-l LOGLEVEL, --log LOGLEVEL
Logging verbosity, use DEBUG for more output and
showing graphs (Default: INFO)
```

Example Usage:
-------------
First generate a report config, most likely the default is all you need. This creates ./report.config
```$> pyNmonAnalyzer --defaultConfig```

Build HTML report with *interactive* graphs for test.nmon and store results to testReport
```$> pyNmonAnalyzer -b -o testReport -i test.nmon```

Build HTML report with static graphs for test.nmon and store results to testReport
```$> pyNmonAnalyzer -b -t static -o testReport -i test.nmon```

Compile CSV formatted tables for data in test.nmon and store results to testOut
```$> pyNmonAnalyzer -c -o testOut -i test.nmon```

Configuration:
-------------
To control which items get graphed(CPU, MEM etc) you need to configure the report.config file.
This is especially important for AIX NMON systems. To get a sense of what the config file
should look like, run `pyNmonAnalyzer --defaultConfig` this will generate "report.config" in
your local directory. It contians two examples, one for Linux and one for AIX systems.
Adjust them according to your device names, for Linux you'll want to set DISKBUSY to your sda1 or sdb1 or what ever.
You should be able to use **any** nmon performance stats, so DISKBUSY, DISKREAD, CPU1, CPU2 etc.

Troubleshooting:
---------------
- **It crashes or my graphs don't show anything!**
Have you looked at your current report.config? Is it customized to your device names?
- **My interactive report will not display! What did I do wrong?**
Since the interactive report uses javascript to load CSV files, your browser needs to be allowed to read local files(if you are viewing locally). Firefox has been the most reliable for me, chrome currently does not allow JS to access local files.

**Any other problems, file an issue or send me an email.**


License:
-------
```
Copyright (c) 2012-2014 Matthias Lee, matthias.a.lee[]gmail.com
Last edited: August 8th 2014

This program is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.

You should have received a copy of the GNU General Public License
along with this program. If not, see <http://www.gnu.org/licenses/>.
```

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pyNmonAnalyzer-1.0.2.tar.gz (39.0 kB view details)

Uploaded Source

File details

Details for the file pyNmonAnalyzer-1.0.2.tar.gz.

File metadata

File hashes

Hashes for pyNmonAnalyzer-1.0.2.tar.gz
Algorithm Hash digest
SHA256 32812a8f535937da95fedf4f9e975b782bffcae8740322b13f1ea771e3fcdfea
MD5 bb5f7da495132c80f2a6f249bd6fe0c3
BLAKE2b-256 0f37a16969fb85c157412be15c04c1770f817bcaaad5c62b0e611f5603bf3cb5

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page