Skip to main content

Tempest Parser tool used to generate trending reports out of various result formats: pytest's CLI, Rally's XML,JSON, jUnit XML (with v4 schema support), CSV (two types).

Project description

======= Foreword

When you running tempest, you probably want to review result in a human manner. You running it once again… and again… and a couple times more the next day… …you end up with 20+ files in ‘.testrepository’ folder. Start digging how specific tempest test was executed yesterday, how changed result is today. ‘grep’, ‘less’… Brain goes hot.

Honestly, Subunit’s CLI output is good enough for reading the word PASSED at the end… …and the summary.

So, there is a need to: - import tempest tests results - match tests by Class, test_name and options - produce some sort of a report to work with test statuses and track them over time - Have error messages be added to the report

======= Installing

Latest published version can be obtained using pip:

pip install tempestparser

or using from cloned git repo

python install

======= Usage

This util is originally intended for ‘import-match-export’ flow to produce CSV with tests matched by Class and name against the list of tests that was originally executed.

tparser -c matched.csv tempest.log

Folder also can be used:

tparser -c matched.csv folder1

And finally, here is HTML report

tparser -r trending.html tempest.xml


tparser -r trending.html folder1

also, you can add full traceback messages to report by adding -d switch

tparser -r trending.html -d folder1

In order to eliminate some time wasting scrolling of report back and forth, you can produce unique errors report (see below). Please, note that here you must supply single test run file

tparser -e errors.html single_run.json

This report matches FAILs and SKIPs by main ‘message’ to produce unique errors and skips list. If main message is not there it tries to extract it from trace by matching strings started with ‘Details: ‘ as main message and additional ones with a pair of logical statements: - regular expression of r’s’ (no white spaces at string start) - string not started with ‘Trace’

======= Imported Formats —- .log files Bare tempest output captured with either redirection or by copying XX numbered files from .testrepository folder. LOG parser anchors against lines started with specific strings. Make sure to remove leading environment variables and worker report stuff.

—– .xml files Files exported from tempest with subunit’s XML export.

—– .json files [Rally]( tool export:

rally verify results –json –output-file result1.json

======= Credits

Thanks goes to Dmitry Bogun, Alexey Diyan and Dmitriy Zapeka.

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for TempestParser, version 0.2.55
Filename, size File type Python version Upload date Hashes
Filename, size TempestParser-0.2.55.tar.gz (77.8 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page