Skip to main content

Store bench result from JMeter of FunkLoad for reporting.

Project description

NAME

benchbase - Store and manage JMeter or FunkLoad benchmark results.
Produces detailed reports.

Visit https://github.com/bdelbosc/benchbase/wiki to see report examples.

USAGE

benchbase [–version] [–logfile=LOGFILE] [–database=DATABASE] COMMAND [OPTIONS] [ARGUMENT]

COMMANDS

list
List the imported benchmark in the database.
info BID
Give more information about the benchmark with the bid number (benchmark identifier).
import [–jmeter|–funkload|–comment=COMMENT] FILE
Import the benchmark result into the database. Output the BID number. The input file can be gzipped.
addsar –host HOST [–comment=COMMENT] BID SAR
Import the text sysstat sar output, the input file can be gzipped.
report –output REPORT_DIR BID
Generate the report for the imported benchmark

EXAMPLES

benchbase list
List of imported benchmarks.
benchbase import -m”Run 42” jmeter-2010.xml
Import a JMeter benchmark result file, this will output a BID number.
benchbase addsar -H”localhost” -m”bencher host” 1 /tmp/sysstat-sar.log.gz
Attach a gzipped sysstat sar file for the bench BID 1.
benchbase report 1 -o /tmp/report-run42
Build the report of benchmark BID 1 into /tmp/report-run42 directory.

REQUIRES

Benchbase requires gnuplot and sqlite3, on Debian/Ubuntu:

sudo aptitude install sqlite3 gnuplot

INSTALLATION

sudo easy_install benchbase

INPUTS

JMeter

Supported JMeter file format is JTL 2.1 sample attributes.

This has been tested using an ant script with the following configuration:

<jmeter ...>
 ...
 <property name="file_format.testlog" value="2.1"/>
 <property name="jmeter.save.saveservice.output_format" value="xml"/>
 <property name="jmeter.save.saveservice.bytes" value="true"/>
 <property name="jmeter.save.saveservice.thread_counts" value="true"/>
 ...
</jmeter>

The CSV output is also supported in 10 or 12 columns

10: ['ts', 't', 'lb', 'tn', 'de', 's', 'by', 'ng', 'na', 'lt'],
12: ['ts', 't', 'lb', 'rc', 'rm', 'tn', 'de', 's', 'by', 'ng', 'na', 'lt']}

FunkLoad

Should work with any FunkLoad xml result file.

Sysstat sar file

Supported sysstat sar format is the text output. For instance you can capture stuff like this:

sar -d -o /tmp/sar.data 1 100 > /dev/null 2>&1 &

This gets stats every second during 100s and store the result in a file.

To get the text output you need to run this:

LC_ALL=C sar -f /tmp/sar.data -A > /tmp/sar.log

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
benchbase-1.1.0-py2.6.egg (45.2 kB) Copy SHA256 hash SHA256 Egg 2.6
benchbase-1.1.0-py2.7.egg (45.0 kB) Copy SHA256 hash SHA256 Egg 2.7
benchbase-1.1.0.tar.gz (772.5 kB) Copy SHA256 hash SHA256 Source None

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page