Skip to main content

benchbase

NAME

benchbase - Store and manage JMeter or FunkLoad benchmark results.

Produces detailed reports.

Visit https://github.com/bdelbosc/benchbase/wiki to see report examples.

USAGE

benchbase [–version] [–logfile=LOGFILE] [–database=DATABASE] COMMAND [OPTIONS] [ARGUMENT]

COMMANDS

list

List the imported benchmark in the database.

info BID

Give more information about the benchmark with the bid number (benchmark identifier).

import [–jmeter|–funkload|–comment=COMMENT] FILE

Import the benchmark result into the database. Output the BID number. The input file can be gzipped.

addsar –host HOST [–comment=COMMENT] BID SAR

Import the text sysstat sar output, the input file can be gzipped.

report –output REPORT_DIR BID

Generate the report for the imported benchmark

EXAMPLES

benchbase list

List of imported benchmarks.

benchbase import -m”Run 42” jmeter-2010.xml

Import a JMeter benchmark result file, this will output a BID number.

benchbase addsar -H”localhost” -m”bencher host” 1 /tmp/sysstat-sar.log.gz

Attach a gzipped sysstat sar file for the bench BID 1.

benchbase report 1 -o /tmp/report-run42

Build the report of benchmark BID 1 into /tmp/report-run42 directory.

REQUIRES

Benchbase requires gnuplot and sqlite3, on Debian/Ubuntu:

sudo aptitude install sqlite3 gnuplot

INSTALLATION

sudo easy_install benchbase

INPUTS

JMeter

Supported JMeter file format is JTL 2.1 sample attributes.

This has been tested using an ant script with the following configuration:

<jmeter ...>
 ...
 <property name="file_format.testlog" value="2.1"/>
 <property name="jmeter.save.saveservice.output_format" value="xml"/>
 <property name="jmeter.save.saveservice.bytes" value="true"/>
 <property name="jmeter.save.saveservice.thread_counts" value="true"/>
 ...
</jmeter>

The CSV output is also supported in 10 or 12 columns

10: ['ts', 't', 'lb', 'tn', 'de', 's', 'by', 'ng', 'na', 'lt'],
12: ['ts', 't', 'lb', 'rc', 'rm', 'tn', 'de', 's', 'by', 'ng', 'na', 'lt']}

FunkLoad

Should work with any FunkLoad xml result file.

Sysstat sar file

Supported sysstat sar format is the text output. For instance you can capture stuff like this:

sar -d -o /tmp/sar.data 1 100 > /dev/null 2>&1 &

This gets stats every second during 100s and store the result in a file.

To get the text output you need to run this:

LC_ALL=C sar -f /tmp/sar.data -A > /tmp/sar.log

Metadata

Release files for benchbase 1.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for benchbase 1.1.0
File Size Uploaded
benchbase-1.1.0.tar.gz 772.5 kB Details

Built distributions (wheels)

Table of built distributions (wheels) for benchbase 1.1.0
File Interpreter ABI Platform
benchbase-1.1.0-py2.7.egg Legacy Egg format - - Details
benchbase-1.1.0-py2.6.egg Legacy Egg format - - Details

Total release size: 862.6 kB

Release files / benchbase-1.1.0.tar.gz

Download URL benchbase-1.1.0.tar.gz
Size 772.5 kB
Tags Source
SHA-256 checksum
How to use checksums
a9943c4fa9fcb0d10af3730d1e65f216b74cbdf2cb0820d7a4d0a1d2ca6c7ff4
BLAKE2b-256 checksum
How to use checksums
4f4ea2b1906a93fa0a34126f061c74001d5793bc165c30a04723738964237843
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release files / benchbase-1.1.0-py2.7.egg

Download URL benchbase-1.1.0-py2.7.egg
Size 45.0 kB
Tags Egg
SHA-256 checksum
How to use checksums
85fc730c0ea55c9e5573d1ffca03c70079c387f53c3b44dd5e1588842746b722
BLAKE2b-256 checksum
How to use checksums
94ed30e38c91aedb4fec36a96959a64531910f8f3c691d6d984987889b0d73c2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release files / benchbase-1.1.0-py2.6.egg

Download URL benchbase-1.1.0-py2.6.egg
Size 45.2 kB
Tags Egg
SHA-256 checksum
How to use checksums
d017c1dcc63fbe31bb160a8dc45d70ba86e53470792b5af310966ec53dae3fdf
BLAKE2b-256 checksum
How to use checksums
c97ae2e60972e4f615ef50d5983114f12ddaed922cf9a8c71ae9ebf4cda6515c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release history Release notifications | RSS feed

This release

1.1.0 This release

3 release files

1.0.0

3 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page