Skip to main content

Execute and document benchmarks reproducibly.

Project description

ReBench - Execute and Document Benchmarks Reproducibly

ReBench is a tool to run and document benchmarks. Currently, its focus lies on benchmarking virtual machines, but nonetheless it can be used to benchmark all kind of other applications/programs, too.

To facilitate the documentation of benchmarks, ReBench uses a text-based configuration format. The configuration files contain all aspects of the benchmark. They describe which binary was used, which parameters where given to the benchmarks, and the number of iterations to be used to obtain statistically reliable results.

Thus, the documentation contains all benchmark-specific informations to reproduce a benchmark run. However, it does not capture the whole systems information, and also does not include build settings for the binary that is benchmarked. These informations can be included as comments, but are not captured automatically.

The data of all benchmark runs is recorded in a data file and allows to continue aborted benchmark runs at a later time.

The data can be exported for instance as CSV or visualized with the help of box plots.

Current Build Status

BuildStatus

Credits

Even though, we do not share code with JavaStats, it was a strong inspiration for the creation of ReBench.

Furthermore, our thanks go to Travis CI for their services.

Project details


Release history Release notifications

History Node

0.9.1

History Node

0.9.0

History Node

0.8.0

History Node

0.7.5

History Node

0.7.4

History Node

0.7.3

History Node

0.7.2

History Node

0.7.1

History Node

0.6.1

History Node

0.6.0

This version
History Node

0.5.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
ReBench-0.5.0.tar.gz (23.5 kB) Copy SHA256 hash SHA256 Source None Mar 5, 2014

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page