Skip to main content

Automated code benchmark solution

Project description

Automated code benchmark solution.

Empower developers with tools to trace and analyze project performances.

Introduction

What is Codebench?

Codebench is a tool that runs user-defined benchmark programs, monitors system information and generates reports. It is most powerful when using in a project tracked by git. It runs benchmarks based on different commits and reports the system usage difference, so that users can compare and track performance changes of their project across commits. It can also be used in CI (Continuous Integration) to detect recent commits that increases/decreases project performance.

What Codebench is not?

Codebench itself does not provide benchmark programs. It is not smart enough to generate a benchmark program for your code. Instead, it can be considered as a wrapper or a supervisor for your benchmark.

Features

  • Normal Mode
    • comparison among commits
    • auto-generated report
  • CI Mode (in development)
    • comparison with baseline
    • auto-generated report
    • threshold alarms

Installation

Codebench can be simply installed by running:

pip install codebench

If you want to install from a source distribution, extract the tarball and run the following command:

python setup.py install

Usage

Command Line Interface

Codebench provides a command line interface. Run codebench -h for details.

Sample

See codebench-sample for details.

A quick demo is demonstrated below:

codebench --before ./before_script.sh --start ./benchmark.py \
--report_type chart --commits cb91b8 3cd96d bb1541

memory_usage elapsed_time cpu_usage

Project details


Release history Release notifications

This version

0.0.2

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for codebench, version 0.0.2
Filename, size File type Python version Upload date Hashes
Filename, size codebench-0.0.2-py2-none-any.whl (8.4 kB) File type Wheel Python version py2 Upload date Hashes View
Filename, size codebench-0.0.2-py3-none-any.whl (8.4 kB) File type Wheel Python version py3 Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page