csstuning 0.0.3

Configurable Software System Tuning Benchmark

CSSTuning - Configurable Software Configuration Optimization Benchmark

CSSTuning is a comprehensive benchmark tool that caters to various real-world software configuration optimization problems. It offers a simple and rapid setup process for creating a software configuration optimization environment on Linux systems, accurately replicating real software configuration challenges.

Introduction

Optimizing software configurations is a crucial aspect of performance tuning for a wide array of applications and systems. CSSTuning aims to address this need by providing an extensive collection of benchmark scenarios, each representing authentic software configuration optimization problems. Whether you are a developer, researcher, or enthusiast, CSSTuning provides an invaluable resource for assessing and optimizing the performance of diverse software configurations.

Benchmark List

Compiler

Data base manage system (DBMS) //to do

Web Server //to do

Big data system //to do

Features

• Diverse Benchmark Scenarios: CSSTuning presents a rich set of benchmark scenarios that accurately emulate real-world software configuration optimization problems for multiple software systems.
• Multi-objective Optimization: For each software system, CSSTuning incorporates various officially recognized performance evaluation metrics, allowing the construction of multi-objective optimization problems.
• Containerized Benchmarks: All benchmarks in CSSTuning are containerized, eliminating dependency issues and ensuring easy reproducibility across different environments.
• Industrial Data-driven Tuning: CSSTuning goes beyond traditional benchmarks by providing the ability to optimize software systems using real-world industrial data, making the optimization process more relevant and practical.

installation

Prerequisites:

• POSIX System (i.e. Linux, MacOS)
• Docker installed
• Python 3.8+

git clone https://github.com/neeetman/csstuning.git
cd path/to/csstuning
#modify PAPI permissions for compiler benchmark
sudo sh -c "echo -1 > /proc/sys/kernel/perf_event_paranoid"
##installation
python setup.py install --user

Usage

1.Compiler Benchmarks

Use command line

GCC compiler

# View the available benchmarks for GCC #
csstuning compiler:gcc list benchs
# View the available flags for GCC #
csstuning compiler:gcc list flags
# Help command #
csstuning --help
# Run GCC with specific benchmark and flags #
csstuning compiler:gcc run benchs=cbench-automotive-bitcount flags="ftree-loop-vectorize,ftree-partial-pre"

LLVM compiler

# View the available benchmarks for LLVM #
csstuning compiler:llvm cc list benchs
# View the available flags for LLVM #
csstuning compiler:llvm list flags
# Help command #
csstuning --help
# Run LLVM with specific benchmark and flags #
csstuning compiler:llvm run benchs=cbench-automotive-bitcount flags="vetor-combine"

Use in python

2.DBMS Benchmarks