Parses db_bench.log files outputted from RocksDB
Project description
rocksdb-statistics
A small snippet I wrote to generate plots for my thesis on Auto-tuning RocksDB
Parses db_bench.log files outputted from RocksDB Outputs CSV-files and pgfplot of write, compaction and stall statistics.
Supported statistics:
- interval_writes
- cumulative_writes
- interval_stall
- cumulative_stall
- interval_compaction
- cumulative_compaction
Usage
pip install rocksdb-statistics
rocksdb-statistics db_bench.log
Parsed stats are outputted to output/
in the current directory
Alternatively specify what stats to output
rocksdb-statistics db_bench.log --statistics "interval_writes,interval_compaction"
Example
Run db_bench with statistics using stats_interval_seconds
to retrieve stats for each second. Make sure to set stats_per_interval
to make db_bench output ** DB stats **
for each interval.
./db_bench --benchmarks="fillrandom,stats" -stats_interval_seconds 1 -stats_per_interval 1 &> db_bench.log
rocksdb-statistics db_bench.log
The directory output/
contains the parsed statistics in csv.
Example files are provided in the example/
directory.
You can also add -statistics
to get a summary of a lot of other things.
./db_bench --benchmarks="fillrandom,stats" -statistics -stats_interval_seconds 1 -stats_per_interval 1 &> db_bench.log
Example plots
Below are some plots I generated using this tool for my thesis.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for rocksdb-statistics-0.0.10.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 73cc98764eaeb5b267e3a44a432204753a6418a46145feceab47c2446a6e69e3 |
|
MD5 | f6c47a1b57a04270b97b5367c7f1c109 |
|
BLAKE2b-256 | 05b8803b8f0f15209b85b1681d9654b3d8d8add236edce1d12512c171d48ff3d |
Hashes for rocksdb_statistics-0.0.10-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6bac9f1a285cbac7e2c21f294e31ff2049900f418a79e37a7c5e3f8a79ace3c2 |
|
MD5 | 811e7c1c00748a86b38b837cfa6be7b5 |
|
BLAKE2b-256 | eed424bc0d5f5dac063a79a04c7efc78b4cdda19e1bd306ec60cd67c2883227a |