Interactive dashboard tool for analyzing differences between Aider benchmark runs
Project description
BDA - Benchmark Delta Analysis Tool
A Python tool for analyzing and visualizing differences between two Aider benchmark runs through an interactive dashboard.
Features
- Compares two benchmark run folders (raw or tar-bz2 archives)
- Interactive web dashboard built with Dash
- Detailed test-by-test comparison analysis
- Visualizes performance changes and differences
Dashboard Features
- Test result comparison
- Performance metrics visualization
- Interactive data filtering and sorting
- Detailed test case analysis
Installation
pipx install cedarverse-bda
Usage
# Info on a single benchmark run
bda <run-path>
# Delta Analysis
bda <run1-path> <run2-path>
# Interactive dashboard
bda --dashboard <run-path>
Development
# Install development dependencies
pip install -e .[dev]
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
cedarverse_bda-0.0.1.tar.gz
(208.0 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file cedarverse_bda-0.0.1.tar.gz.
File metadata
- Download URL: cedarverse_bda-0.0.1.tar.gz
- Upload date:
- Size: 208.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6f7944479c7e867a77535efb544e30ef2b025f3de32989600b0f3ab27d11d35e
|
|
| MD5 |
c9874fc09e8ec91b38475d0f3f08778b
|
|
| BLAKE2b-256 |
f063165bdca553df5b7d7b12284bb123d2af28f60db5ede1afb078c7cd664337
|
File details
Details for the file cedarverse_bda-0.0.1-py3-none-any.whl.
File metadata
- Download URL: cedarverse_bda-0.0.1-py3-none-any.whl
- Upload date:
- Size: 24.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.0.1 CPython/3.12.8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
feefc238036ff2eafd1cec1659d2e0e6bf55f9471895006e0d4259f204058729
|
|
| MD5 |
8ef76ddbcbcbbce6f3ccb80fee33a5d1
|
|
| BLAKE2b-256 |
3b13ab021da5ffc50b43f763948236874d620bb6badf8460027e33a56f2a3969
|
