Skip to main content

A cross-platform client to perform collaborative and reproducible benchmarking, optimization and co-design of software and hardware for emerging workloads (AI, ML, quantum, IoT) via the open portal

Project description

PyPI version Python Version License

Linux/MacOS: Build Status Windows: Windows Build status


cBench is a small and cross-platform framework connected with the open Collective Knowledge portal to help researchers and practitioners reproduce ML&systems research on their own bare-metal platforms, participate in collaborative benchmarking and optimization, and share results on live scoreobards.

You can try to reproduce MLPerf inference benchmark on your machine using this solution and see public results from the community on this scoreboard.

cBench is a part of the Collective Knowledge project (CK) and uses portable CK solutions to describe how to download, build, benchmark and optimize applications across different hardware, software, models and data sets.

Platform support:

As a host platform As a target platform
Generic Linux
Linux (Arm)
Raspberry Pi
MacOS ±
Android ±

Object detection crowd-benchmarking demo on Ubuntu

Install prerequisites:

sudo apt update
sudo apt install git wget libz-dev curl cmake
sudo apt install gcc g++ autoconf autogen libtool
sudo apt install libfreetype6-dev
sudo apt install python3.7-dev
sudo apt install -y libsm6 libxext6 libxrender-dev

Install cbrain:

python3 -m pip install cbrain

Initialize the CK solution for MLPerf:

cb init demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows

Participate in crowd-benchmarking:

cb benchmark demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows

See results on a public SOTA dashboard.

You can also use the stable Docker image to participate in crowd-benchmarking:

sudo docker run ctuning/cbench-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows /bin/bash -c "cb benchmark demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows"

You can also check all dependencies for this solution.



  • This is an ongoing project - don't hesitate to contact us if you have any feedback and suggestions!


We would like to thank all CK partners for fruitful discussions and feedback!

Copyright 2020 cTuning foundation

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cbench-1.2.10.tar.gz (45.2 kB view hashes)

Uploaded source

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page