A cross-platform client to perform collaborative and reproducible benchmarking, optimization and co-design of software and hardware for emerging workloads (AI, ML, quantum, IoT) via the open cKnowledge.io portal
Project description
Introduction
cBench is a cross-platform client connected with the open cKnowledge.io portal to support collaborative and reproducible benchmarking, optimization and co-design of computational systems based on emerging technologies (AI, ML, quantum, IoT).
cBench is a part of the Collective Knowledge technology and a wrapper around the low-level CK SDK to simplify the user experience.
Platform support:
As a host platform | As a target platform | |
---|---|---|
Generic Linux | ✓ | ✓ |
Linux (Arm) | ✓ | ✓ |
Raspberry Pi | ✓ | ✓ |
MacOS | ✓ | ± |
Windows | ✓ | ✓ |
Android | ± | ✓ |
iOS | TBD | TBD |
MLPref crowd-benchmarking demo on Ubuntu
Install prerequisites:
sudo apt update
sudo apt install git wget libz-dev curl cmake
sudo apt install gcc g++ autoconf autogen libtool
sudo apt install libfreetype6-dev
sudo apt install python3.7-dev
sudo apt install -y libsm6 libxext6 libxrender-dev
Install cbrain:
python3 -m pip install cbrain
Initialize the CK solution for MLPerf:
cb init demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows
Participate in crowd-benchmarking:
cb benchmark demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows
See results on a public SOTA dashboard.
You can also use the stable Docker image to participate in crowd-benchmarking:
sudo docker run ctuning/cbench-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows /bin/bash -c "cb benchmark demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows"
You can also check all dependencies for this solution.
Documentation
Feedback
- This is an ongoing project - don't hesitate to contact us if you have any feedback and suggestions!
Acknowledgments
We would like to thank all CK partners for fruitful discussions and feedback!
Copyright 2020 cTuning foundation and cKnowledge SAS
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.