Skip to main content

PyPI version Python Version License

Linux/MacOS: Build Status Windows: Windows Build status

Introduction

cBench is a cross-platform client connected with the open cKnowledge.io portal to support collaborative and reproducible benchmarking, optimization and co-design of computational systems based on emerging technologies (AI, ML, quantum, IoT).

cBench is a part of the Collective Knowledge technology and a wrapper around the low-level CK SDK to simplify the user experience.

Platform support:

As a host platform As a target platform
Generic Linux ✓ ✓
Linux (Arm) ✓ ✓
Raspberry Pi ✓ ✓
MacOS ✓ ±
Windows ✓ ✓
Android ± ✓
iOS TBD TBD

MLPref crowd-benchmarking demo on Ubuntu

Install prerequisites:

sudo apt update
sudo apt install git wget libz-dev curl cmake
sudo apt install gcc g++ autoconf autogen libtool
sudo apt install libfreetype6-dev
sudo apt install python3.7-dev
sudo apt install -y libsm6 libxext6 libxrender-dev

Install cbrain:

python3 -m pip install cbrain

Initialize the CK solution for MLPerf:

cb init demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows

Participate in crowd-benchmarking:

cb benchmark demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows

See results on a public SOTA dashboard.

You can also use the stable Docker image to participate in crowd-benchmarking:

sudo docker run ctuning/cbench-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows /bin/bash -c "cb benchmark demo-obj-detection-coco-tf-cpu-benchmark-linux-portable-workflows"

You can also check all dependencies for this solution.

Documentation

Feedback

  • This is an ongoing project - don't hesitate to contact us if you have any feedback and suggestions!

Acknowledgments

We would like to thank all CK partners for fruitful discussions and feedback!

Copyright 2020 cTuning foundation and cKnowledge SAS

Release files for cbench 1.2.9

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for cbench 1.2.9
File Size Uploaded
cbench-1.2.9.tar.gz 43.1 kB Details

Release files / cbench-1.2.9.tar.gz

Download URL cbench-1.2.9.tar.gz
Size 43.1 kB
Tags Source
SHA-256 checksum
How to use checksums
c765c44e6479890e858d794ba835bfd9c05dbfddc34eb2ca34e95e45d302ca8b
BLAKE2b-256 checksum
How to use checksums
cca3fcb95ae58fca5cbca309e50b80afc6ae21cd5b4c84e5f975c9b1fce60d7e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.1.3 requests-toolbelt/0.9.1 tqdm/4.45.0 CPython/3.6.7

Release history Release notifications | RSS feed

1.3.1

1 release file

1.2.10

1 release file

This release

1.2.9 This release

1 release file

1.2.8

1 release file

1.2.7

1 release file

1.2.6

1 release file

1.2.5

1 release file

1.2.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page