Skip to main content

OrcBench: A Representative Serverless Benchmark

Project description

⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢀⡀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢠⣿⣿⡄⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀
⠀⠀⠀⠀⠀⠀⠀⠀⠀⣀⣤⣶⣧⣄⣉⣉⣠⣼⣶⣤⣀⠀⠀⠀⠀⠀⠀⠀⠀⠀
⠀⠀⠀⠀⠀⠀⠀⢰⣿⣿⣿⣿⡿⣿⣿⣿⣿⢿⣿⣿⣿⣿⡆⠀⠀⠀⠀⠀⠀⠀
⠀⠀⠀⠀⠀⠀⠀⣼⣤⣤⣈⠙⠳⢄⣉⣋⡡⠞⠋⣁⣤⣤⣧⠀⠀⠀⠀⠀⠀⠀
⠀⢲⣶⣤⣄⡀⢀⣿⣄⠙⠿⣿⣦⣤⡿⢿⣤⣴⣿⠿⠋⣠⣿⠀⢀⣠⣤⣶⡖⠀
⠀⠀⠙⣿⠛⠇⢸⣿⣿⡟⠀⡄⢉⠉⢀⡀⠉⡉⢠⠀⢻⣿⣿⡇⠸⠛⣿⠋⠀⠀
⠀⠀⠀⠘⣷⠀⢸⡏⠻⣿⣤⣤⠂⣠⣿⣿⣄⠑⣤⣤⣿⠟⢹⡇⠀⣾⠃⠀⠀⠀
⠀⠀⠀⠀⠘⠀⢸⣿⡀⢀⠙⠻⢦⣌⣉⣉⣡⡴⠟⠋⡀⢀⣿⡇⠀⠃⠀⠀⠀⠀
⠀⠀⠀⠀⠀⠀⢸⣿⣧⠈⠛⠂⠀⠉⠛⠛⠉⠀⠐⠛⠁⣼⣿⡇⠀⠀⠀⠀⠀⠀
⠀⠀⠀⠀⠀⠀⠸⣏⠀⣤⡶⠖⠛⠋⠉⠉⠙⠛⠲⢶⣤⠀⣹⠇⠀⠀⠀⠀⠀⠀
⠀⠀⠀⠀⠀⠀⠀⠀⠀⢹⣿⣶⣿⣿⣿⣿⣿⣿⣶⣿⡏⠀⠀⠀⠀⠀⠀⠀⠀⠀
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠈⠉⠉⠉⠛⠛⠛⠛⠉⠉⠉⠁⠀⠀⠀⠀⠀⠀⠀⠀⠀

OrcBench: A Representative Serverless Benchmark

OrcBench generates a workload trace which can be consumed by serverless platforms to test their service. The models used by OrcBench are modeled off of Microsoft Azure and whos creation is outlined in our paper (referenced below).

Installation

pip install orcbench

Quick Start

orcbench trace

OR

python3 -m orcbench trace

This will produce a standard trace (25% that of the original Microsoft Workload, --scale 0.25). nd produces jobs which will sample for 10 models (--N 10). With a runtime (--runtime 30) of 30 minutes. The seed (--seed) can be optionally set to produce deterministic workloads. The outputted (--out) trace is by default sent to trace.out.

Referencing Us

If you use this benchmark please make sure to cite us using the following citation

PDF of the paper can be found - OrcBench: A Representative Serverless Benchmark

@inproceedings{hancock:benchmarking,
  author    = {Ryan Hancock and
               Sreeharsha Udayashankar and
               Ali José Mashtizadeh and
               Samer Al-Kiswany},
  title     = {OrcBench: A Representative Serverless Benchmark},
  booktitle = {Proceedings of the15th International Conference on Cloud Computing (CLOUD'22)}
  publisher = {{IEEE}},
  year      = {2022},
  doi       = {10.1109/CLOUD55607.2022.00028},
}

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

orcbench-0.1.4.tar.gz (1.2 MB view details)

Uploaded Source

Built Distribution

orcbench-0.1.4-py3-none-any.whl (1.2 MB view details)

Uploaded Python 3

File details

Details for the file orcbench-0.1.4.tar.gz.

File metadata

  • Download URL: orcbench-0.1.4.tar.gz
  • Upload date:
  • Size: 1.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.9.15 FreeBSD/13.1-RELEASE-p2

File hashes

Hashes for orcbench-0.1.4.tar.gz
Algorithm Hash digest
SHA256 552208e4c1c33674f9ecc14366640e5412094cbbf663c5da26379e22c981c8c2
MD5 a56e43b355eabbb6a95574c6926f0cdd
BLAKE2b-256 18336934b2919ae1161412456ea619998826d008c009b6ac27e957bd3857dd3d

See more details on using hashes here.

File details

Details for the file orcbench-0.1.4-py3-none-any.whl.

File metadata

  • Download URL: orcbench-0.1.4-py3-none-any.whl
  • Upload date:
  • Size: 1.2 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.2.2 CPython/3.9.15 FreeBSD/13.1-RELEASE-p2

File hashes

Hashes for orcbench-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 ff771d81279c8edcb074f2134e8af6ff75e10a6ae46cf39721ce18003f687d0c
MD5 4a25e939ac9acab83d89389f75689a89
BLAKE2b-256 194b83ece3f010be69d21c1c7d258c6f481247239df9dc636e3d73b1d52206aa

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page