A Prototype U.S. CMS analysis facility
Project description
Coffea-casa - A Prototype U.S. CMS analysis facility for Columnar Object Framework For Effective Analysis
About Coffea-casa
The prototype analysis facility provides services for “low latency columnar analysis”, enabling rapid processing of data in a column-wise fashion. These services, based on Dask and Jupyter notebooks, aim to dramatically lower time for analysis and provide an easily-scalable and user-friendly computational environment that will simplify, facilitate, and accelerate the delivery of HEP results. The facility is built on top of a Kubernetes cluster and integrates dedicated resources with resources allocated via fairshare through the local HTCondor system. In addition to the user-facing interfaces such as Dask, the facility also manages access control through single-sign-on and authentication & authorization for data access. The notebooks in this repository and include simple HEP analysis examples, managed interactively in a Jupyter notebook and scheduled on Dask workers and accessing both public and protected data.
Check analysis repositories using coffea-casa
Docker images used for Coffea-casa
Latest :
Image | Description | Size | Pulls | Version | Layers |
---|---|---|---|---|---|
coffea-casa | Dask scheduler image for coffea-casa hub | ||||
coffea-casa-analysis | Dask worker image for coffea-casa hub |
Image tagging and "continuous building"
This repository uses GitHub Actions to build images, run tests, and push images to DockerHub (Docker image tags are syncronised with Coffea-casa releases).
- Tags pushed to GitHub represent "production" releases with corresponding tags on dockerhub
coffeateam/coffea-casa:x.x.x
andcoffeateam/coffea-casa-analysis:x.x.x
. The latest tag also corresponds to the most recent GitHub tag.
Please note we are using for Coffea-casa Docker images and Pypi module.
References
- Coffea-casa: an analysis facility prototype, M. Adamec, G. Attebury, K. Bloom, B. Bockelman, C. Lundstedt, O. Shadura and J. Thiltges, arXiv (02 Mar 2021).
- PyHEP 2020 coffea-casa proceedings:
- The PyHEP 2020 introductory Youtube video is here.
Contact us
Interested? You can reach us in or in IRIS-HEP Slack channel.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for coffea_casa-2021.7.9.post0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 993e95c2560a7136b8c632d27f4d07e56f46677e4135605a3c34cdf5cc3d8402 |
|
MD5 | dfb7236734e360fb2a8193d3a6b9ab48 |
|
BLAKE2b-256 | 42ab4a69a5527ca5915de8af724da0425fde7b92ebbfc1da2800386e46055b0a |
Hashes for coffea_casa-2021.7.9.post0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3b3e85d6048887f35a9e52d5d6d0fc4cac9ada057c557e9b7d72fdfc3c850f1a |
|
MD5 | ce444fa807c0bb0f0d4f815a1c4ecfea |
|
BLAKE2b-256 | f3a6226d817746755f66be013aac357c88520d2148cb647ec5d7bbb2d359fd05 |