A Prototype U.S. CMS analysis facility
Project description
Coffea-casa - A Prototype U.S. CMS analysis facility for Columnar Object Framework For Effective Analysis
About Coffea-casa
The prototype analysis facility provides services for “low latency columnar analysis”, enabling rapid processing of data in a column-wise fashion. These services, based on Dask and Jupyter notebooks, aim to dramatically lower time for analysis and provide an easily-scalable and user-friendly computational environment that will simplify, facilitate, and accelerate the delivery of HEP results. The facility is built on top of a Kubernetes cluster and integrates dedicated resources with resources allocated via fairshare through the local HTCondor system. In addition to the user-facing interfaces such as Dask, the facility also manages access control through single-sign-on and authentication & authorization for data access. The notebooks in this repository and include simple HEP analysis examples, managed interactively in a Jupyter notebook and scheduled on Dask workers and accessing both public and protected data.
Contact us
Interested? You can reach us in or in IRIS-HEP Slack channel.
Docker images used for Coffea-casa
Latest :
| Image | Description | Size | Pulls | Version | Layers |
|---|---|---|---|---|---|
| coffea-casa | Dask scheduler image for coffea-casa hub | ||||
| coffea-casa-analysis | Dask worker image for coffea-casa hub |
Image tagging and "continuous building"
This repository uses GitHub Actions to build images, run tests, and push images to DockerHub (Docker image tags are syncronised with Coffea-casa releases).
- Tags pushed to GitHub represent "production" releases with corresponding tags on dockerhub
coffeateam/coffea-casa:x.x.xandcoffeateam/coffea-casa-analysis:x.x.x. The latest tag also corresponds to the most recent GitHub tag.
Please note we are using for Coffea-casa Docker images and Pypi module.
References
- Coffea-casa: an analysis facility prototype, M. Adamec, G. Attebury, K. Bloom, B. Bockelman, C. Lundstedt, O. Shadura and J. Thiltges, arXiv
(02 Mar 2021).
- PyHEP 2020 coffea-casa proceedings:
- The PyHEP 2020 introductory Youtube video is here.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file coffea_casa-2021.6.8.tar.gz.
File metadata
- Download URL: coffea_casa-2021.6.8.tar.gz
- Upload date:
- Size: 24.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.0 CPython/3.9.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1d9f2f1773b68054e9f9ff8788aded9a5c26c07acfe253b61f602ea2fdfef9a2
|
|
| MD5 |
9b098d5334b867b2e295164e7264a805
|
|
| BLAKE2b-256 |
685bd9ff98a53cba0eac7de4d40ba555bfecace03366f28e44990ae55155e0d4
|
File details
Details for the file coffea_casa-2021.6.8-py2.py3-none-any.whl.
File metadata
- Download URL: coffea_casa-2021.6.8-py2.py3-none-any.whl
- Upload date:
- Size: 9.1 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.0 CPython/3.9.5
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
74b9627c8c64b23f82499f96edeb88e0f586eb593938281f9990fb2571cf0bc7
|
|
| MD5 |
9469583c2cc71385c9c7abdbb0c7e3b7
|
|
| BLAKE2b-256 |
761380dd3923324241e64e198b8f47ba3172fda611002ccf83659c0ec2948b1c
|