Coffea-casa - A Prototype U.S. CMS analysis facility for Columnar Object Framework For Effective Analysis
About Coffea-casa
The prototype analysis facility provides services for “low latency columnar analysis”, enabling rapid processing of data in a column-wise fashion. These services, based on Dask and Jupyter notebooks, aim to dramatically lower time for analysis and provide an easily-scalable and user-friendly computational environment that will simplify, facilitate, and accelerate the delivery of HEP results. The facility is built on top of a Kubernetes cluster and integrates dedicated resources with resources allocated via fairshare through the local HTCondor system. In addition to the user-facing interfaces such as Dask, the facility also manages access control through single-sign-on and authentication & authorization for data access. The notebooks in this repository and include simple HEP analysis examples, managed interactively in a Jupyter notebook and scheduled on Dask workers and accessing both public and protected data.
Contact us
Interested? You can reach us in or in IRIS-HEP Slack channel.
Docker images used for Coffea-casa
Latest :
| Image | Description | Size | Pulls | Version | Layers |
|---|---|---|---|---|---|
| coffea-casa | Dask scheduler image for coffea-casa hub | ||||
| coffea-casa-analysis | Dask worker image for coffea-casa hub |
Image tagging and "continuous building"
This repository uses GitHub Actions to build images, run tests, and push images to DockerHub (Docker image tags are syncronised with Coffea-casa releases).
- Tags pushed to GitHub represent "production" releases with corresponding tags on dockerhub
coffeateam/coffea-casa:x.x.xandcoffeateam/coffea-casa-analysis:x.x.x. The latest tag also corresponds to the most recent GitHub tag.
Please note we are using for Coffea-casa Docker images and Pypi module.
References
- Coffea-casa: an analysis facility prototype, M. Adamec, G. Attebury, K. Bloom, B. Bockelman, C. Lundstedt, O. Shadura and J. Thiltges, arXiv
(02 Mar 2021).
- PyHEP 2020 coffea-casa proceedings:
- The PyHEP 2020 introductory Youtube video is here.
Metadata
Release files for coffea-casa 2021.5.6.post12
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| coffea_casa-2021.5.6.post12.tar.gz | 25.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| coffea_casa-2021.5.6.post12-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 34.5 kB
Release files / coffea_casa-2021.5.6.post12.tar.gz
| Download URL | coffea_casa-2021.5.6.post12.tar.gz |
|---|---|
| Size | 25.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
7252d2f2779cd208d85cc20caa658e2c2d0ddeb219443bebe700dd952c54d308
|
|
BLAKE2b-256 checksum How to use checksums |
5dcfd1d902759e121b72b1cdcb7f203a061e301262709e87ab8bd60c42fae662
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.5
|
Release files / coffea_casa-2021.5.6.post12-py2.py3-none-any.whl
| Download URL | coffea_casa-2021.5.6.post12-py2.py3-none-any.whl |
|---|---|
| Size | 9.4 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
fe18810b3f85f65f0e60b03dfb62c6044c52a743c341aeeeb66b21fa031497ff
|
|
BLAKE2b-256 checksum How to use checksums |
aa824e60f49005d0e077ff2011e8bf1cd578bc960fd7d3a74ec9f84641f352cc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.9.5
|