Skip to main content

Coffea-casa - A Prototype U.S. CMS analysis facility for Columnar Object Framework For Effective Analysis

Actions Status Documentation Status Code style: black PyPI version PyPI platforms GitHub Discussion GitHub issues GitHub pull requests

About Coffea-casa

The prototype analysis facility provides services for “low latency columnar analysis”, enabling rapid processing of data in a column-wise fashion. These services, based on Dask and Jupyter notebooks, aim to dramatically lower time for analysis and provide an easily-scalable and user-friendly computational environment that will simplify, facilitate, and accelerate the delivery of HEP results. The facility is built on top of a Kubernetes cluster and integrates dedicated resources with resources allocated via fairshare through the local HTCondor system. In addition to the user-facing interfaces such as Dask, the facility also manages access control through single-sign-on and authentication & authorization for data access. The notebooks in this repository and Coffea-casa tutorials include simple HEP analysis examples, managed interactively in a Jupyter notebook and scheduled on Dask workers and accessing both public and protected data.

Contact us

Interested? You can reach us in Github Discussions or in IRIS-HEP Slack channel.

Docker images used for Coffea-casa

Latest DockerHub Images:

Image Description Size Pulls Version Layers
coffea-casa Dask scheduler image for coffea-casa hub
coffea-casa-analysis Dask worker image for coffea-casa hub

Image tagging and "continuous building"

This repository uses GitHub Actions to build images, run tests, and push images to DockerHub (Docker image tags are syncronised with Coffea-casa releases).

  1. Tags pushed to GitHub represent "production" releases with corresponding tags on dockerhub coffeateam/coffea-casa:x.x.x and coffeateam/coffea-casa-analysis:x.x.x. The latest tag also corresponds to the most recent GitHub tag.

Please note we are using date-based versioning for Coffea-casa Docker images and Pypi module.

References

  • Coffea-casa: an analysis facility prototype, M. Adamec, G. Attebury, K. Bloom, B. Bockelman, C. Lundstedt, O. Shadura and J. Thiltges, arXiv 2103.01871 (02 Mar 2021).
  • PyHEP 2020 coffea-casa proceedings: DOI
  • The PyHEP 2020 introductory Youtube video is here.

Metadata

Release files for coffea-casa 2021.3.post31

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for coffea-casa 2021.3.post31
File Size Uploaded
coffea_casa-2021.3.post31.tar.gz 24.9 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for coffea-casa 2021.3.post31
File Interpreter ABI Platform
coffea_casa-2021.3.post31-py2.py3-none-any.whl Python 2, Python 3 none any Details

Total release size: 34.1 kB

Release files / coffea_casa-2021.3.post31.tar.gz

Download URL coffea_casa-2021.3.post31.tar.gz
Size 24.9 kB
Tags Source
SHA-256 checksum
How to use checksums
c04c12860a6966b74dc5ea013a075a83770c6731eb34c7585873d05b0170a1a0
BLAKE2b-256 checksum
How to use checksums
b423f3f64c5cec4103bceccebe38c1e997d19e7f76589eede7e784c9b267c897
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.1 importlib_metadata/3.10.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.9.2

Release files / coffea_casa-2021.3.post31-py2.py3-none-any.whl

Download URL coffea_casa-2021.3.post31-py2.py3-none-any.whl
Size 9.2 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
aa5464814ad548b464662af87efb8e4e2b48a916725a7d3d0fb579c6f41e5e6d
BLAKE2b-256 checksum
How to use checksums
586d5e292ea1fe659b73b52ba8070908787009a08af0c626a9023d4ba567acc2
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.1 importlib_metadata/3.10.0 pkginfo/1.7.0 requests/2.25.1 requests-toolbelt/0.9.1 tqdm/4.59.0 CPython/3.9.2

Release history Release notifications | RSS feed

This release

2021.3.post31 This release

2 release files

0.0.3

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page