Skip to main content

Coffea-casa - A Prototype of an Analysis Facility for Columnar Object Framework For Effective Analysis

Actions Status Documentation Status Code style: black PyPI version PyPI platforms GitHub Discussion GitHub issues GitHub pull requests

About Coffea-casa

The prototype analysis facility provides services for “low latency columnar analysis”, enabling rapid processing of data in a column-wise fashion. These services, based on Dask and Jupyter notebooks, aim to dramatically lower time for analysis and provide an easily-scalable and user-friendly computational environment that will simplify, facilitate, and accelerate the delivery of HEP results. The facility is built on top of a Kubernetes cluster and integrates dedicated resources with resources allocated via fairshare through the local HTCondor system. In addition to the user-facing interfaces such as Dask, the facility also manages access control through single-sign-on and authentication & authorization for data access. The notebooks in this repository and Coffea-casa tutorials include simple HEP analysis examples, managed interactively in a Jupyter notebook and scheduled on Dask workers and accessing both public and protected data.

Analysis repositories using coffea-casa

  • Commissioning studies in the BTV POG based on (custom) nanoAOD samples
  • SUEP Coffea Dask - Repository for SUEP using fastjet with awkward input from PFnano nanoAOD samples
  • Tools for running the CMS Higgs to Two Photons Analysis on NanoAOD

Docker images used for Coffea-casa

Latest DockerHub Images:

Image Description Size Pulls Version
coffea-casa Dask scheduler image for coffea-casa hub
coffea-casa-analysis Dask worker image for coffea-casa hub

Helm charts, coffea_casa package and Docker image tags

This repository uses GitHub Actions to build images, run tests, and push charts, python package to PyPI and images to DockerHub (Docker images, charts and python package tags are syncronised with Coffea-casa releases).

  1. Tags pushed to GitHub trigger Docker image published with corresponding tags on Dockerhub: coffeateam/coffea-casa:x.x.x and coffeateam/coffea-casa-analysis:x.x.x. Tags pushed to GitHub as well trigger Docker image published with corresponding tags on Openscience Harbor Registry: hub.opensciencegrid.org/coffea-casa:x.x.x and hub.opensciencegrid.org/coffea-casa-analysis:x.x.x. The latest tag in both cases also corresponds to the most recent GitHub tag.

  2. Tags pushed to GitHub trigger Helm charts releases with corresponding Helm Chart tag and with charts published to https://coffeateam.github.io/coffea-casa.

  3. Tags pushed to GitHub will push coffea_casa python package to PyPI (same as a tag).

How to tag

A list of "must" steps to do before to tag:

  1. Tag Docker images coffeateam/coffea-casa:x.x.x and coffeateam/coffea-casa-analysis:x.x.x changing $TAG value in https://github.com/CoffeaTeam/coffea-casa/blob/master/docker/coffea-casa/Dockerfile and https://github.com/CoffeaTeam/coffea-casa/blob/master/docker/coffea-casa-analysis/Dockerfile

  2. Tag Helm Chart's changing $appVersion value in Charts.yaml file in see https://github.com/CoffeaTeam/coffea-casa/blob/master/charts/coffea-casa/Chart.yaml

  3. Add new tag: https://github.com/CoffeaTeam/coffea-casa/releases

Please note we are using date-based versioning for Coffea-casa Docker images, Helm charts and Pypi module.

References

  • Coffea-casa: an analysis facility prototype, M. Adamec, G. Attebury, K. Bloom, B. Bockelman, C. Lundstedt, O. Shadura and J. Thiltges, arXiv 2103.01871 (02 Mar 2021).
  • PyHEP 2020 coffea-casa proceedings: DOI
  • The PyHEP 2020 introductory Youtube video is here.

Contact us

Interested? You can reach us in Github Discussions or in IRIS-HEP Slack channel.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

coffea_casa-2026.7.10.tar.gz (8.4 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

coffea_casa-2026.7.10-py3-none-any.whl (14.9 kB view details)

Uploaded Python 3

File details

Details for the file coffea_casa-2026.7.10.tar.gz.

File metadata

  • Download URL: coffea_casa-2026.7.10.tar.gz
  • Upload date:
  • Size: 8.4 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for coffea_casa-2026.7.10.tar.gz
Algorithm Hash digest
SHA256 7b58205978d4c24a243d8ec3699777f9ba21207ce8bedc59873db22c43384e43
MD5 ee6f289c92a808341f9fe9f0cf62b885
BLAKE2b-256 692f9b973f404b70382ef0abb8935824474eee1a1272f8a5774ae6f92f93dd32

See more details on using hashes here.

Provenance

The following attestation bundles were made for coffea_casa-2026.7.10.tar.gz:

Publisher: pypi-tag-deploy.yml on CoffeaTeam/coffea-casa

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file coffea_casa-2026.7.10-py3-none-any.whl.

File metadata

  • Download URL: coffea_casa-2026.7.10-py3-none-any.whl
  • Upload date:
  • Size: 14.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.12

File hashes

Hashes for coffea_casa-2026.7.10-py3-none-any.whl
Algorithm Hash digest
SHA256 ae9efa02aa7fbee166179fecbb77073b85ce9c23801bb9210d2e131af2df47b6
MD5 109612db7ec5db4bf95b36ad2d9d8fe9
BLAKE2b-256 d918108ab9bb070e00b669dd14b9a1c9c1a123996eb78d6970b1eda147161f5e

See more details on using hashes here.

Provenance

The following attestation bundles were made for coffea_casa-2026.7.10-py3-none-any.whl:

Publisher: pypi-tag-deploy.yml on CoffeaTeam/coffea-casa

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page