Skip to main content

A Prototype U.S. CMS analysis facility

Project description

coffea-casa - A Prototype U.S. CMS analysis facility for Columnar Object Framework For Effective Analysis

CI/CD status GitHub issues GitHub pull requests Documentation Status

Latest DockerHub Images: https://hub.docker.com/orgs/coffeateam/repositories

Image Description Size Pulls Version Layers
coffea-casa Dask scheduler image for coffea-casa hub
coffea-casa-analysis Dask worker image for coffea-casa hub

About

The prototype analysis facility provides services for “low latency columnar analysis”, enabling rapid processing of data in a column-wise fashion. These services, based on Dask and Jupyter notebooks, aim to dramatically lower time for analysis and provide an easily-scalable and user-friendly computational environment that will simplify, facilitate, and accelerate the delivery of HEP results. The facility is built on top of a Kubernetes cluster and integrates dedicated resources with resources allocated via fairshare through the local HTCondor system. In addition to the user-facing interfaces such as Dask, the facility also manages access control through single-sign-on and authentication & authorization for data access. The notebooks in this repository and Coffea-casa tutorials include simple HEP analysis examples, managed interactively in a Jupyter notebook and scheduled on Dask workers and accessing both public and protected data.

Image tagging and "continuous building"

This repository uses GitHub Actions to build images, run tests, and push images to DockerHub.

  1. Tags pushed to GitHub represent "production" releases with corresponding tags on dockerhub coffeateam/coffea-casa:x.x.x and coffeateam/coffea-casa-analysis:x.x.x. The latest tag also corresponds to the most recent GitHub tag.

References

The PyHEP introductory Youtube video is here.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

coffea_casa-2021.3.dev24.tar.gz (24.1 kB view hashes)

Uploaded Source

Built Distribution

coffea_casa-2021.3.dev24-py2.py3-none-any.whl (8.6 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page