Skip to main content

Quality Pipeline, subsystem of DPPS-CTAO

Project description

QualPipe

QualPipe is a Python-based automation tool for the CTAO data quality evaluations. It leverages the ctapipe library to process telescope monitoring data and applies configurable quality criteria to ensure that the collected data meets desired standards.

Features

  • Define and apply quality checks to monitoring data based on configuration files.
  • Modular and extensible framework for describing and validating data.
  • Supports processing with telescope-specific criteria.
  • YAML configuration for easy adaptability.

Installation instructions

The package is under active development. To install QualPipe package we recommend to create and activate an isolated virtual environment with Python >= 3.10 and ctapipe. This can be achieved via conda or mamba commands:

mamba create -n qualpipe -c conda-forge python==3.12 ctapipe
mamba activate qualpipe

Next, follow the installation instructions for users or for developers.

Installation for users

QualPipe has not been published on PyPi yet, but it can be installed using pip:

pip install git+https://gitlab.cta-observatory.org/cta-computing/dpps/qualpipe/qualpipe

Installation for developers

First, clone the source code from GitLab:

git clone https://gitlab.cta-observatory.org/cta-computing/dpps/qualpipe/qualpipe.git
cd qualpipe

Then perform an editable installation with pip to include documentation and testing dependencies:

pip install -e .[all]

We are using pre-commit, code-spell and ruff tools for automatic adherence to the code style. To enforce running these tools whenever you make a commit, setup the pre-commit hook executing:

pre-commit install

The pre-commit hook will then execute the tools with the same settings as when a merge request is checked on GitLab, and if any problems are reported the commit will be rejected. You then have to fix the reported issues before tying to commit again.

License

This project is licensed under the BSD 3-Clause License. See the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ctao_qualpipe-0.3.0.tar.gz (99.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ctao_qualpipe-0.3.0-py3-none-any.whl (86.4 kB view details)

Uploaded Python 3

File details

Details for the file ctao_qualpipe-0.3.0.tar.gz.

File metadata

  • Download URL: ctao_qualpipe-0.3.0.tar.gz
  • Upload date:
  • Size: 99.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.2.0 CPython/3.12.11

File hashes

Hashes for ctao_qualpipe-0.3.0.tar.gz
Algorithm Hash digest
SHA256 c4c38c8628075d454e2389503e2507c6ff20dc32bfa228518527dd5c1ad28830
MD5 0c4c853b42a35e3e7cceb502c514486a
BLAKE2b-256 f7dab94ddef956e8055fe8f6d85dad9af087ca78431b4e241294ddce34c7efc9

See more details on using hashes here.

File details

Details for the file ctao_qualpipe-0.3.0-py3-none-any.whl.

File metadata

  • Download URL: ctao_qualpipe-0.3.0-py3-none-any.whl
  • Upload date:
  • Size: 86.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.2.0 CPython/3.12.11

File hashes

Hashes for ctao_qualpipe-0.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 f1c865fcd779aa9e43b32676f9bd1b23d5fd3a255e4f9be9fb611bc2f1ca9e3f
MD5 082df9e6a42602ed892a2c309fe6db49
BLAKE2b-256 dffb8e04c7784fc555b20031bd697839d99f69703ab9f9fbfd7e39e7649a0a0b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page