Code that is used by the DKIST Science Data Processing Airflow pipelines to process VBI data.
Project description
Overview
The dkist-processing-vbi library contains the implementation of the vbi pipelines as a collection of the dkist-processing-core framework and dkist-processing-common Tasks.
The recommended project structure is to separate tasks and workflows into seperate packages. Having the workflows in their own package facilitates using the build_utils to test the integrity of those workflows in the unit test. example
Build
Artifacts are built through bitbucket pipelines
The pipeline can be used in other repos with a modification of the package and artifact locations to use the names relevant to the target repo.
e.g. dkist-processing-test -> dkist-processing-vbi and dkist_processing_test -> dkist_processing_vbi
Deployment
Deployment is done with turtlebot and follows the process detailed in dkist-processing-core
Environment Variables
Only those specified by dkist-processing-core and dkist-processing-common.
Development
git clone git@bitbucket.org:dkistdc/dkist-processing-vbi.git
cd dkist-processing-vbi
pre-commit install
pip install -e .[test]
pytest -v --cov dkist_processing_vbi
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for dkist_processing_vbi-0.3.3.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 226c2a6d428fc7eda870aec8456e4da655f09ffecf324f9a2fcb1919c79bcfb3 |
|
MD5 | cce8ca1405e7576164d0d11efaedd829 |
|
BLAKE2b-256 | f370eaef370bdbe70d43a22c667907dd47cc83d7ebf389a333fa07d6df887ab3 |