Skip to main content

A WDL toolkit with a focus on ETL and Cloud integration

Project description

WDL-kit

A WDL toolkit with a focus on ETL and Cloud integration

WDL-kit is a collection of dockerized utilities to simplify the creation of ETL-like workflows in the Workflow Definition Language.

Features

  • YAML-to-WDL

    Converts .yaml files into .wdl tasks. This is primarily a workaround for the WDL language not supporting multi-line strings, which is problematic for SQL ETL workflows.

  • Google Cloud

    Wrappers for BigQuery, Google Cloud Storage, etc.

  • Slack

    Wrapper for sending Slack messages

  • MailGun

    Wrapper for sending mail via MailGun

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

stanford-wdl-kit-1.6.1.tar.gz (22.2 kB view hashes)

Uploaded Source

Built Distribution

stanford_wdl_kit-1.6.1-py3-none-any.whl (26.0 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page