Skip to main content

A WDL toolkit with a focus on ETL and Cloud integration

Project description

WDL-kit

A WDL toolkit with a focus on ETL and Cloud integration

WDL-kit is a collection of dockerized utilities to simplify the creation of ETL-like workflows in the Workflow Definition Language.

Features

  • YAML-to-WDL

    Converts .yaml files into .wdl tasks. This is primarily a workaround for the WDL language not supporting multi-line strings, which is problematic for SQL ETL workflows.

  • Google Cloud

    Wrappers for BigQuery, Google Cloud Storage, etc.

  • Slack

    Wrapper for sending Slack messages

  • MailGun

    Wrapper for sending mail via MailGun

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

stanford-wdl-kit-1.6.1.tar.gz (22.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

stanford_wdl_kit-1.6.1-py3-none-any.whl (26.0 kB view details)

Uploaded Python 3

File details

Details for the file stanford-wdl-kit-1.6.1.tar.gz.

File metadata

  • Download URL: stanford-wdl-kit-1.6.1.tar.gz
  • Upload date:
  • Size: 22.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.9.2

File hashes

Hashes for stanford-wdl-kit-1.6.1.tar.gz
Algorithm Hash digest
SHA256 b597ff3cf81dde01b111361d1e77d83b5cba3657ef90b4179d4d79e47590a429
MD5 27d0d29a9bef2b4019edce75cb803925
BLAKE2b-256 a6a5c13151364b9e942071da1879f42ce9ee93d2c219f7d95ff494efa0766f07

See more details on using hashes here.

File details

Details for the file stanford_wdl_kit-1.6.1-py3-none-any.whl.

File metadata

File hashes

Hashes for stanford_wdl_kit-1.6.1-py3-none-any.whl
Algorithm Hash digest
SHA256 df6ff4b10e5b20ca78c3eeced4d975b6ed54ea87ad0fb216acaf63507bf6f399
MD5 d3e7aa86425724ea060f65763d9cd3b5
BLAKE2b-256 c04533df6c5735982c6fd425bf13e6d06cf0b0159b4940466418e1c0e2f11463

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page