Skip to main content

A Python DSL for bioinformatics pipelines

Project description

A Python DSL for pipelines

Don't Repeat Yourself (D.R.Y) while writing pipelines, and stay away from leaky abstractions, use DryPipe !

What is a pipeline ?

A pipeline could be described as "a bunch of programs feeding data to one another".

Programs within a pipeline tend to:

  1. run for a long time
  2. need large amounts of resources (cpu, memory, disk space, etc), requiring clusters to run (Slurm, Torque,etc)
  3. be written in different languaged, have different CLI interfaces, file formats, etc.
  4. long CODE->RUN->DEBUG->CODE cycles

The length of the development cycle makes pipelines difficult to debug.

https://drypipe.readthedocs.io/

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dry_pipe-0.8.0.tar.gz (74.7 kB view hashes)

Uploaded Source

Built Distribution

dry_pipe-0.8.0-py3-none-any.whl (70.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page