soopervisor 0.2

No project description provided

Soopervisor

Soopervisor is a command line utility to execute Ploomber-compatible projects.

Installation

pip install soopervisor

Usage

For its simplest usage, soopervisor expects a project with a pipeline.yaml file, outputs saved in an output/ directory and dependencies declared in an environment.yml file

To execute a project:

soopervisor build

Unlike ploomber build, soopervisor build creates the environment first, and then executes the pipeline (using ploomber build). This ensures dependency installation is part of the reproducibility process. But it offers much more than just installing dependencies.

Configuration

An optional soopervisor.yaml file allows you to customize the build process.

Using Soopervisor for Continuous Integration

[WIP]

Github action

[WIP]

Development

Once you cloned the repo:

pip install --editable ".[dev]"

To run tests:

pytest

CHANGELOG

0.2 (2020-10-15)

• Adds DockerExecutor

• Products are saved in a folder with the name of the current commit by default

• Conda environments are created locally in a .soopervisor/ folder

• Conda environments are cached by default

• Ability to customize arguments to ploomber build

0.1 (2020-08-09)

• First release