Skip to main content

No project description provided

Project description

Soopervisor

CI badge

Soopervisor is a command line utility to execute Ploomber-compatible projects.

Installation

pip install soopervisor

Usage

For its simplest usage, soopervisor expects a project with a pipeline.yaml file, outputs saved in an output/ directory and dependencies declared in an environment.yml file

To execute a project:

soopervisor build

Unlike ploomber build, soopervisor build creates the environment first, and then executes the pipeline (using ploomber build). This ensures dependency installation is part of the reproducibility process. But it offers much more than just installing dependencies.

Configuration

An optional soopervisor.yaml file allows you to customize the build process.

Using Soopervisor for Continuous Integration

[WIP]

Github action

[WIP]

Development

Once you cloned the repo:

pip install --editable ".[dev]"

To run tests:

pytest

CHANGELOG

0.2 (2020-10-15)

  • Adds DockerExecutor

  • Products are saved in a folder with the name of the current commit by default

  • Conda environments are created locally in a .soopervisor/ folder

  • Conda environments are cached by default

  • Ability to customize arguments to ploomber build

0.1 (2020-08-09)

  • First release

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

soopervisor-0.2.tar.gz (11.3 kB view hashes)

Uploaded Source

Built Distribution

soopervisor-0.2-py3-none-any.whl (13.9 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page