Skip to main content

StreamFlow framework

Project description

StreamFlow

Build Status

The StreamFlow framework is a container-native Workflow Management System (WMS) written in Python 3. It has been designed around two main principles:

  • Allow the execution of tasks in multi-container environments, in order to support concurrent execution of multiple communicating tasks in a multi-agent ecosystem.
  • Relax the requirement of a single shared data space, in order to allow for hybrid workflow executions on top of multi-cloud or hybrid cloud/HPC infrastructures.

Use StreamFlow

The StreamFlow module is available on PyPI, so you can install it using pip.

pip install streamflow

Please note that StreamFlow requires python >= 3.7. Then you can execute it directly from the CLI

streamflow /path/to/streamflow.yml

Contribute to StreamFlow

StreamFlow uses pipenv to guarantee deterministic builds. Therefore, the recommended way to manage dependencies is by means of the pipenv command.

As a first step, get StreamFlow from GitHub

git clone git@github.com:alpha-unito/streamflow.git

Then you can install all the requred packages using the pipenv command

pip install --user pipenv
cd streamflow
pipenv install

Finally, you can run StreamFlow in the generated virtual environment

pipenv run python -m streamflow

StreamFlow relies on Travis CI for PyPI distribution. Therefore, in order to publish a new version of the package on PyPI, you only have to augment the version number in setup.py file.

StreamFlow Team

Iacopo Colonnelli iacopo.colonnelli@unito.it (creator and maintainer)
Barbara Cantalupo barbara.cantalupo@unito.it (maintainer)
Marco Aldinucci aldinuc@di.unito.it (maintainer)

Project details


Release history Release notifications

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for streamflow, version 0.0.11
Filename, size File type Python version Upload date Hashes
Filename, size streamflow-0.0.11-py2.py3-none-any.whl (36.1 kB) File type Wheel Python version py2.py3 Upload date Hashes View hashes
Filename, size streamflow-0.0.11.tar.gz (24.6 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page