streamflow 0.0.12

StreamFlow framework

StreamFlow

The StreamFlow framework is a container-native Workflow Management System (WMS) written in Python 3. It has been designed around two main principles:

• Allow the execution of tasks in multi-container environments, in order to support concurrent execution of multiple communicating tasks in a multi-agent ecosystem.
• Relax the requirement of a single shared data space, in order to allow for hybrid workflow executions on top of multi-cloud or hybrid cloud/HPC infrastructures.

Use StreamFlow

The StreamFlow module is available on PyPI, so you can install it using pip.

pip install streamflow

Please note that StreamFlow requires python >= 3.7. Then you can execute it directly from the CLI

streamflow /path/to/streamflow.yml

Contribute to StreamFlow

StreamFlow uses pipenv to guarantee deterministic builds. Therefore, the recommended way to manage dependencies is by means of the pipenv command.

As a first step, get StreamFlow from GitHub

git clone [e-mail]:alpha-unito/streamflow.git

Then you can install all the requred packages using the pipenv command

pip install --user pipenv
cd streamflow
pipenv install

Finally, you can run StreamFlow in the generated virtual environment

pipenv run python -m streamflow

StreamFlow relies on Travis CI for PyPI distribution. Therefore, in order to publish a new version of the package on PyPI, you only have to augment the version number in setup.py file.

StreamFlow Team

Iacopo Colonnelli [e-mail] (creator and maintainer)
Barbara Cantalupo [e-mail] (maintainer)
Marco Aldinucci [e-mail] (maintainer)