Skip to main content

ESRF Workflow System

Project description

Ewoks: ESRF Workflow System

Many workflow management systems exist to deal with data processing problems that can be expressed as a graph of tasks, also referred to as a computational graph or workflow. The main purpose of a workflow management system is to provide a framework for implementing tasks, creating graphs of tasks and executing these graphs.

The purpose of ewoks is to provide an abstraction layer between graph representation and execution. This allows using the same tasks and graphs in different workflow management systems. ewoks itself is not a workflow management system.

Install

python -m pip install ewoks[orange,dask,ppf,test]

Test

pytest --pyargs ewoks.tests

Getting started

Workflows can be loaded and executed from the command line

ewoks execute /path/to/graph.json [--binding dask]

or from python

from ewoks import execute_graph

result = execute_graph("/path/to/graph.json", binding="dask")

When no binding is specified it will use sequential execution from ewokscore.

Documentation

https://workflow.gitlab-pages.esrf.fr/ewoks/ewoks

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ewoks-0.0.5a1.tar.gz (5.1 kB view hashes)

Uploaded source

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page