Skip to main content

SwarmForm Workflow Management Software

Project description

SwarmForm

SwarmForm is a distributed workflow management system for High Performance Computing environments. SwarmForm introduces task clustering to reduce the makespan of workflows executed using it by minimizing the overheads. SwarmForm follows a distributed architecture with independent programs controlling different functional layers in workflow management.

Getting Started

These instructions will get you familiar with the installation and basic functions of the SwarmForm.

_Prerequisites_

Following prerequisites should be installed to run SwarmForm.

  • MongoDB

  • Python 3.3+

  • pip

_Installation_

To install SwarmForm, simply type

` pip install SwarmForm `

_Basic Usage_

Following is a step by step series of examples that tell you how to use the basic system functions.

  • Initialize a SwarmForm launchpad YAML file

` sform init `

  • Insert a SwarmFlow from file

` sform add -sf <file path> `

  • Get SwarmFlow from SwarmPad

` sform get_sf -id <SwarmFlow ID> `

  • Cluster the fireworks in the SwarmFlow and save the new SwarmFlow to the database

` sform cluster -sf <SwarmFlow ID> ` or

` sform cluster -sf <SwarmFlow ID> -a <clustering algorithm rac/wpa> -cc <cluster count> `

  • Reset and re-initialize the SwarmForm database

` sform reset `

Built With

Authors

Publication

A. Weerasinghe, K. Wijethunga, R. Jayasekara, I. Perera and A. Wickramarachchi, “SwarmForm: A Distributed Workflow Management System with Task Clustering”, in 20th International Conference on Advances in ICT for Emerging Regions, Colombo, Sri Lanka, 2020.

Copyright 2021 © SwarmForm.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

SwarmForm-1.0.2.tar.gz (20.4 kB view hashes)

Uploaded Source

Built Distribution

SwarmForm-1.0.2-py3-none-any.whl (29.4 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page