Skip to main content

SwarmForm

SwarmForm is a distributed workflow management system for High Performance Computing environments. SwarmForm introduces task clustering to reduce the makespan of workflows executed using it by minimizing the overheads. SwarmForm follows a distributed architecture with independent programs controlling different functional layers in workflow management.

Getting Started

These instructions will get you familiar with the installation and basic functions of the SwarmForm.

_Prerequisites_

Following prerequisites should be installed to run SwarmForm.

  • MongoDB

  • Python 3.3+

  • pip

_Installation_

To install SwarmForm, simply type

` pip install SwarmForm `

_Basic Usage_

Following is a step by step series of examples that tell you how to use the basic system functions.

  • Initialize a SwarmForm launchpad YAML file

` sform init `

  • Insert a SwarmFlow from file

` sform add -sf <file path> `

  • Get SwarmFlow from SwarmPad

` sform get_sf -id <SwarmFlow ID> `

  • Cluster the fireworks in the SwarmFlow and save the new SwarmFlow to the database

` sform cluster -sf <SwarmFlow ID> ` or

` sform cluster -sf <SwarmFlow ID> -a <clustering algorithm rac/wpa> -cc <cluster count> `

  • Reset and re-initialize the SwarmForm database

` sform reset `

Built With

Authors

Publication

A. Weerasinghe, K. Wijethunga, R. Jayasekara, I. Perera and A. Wickramarachchi, “SwarmForm: A Distributed Workflow Management System with Task Clustering”, in 20th International Conference on Advances in ICT for Emerging Regions, Colombo, Sri Lanka, 2020.

Copyright 2021 © SwarmForm.

Release files for SwarmForm 1.0.2

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for SwarmForm 1.0.2
File Size Uploaded
SwarmForm-1.0.2.tar.gz 20.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for SwarmForm 1.0.2
File Interpreter ABI Platform
SwarmForm-1.0.2-py3-none-any.whl Python 3 none any Details

Total release size: 49.8 kB

Release files / SwarmForm-1.0.2.tar.gz

Download URL SwarmForm-1.0.2.tar.gz
Size 20.4 kB
Tags Source
SHA-256 checksum
How to use checksums
f629d4e96a669b60ea0c6c846fd04f7678b43a58cdb4f95159329149d2235409
BLAKE2b-256 checksum
How to use checksums
7f55b2463e5cd408acc4bfcc201ebdf05c028bd7c5848393a8bbef0a43c78721
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.3.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/51.1.2 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.4

Release files / SwarmForm-1.0.2-py3-none-any.whl

Download URL SwarmForm-1.0.2-py3-none-any.whl
Size 29.4 kB
Tags Python 3
SHA-256 checksum
How to use checksums
a584ef8f2d18c59c1887d08c70ac27761856eade54e13c102eebd5f5d463725f
BLAKE2b-256 checksum
How to use checksums
a078c92a4304e3a95547bf39ec5bf2a717ad4fc3270dc87620bbb8ca0203a4aa
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.3.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/51.1.2 requests-toolbelt/0.9.1 tqdm/4.36.1 CPython/3.7.4

Release history Release notifications | RSS feed

This release

1.0.2 This release

2 release files

1.0.1

2 release files

1.0.0

3 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page