Skip to main content

Run bash commands with python multiprocessing according to a csv file edgelist.

Project description

workforce

https://img.shields.io/pypi/v/workforce.svg https://img.shields.io/travis/theoportlock/workforce.svg Documentation Status

Build and run a pipeline of bash commands with python multiprocessing according to a tsv file edgelist.

Installation

Installation can be done with:

pip install workforce

Building a workforce workflow

To launch the pipeline builder, run:

workforce

To open a previously constructed pipeline, run:

workforce <PIPELINE.tsv>

Running workforce

To run a sample plan from workforce github project:

workforce -r example_plan.tsv

To run individual process(es) from the builder, select the process(es) in the order that you wish them to be excecuted and click the ‘Run’ button. The command line from where the builder was launched will display the standard output and error for each process.

Deleting processes from the project can be done by selecting a process and clicking the ‘Delete’ button

The simplest way to edit a process is to click the edge that the process is connected to. This will fill the ‘Input’ box with the connection details. You can then add a new node with those connections and delete the old process.

To import and use in a python shell, use the following command:

from workforce.workforce import worker
worker("<PLAN.CSV>")

The schema should be in the format of a tsv with two columns. On the left and right column is the source and target process respectively (see example).

This is tested on mac and linux but requires work for windows integration except for wsl2

History

0.1.0 (2021-01-16)

  • First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

workforce-1.0.12.tar.gz (11.1 kB view details)

Uploaded Source

Built Distribution

workforce-1.0.12-py3-none-any.whl (7.6 kB view details)

Uploaded Python 3

File details

Details for the file workforce-1.0.12.tar.gz.

File metadata

  • Download URL: workforce-1.0.12.tar.gz
  • Upload date:
  • Size: 11.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.9.19

File hashes

Hashes for workforce-1.0.12.tar.gz
Algorithm Hash digest
SHA256 74a8a9eca956829cbb238ea814fc83f12de2f8677cb86a2de087ec68f8109c7a
MD5 bd111cb7b3a2213388d49fa60b911323
BLAKE2b-256 237c81d6b9a35f1ae225b9730e66da067a30308ec9d06ed867879c3c09f4a855

See more details on using hashes here.

File details

Details for the file workforce-1.0.12-py3-none-any.whl.

File metadata

  • Download URL: workforce-1.0.12-py3-none-any.whl
  • Upload date:
  • Size: 7.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.0.0 CPython/3.9.19

File hashes

Hashes for workforce-1.0.12-py3-none-any.whl
Algorithm Hash digest
SHA256 732080da68e988273e172ceb4817b86d6a18b3b6f6fd8b30564fe003740c0d40
MD5 25a441aa13dab7736d88157e116235fd
BLAKE2b-256 aaaea1f4056fb4d7f6843bcbf400ed3a2779b758982ac6a3670cc431119b9513

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page