Skip to main content

A utility class to run plumbum commands concurrently

Project description

Fire and forget Multiple Commands

import plumbum as pb
from pb_job_manager import PBJobManager
pbjm = PBJobManager(max_procs=4)
pbjm.add_job(pb.cmd.grep["foo", "input.txt"] | pb.cmd.sort > "foo.txt")
pbjm.add_job(pb.cmd.grep["bar", "input.txt"] | pb.cmd.sort > "bar.txt")
pbjm.add_job(pb.cmd.grep["baz", "input.txt"] | pb.cmd.sort > "baz.txt")   # run until all jobs are finished

Creating Jobs with Callbacks

TODO: Example

Jobs with dependencies

TODO: Example

Result Iteration

TODO: Example

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
pb_job_manager-0.2.2-py2.py3-none-any.whl (5.5 kB) Copy SHA256 hash SHA256 Wheel 2.7
pb_job_manager-0.2.2.tar.gz (3.8 kB) Copy SHA256 hash SHA256 Source None

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page