Gearman Task Server
Project description
gmtasks contains a simple multiprocessing server for Gearman workers, designed for ease of configuration and maximum availability. It includes a task wrapper class that traps any interrupts or exceptions that might be thrown by your task methods, and attempts to make sure that the affected job is re-inserted into the queue (which is not the default behavior if the worker script exits abnormally)
Please see the full documentation for more detailed information.
Sample usage
from multiprocessing import freeze_support from gmtasks.jsonclass import GearmanWorker from gmtasks import GearmanTaskServer, Task # Jobs def job1(worker, job): return job.data['string1'] def job2(worker, job): return job.data['string2'] def job3(worker, job): return job.data['string3'] # Main loop if __name__ == '__main__': # Need this to run in Windows freeze_support() # Import all of the jobs we handle tasks = [ Task('job1', job1), {'task': 'job2', 'callback': job2}, ['job3', job3], ] # Initialize the server server = GearmanTaskServer( host_list = ['localhost:4730'], tasks = tasks, max_workers = None, # Defaults to multiprocessing.cpu_count() id_prefix = 'myworker.', worker_class = GearmanWorker, use_sighandler = True, # SIGINT and SIGTERM send KeyboardInterrupt verbose = True, # log.info() and log.error() messages ) # Run the loop server.serve_forever()
Download
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gmtasks-0.4.tar.gz
(6.2 kB
view details)
File details
Details for the file gmtasks-0.4.tar.gz
.
File metadata
- Download URL: gmtasks-0.4.tar.gz
- Upload date:
- Size: 6.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6c5d389ff9bed4ae54d3435cfc1c64803862f936629418b1f0239a3cf417074d |
|
MD5 | 0eb0ba4a213f3a83fe8f06a57ebaf394 |
|
BLAKE2b-256 | 57692c66bd32adcf444730f5cf67863bdd1c6e7988e36e07757f861e00afa2b1 |