wurker 0.1.25

The superpowered love child of cron and supervisor.

If cron and supervisor had a love child.

• Schedule and supervise jobs using internal Python modules, or external scripts and commands.
• Schedule on-demand jobs to run once. Or run jobs from the command-line.
• Configure and manage jobs from the command-line, via API, or using the web app UI.

An experimental fork of Wurkzen Wurker.

Version

0.1.25

Documentation

Complete documentation is available in this repository:

• Web Site: Wurker Docs
• Local: Local Documentation
• On GitLab: README.org

Development

Starting at version 0.1.0, Wurker development began to focus on PyPi packaging. To enable easier packaging for distribution, we began to use the Hatch project manager. Follow the following instructions to install pipx and hatch on your development environment:

• Install hatch

Next, install system dependencies, as documented in the full Wurker Documentation.

After hatch and all system dependencies are successfully installed, cd into the wurker-hatch directory and do:

hatch env create
hatch shell

History

It kinda IS rocket science to make a robust, reliable scheduler, that also supervises jobs and lets you run jobs on-demand. In the history DevOps, there are a multitude of solutions for similar problems.

This is (another) one of them.

The first incarnation of this project was stupid. It let you run interval jobs in either sub-processes or threads. That was disastrous. The next iteration just implemented APScheduler and had done. It was a good fit for the project.

The most recent iteration of Wurker was a proprietary CIELO project called "Jobber", which at first was only a scheduler, but over the course of half a decade evolved to also replace the use of cron and supervisor. We had need of both facilities – scheduled and supervised – and it was a lot of work to maintain proper configuration and even harder to find out what went wrong. Jobber was a toy in comparison to Wurker, but it ran under heavy load for half a decade with lots of love from CIELO devops.

Wurker was developed by Joseph Edwards in his role as a founder of Wurkzen, Inc., which agreed to release the project under an MIT open-source license.

The current version, Wurker Hatchery, is a major upgrade focusing on PyPI packaging using the Hatch project manager. The repository has been moved to: wurker-hatch on GitLab

Authors

All of the people who have contributed code to Wurker Hatchery or Wurkzen Wurker:

• Joseph Edwards VIII (maintainer)
• Mehul Savaliya
• Jose Sieres
• Rick Cabrera

License

Licensed under MIT license.