Batch execution engine built on celery.
A flexible, simple script execution engine that integrates with the Girder data management system to run distributed batch jobs.
The worker supports running tasks in many environments including Python, R, Scala, PySpark, Julia, and Docker, and supports fetching and pushing data to and from various data sources, including Girder.
Visit the documentation for more details and API documentation.
For questions, comments, or to get in touch with the maintainers, head to our Gitter Forum.
We’d love for you to contribute to Girder Worker.