A simple JIT job management framework in Python.
Custodian is a simple, robust and flexible just-in-time (JIT) job management framework written in Python. Using custodian, you can create wrappers that perform error checking, job management and error recovery. It has a simple plugin framework that allows you to develop specific job management workflows for different applications.
The specific use case for custodian is for long running jobs, with potentially random errors. For example, there may be a script that takes several days to run on a server, with a 1% chance of some IO error causing the job to fail. Using custodian, one can develop a mechanism to gracefully recover from the error, and potentially restart the job if necessary.
Custodian is now in an very early alpha, and there may be many frequent API changes. Please use with care.
The version at the Python Package Index (PyPI) is always the latest stable release that will be hopefully, be relatively bug-free. The easiest way to install custodian on any system is to use easy_install or pip, as follows:
pip install custodian
Some plugins (e.g., vasp management) require additional setup (please see pymatgen’s documentation).
The bleeding edge developmental version is at the custodian’s Github repo. The developmental version is likely to be more buggy, but may contain new features. The Github version include test files as well for complete unit testing. After cloning the source, you can type:
python setup.py install
or to install the package in developmental mode:
python setup.py develop
Custodian requires Python 2.7+. There are no other required dependencies.
Optional libraries that are required if you need certain features:
- pymatgen 2.5+: To use the plugin for VASP.
- nose - For complete unittesting.
The main class in the workflow is known as Custodian, which manages a series of jobs with a list of error handlers. To use custodian, you need to implement concrete implementation of the abstract base classes custodian.custodian.Job and custodian.custodian.ErrorHandler. An very simple example implementation is given in the examples.py script in the scripts directory.
Other specific examples for electronic structure calculations based on the Vienna Ab Initio Simulation Package (VASP) are implemented in the custodian.vasp package. A simple example of a script using Custodian to run a two-relaxation VASP job is as follows:
from custodian.custodian import Custodian from custodian.vasp.handlers import VaspErrorHandler, UnconvergedErrorHandler from custodian.vasp.jobs import VaspJob handlers = [VaspErrorHandler(), UnconvergedErrorHandler(), PoscarErrorHandler()] jobs = VaspJob.double_relaxation_run(args.command.split()) c = Custodian(handlers, jobs, max_errors=10) c.run()
Release history Release notifications
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|Filename, size & hash SHA256 hash help||File type||Python version||Upload date|
|custodian-0.2.4a-py2.7.egg (40.4 kB) Copy SHA256 hash SHA256||Egg||2.7||Mar 19, 2013|
|custodian-0.2.4a.tar.gz (12.6 kB) Copy SHA256 hash SHA256||Source||None||Mar 19, 2013|