Icolos Workflow Manager
Project description
Icolos
: Workflow manager
The Icolos
tool is a workflow manager for structure-based workflows in computational chemistry, that abstracts execution logic from implementation as much as possible. Icolos was designed to interface with REINVENT, and workflows can be called as a component of the scoring function, or to postprocess results with more expensive methods. Workflows are specified in JSON
format (see folder examples
). Currently wrapped are a diverse set of tools and internal steps, including docking, QM and MD capabilities. The pre-print is available here.
Introduction
Icolos
provides a unified interface to a host of software for common computational chemistry calculations, with built in parallelization,
and straight-forward extensibiltiy to add additional functionality. It was principally developed to handle structural calculations for REINVENT
jobs, however, workflows can also be run independently.
Workflows are constructed from elementary 'steps', individual blocks which are combined to specify a sequential list of operations, with control of the command-line options provided through step settings, and options to control other aspects of the step's behaviour included in the additional
block.
For many use cases, one of the template workflows might suit your needs, or need a few tweaks to do what you want. Demonstration notebooks for common workflows are available here.
Initial configuration
You are welcome to clone the repository and use a local version, and in particular if you would like to experiment with the code base and/or contribute features, please get in contact with us.
Installation
After cloning, first install and activate the icolosprod
conda
environment. To ensure the right installation directory is used, you can add the --prefix
parameter to the create
call, specifying the location of the conda
environments.
conda env create -f environment_min.yml
conda activate icolosprod
Then install the package:
pip install -e .
This will give you access to the icolos
entrypoint.
ESPsim
installation
The following will install the ESPsim
package into the environment - this is only required if ligand-based matching using this package is desired.
cd ..
git clone https://github.com/hesther/espsim.git
cd espsim
conda activate icolosprod
pip install -e .
Unit testing
Icolos is extensively unit tested, and relies on an external data repo located here. The full test suite takes ~60 mins on a workstation, therefore it is recommended that you execute a subset of unit tests relevant to the workflow you are running. To execute the full test suite, run something like:
pytest -n 8 tests/
Execution
Once a JSON
is specified, the workflow can be executed like so:
conda activate icolosprod
icolos -conf workflow.json
We usually advise to check the validity of your configuration file before you try to execute it. There is a bespoke validator
entry point to facilitate this:
validator -conf workflow.json
SLURM
Execution
Once specified, a workflow can be called like this in a bash
script:
#!/bin/bash -l
#SBATCH -N 1
#SBATCH -t 0-02:59:00
#SBATCH -p core
#SBATCH --ntasks-per-node=5
#SBATCH --mem-per-cpu=2G
source /<conda_path>/miniconda3/bin/activate /<conda_path>/minconda3/envs/icolosprod
icolos -conf workflow.json
For GROMACS workflows requiring the GPU partition, you will need to adapt the header accordingly, e.g. like so:
#!/bin/bash
#SBATCH -J gmx_cco1_fold_microsecond
#SBATCH -o MygpuJob_out_%j.txt
#SBATCH -e MygpuJob_err_%j.txt
#SBATCH -c 8
#SBATCH --gres=gpu:1
#SBATCH --mem-per-cpu=4g
#SBATCH -p gpu
#SBATCH --time=12:00:00
Developers
- Christian Margreitter @cmargreitter
- J. Harry Moore @jharrymoore
- Matthias R. Bauer mattias.r.b@gmail.com
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file icolos-1.10.0.tar.gz
.
File metadata
- Download URL: icolos-1.10.0.tar.gz
- Upload date:
- Size: 226.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 1ce44320ad395bcc745c918c69683e244ca973983ac33424727b5e0148b08c7c |
|
MD5 | e57d659c476b459894536a71d17509a3 |
|
BLAKE2b-256 | 930d7208da144a6d00c00687de48d44371d539c9ac845043d6cac40bf87401f2 |
File details
Details for the file icolos-1.10.0-py3-none-any.whl
.
File metadata
- Download URL: icolos-1.10.0-py3-none-any.whl
- Upload date:
- Size: 358.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 42258748d799dec09b64f021c94d45954c56af9e441469d8551e9b7fa79fa8b1 |
|
MD5 | edd2762b8fbfbd4bb51a718a5e847d18 |
|
BLAKE2b-256 | f18d71a371a9b13d2e5e3868c5073e77719f674ad0b154ec1ae4ad375ae10a7c |