Icolos Workflow Manager
Project description
Icolos: Workflow manager
The Icolos tool is a workflow manager for structure-based workflows in computational chemistry, that abstracts execution logic from implementation as much as possible. Icolos was designed to interface with REINVENT, and workflows can be called as a component of the scoring function, or to postprocess results with more expensive methods. Workflows are specified in JSON format (see folder examples). Currently wrapped are a diverse set of tools and internal steps, including docking, QM and MD capabilities. The pre-print is available here.
Introduction
Icolos provides a unified interface to a host of software for common computational chemistry calculations, with built in parallelization,
and straight-forward extensibiltiy to add additional functionality. It was principally developed to handle structural calculations for REINVENT jobs, however, workflows can also be run independently.
Workflows are constructed from elementary 'steps', individual blocks which are combined to specify a sequential list of operations, with control of the command-line options provided through step settings, and options to control other aspects of the step's behaviour included in the additional block.
For many use cases, one of the template workflows might suit your needs, or need a few tweaks to do what you want. Demonstration notebooks for common workflows are available here.
Initial configuration
You are welcome to clone the repository and use a local version, and in particular if you would like to experiment with the code base and/or contribute features, please get in contact with us.
Installation
After cloning, first install and activate the icolosprod conda environment. To ensure the right installation directory is used, you can add the --prefix parameter to the create call, specifying the location of the conda environments.
conda env create -f environment_min.yml
conda activate icolosprod
Then install the package:
pip install -e .
This will give you access to the icolos entrypoint.
ESPsim installation
The following will install the ESPsim package into the environment - this is only required if ligand-based matching using this package is desired.
cd ..
git clone https://github.com/hesther/espsim.git
cd espsim
conda activate icolosprod
pip install -e .
Unit testing
Icolos is extensively unit tested, and relies on an external data repo located here. The full test suite takes ~60 mins on a workstation, therefore it is recommended that you execute a subset of unit tests relevant to the workflow you are running. To execute the full test suite, run something like:
pytest -n 8 tests/
Execution
Once a JSON is specified, the workflow can be executed like so:
conda activate icolosprod
icolos -conf workflow.json
We usually advise to check the validity of your configuration file before you try to execute it. There is a bespoke validator entry point to facilitate this:
validator -conf workflow.json
SLURM Execution
Once specified, a workflow can be called like this in a bash script:
#!/bin/bash -l
#SBATCH -N 1
#SBATCH -t 0-02:59:00
#SBATCH -p core
#SBATCH --ntasks-per-node=5
#SBATCH --mem-per-cpu=2G
source /<conda_path>/miniconda3/bin/activate /<conda_path>/minconda3/envs/icolosprod
icolos -conf workflow.json
For GROMACS workflows requiring the GPU partition, you will need to adapt the header accordingly, e.g. like so:
#!/bin/bash
#SBATCH -J gmx_cco1_fold_microsecond
#SBATCH -o MygpuJob_out_%j.txt
#SBATCH -e MygpuJob_err_%j.txt
#SBATCH -c 8
#SBATCH --gres=gpu:1
#SBATCH --mem-per-cpu=4g
#SBATCH -p gpu
#SBATCH --time=12:00:00
Developers
- Christian Margreitter @cmargreitter
- J. Harry Moore @jharrymoore
- Matthias R. Bauer mattias.r.b@gmail.com
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file icolos-1.10.0.tar.gz.
File metadata
- Download URL: icolos-1.10.0.tar.gz
- Upload date:
- Size: 226.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1ce44320ad395bcc745c918c69683e244ca973983ac33424727b5e0148b08c7c
|
|
| MD5 |
e57d659c476b459894536a71d17509a3
|
|
| BLAKE2b-256 |
930d7208da144a6d00c00687de48d44371d539c9ac845043d6cac40bf87401f2
|
File details
Details for the file icolos-1.10.0-py3-none-any.whl.
File metadata
- Download URL: icolos-1.10.0-py3-none-any.whl
- Upload date:
- Size: 358.5 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.10
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
42258748d799dec09b64f021c94d45954c56af9e441469d8551e9b7fa79fa8b1
|
|
| MD5 |
edd2762b8fbfbd4bb51a718a5e847d18
|
|
| BLAKE2b-256 |
f18d71a371a9b13d2e5e3868c5073e77719f674ad0b154ec1ae4ad375ae10a7c
|