Skip to main content

chmutil

https://img.shields.io/pypi/v/chmutil.svg https://pyup.io/repos/github/crbs/chmutil/shield.svg https://travis-ci.org/CRBS/chmutil.svg?branch=master https://coveralls.io/repos/github/CRBS/chmutil/badge.svg?branch=master

Utility package to run Cascaded Hierarchical Model (CHM) jobs on clusters.

For more information visit our wiki page

Tools

  • createchmjob.py – Creates a set of CHM jobs to process a set of images on various compute clusters (Gordon, Comet, & Rocce)

  • checkchmjob.py – Checks status of jobs generated by createchmjob.py script

  • createchmtrainjob.py – Creates a CHM train job, runnable on various compute clusters (Comet & Rocce), which teaches CHM how to segment a desired feature. The output from this job is a trained model that is needed as an input for createchmjob.py

  • createchmimage.py – Simple image conversion utility

  • createprobmapoverlay.py – Overlays semi-transparent colored probability maps over base image

  • mergetiles.py – Merges a set of image tiles in a directory into single image

  • chmrunner.py – Internal tool that runs a CHM task created by createchmjob.py

  • mergetilerunner.py – Internal tool that runs Merge task created by createchmjob.py

Dependencies

Compatibility

  • Should work on Python 2.7 & 3+ on Linux distributions

Installation

pip install chmutil

Usage

# creates a job assuming images are in ./images and ./trainedmodel has
# chm model
createchmjob.py ./images ./trainedmodel myrun --cluster rocce

License

See LICENSE.txt

Bugs

Please report them here

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

History

0.8.4 (2018-03-20)

  • Try number two to get comet configuration to load singularity 2.3.2. See issue 76 below.

0.8.3 (2018-03-16)

  • Added –dontdeletescratch option to createtrainingmrcstack.py to skip deletion of scratchdir. Issue #78

  • Updated comet configuration to load singularity 2.3.2. Issue #76

0.8.2 (2017-07-27)

  • Fixed typo in history notes which caused pypi not to render project description properly

0.8.1 (2017-07-27)

  • Fixed bug in createtrainingmrcstack.py which caused program to fail due to incorrect call to get_image_path_list(). Issue #48

  • Increased required memory for merge tasks on Rocce cluster from 10 to 20 gigabytes of ram and added virtual_free constraint to handle gigapixel images. Issue #49

0.8.0 (2017-06-23)

  • Added –gentifs to createchmjob.py to generate tif probability map images Issue #43

  • Fixed bug in checkchmjob.py –detailed where ram value was incorrect Issue #44

  • Added information about input images to checkchmjob.py –detailed Issue #28

0.7.0 (2017-06-09)

  • Added –gentiles flag to createchmimage.py to generate tiles from image that can be viewed in probability map viewer. Issue #42

  • Added –rawthreshold flag to createprobmapoverlay.py which lets caller specify exact pixel intensity value instead of percentage as offered with –threshpc. Issue #41

  • Added virtual_free to requirements for SGE jobs submitted by createchmtrainjob.py to rocce cluster. Issue #40

0.6.0 (2017-03-03)

  • Added –detailed option to checkchmjob.py. Issue #6

  • Added –addprobmap to createprobmapoverlay.py to enable additional probability maps to be overlayed. Issue #25

  • Added createchmtrainjob.py script that creates a CHM train job. Issue #19

  • Fixed incorrect script names in readme.txt generated by createchmjob.py. Issue #20

0.5.1 (2017-01-12)

  • Fixed account not being put into runjobs.gordon and runmerge.gordon. Issue #11

  • Fixed errors in checking job status examples in readme.txt created by createchmjob.py. Issue #12

0.5.0 (2017-01-11)

  • First release on PyPI.

Metadata

Release files for chmutil 0.8.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for chmutil 0.8.4
File Size Uploaded
chmutil-0.8.4.tar.gz 80.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for chmutil 0.8.4
File Interpreter ABI Platform
chmutil-0.8.4-py2.py3-none-any.whl Python 2, Python 3 none any Details

Total release size: 164.0 kB

Release files / chmutil-0.8.4.tar.gz

Download URL chmutil-0.8.4.tar.gz
Size 80.5 kB
Tags Source
SHA-256 checksum
How to use checksums
b658e52974e4528fe035bd9bbcadc023e5e6ec42fa72087930a8d412c6b032c3
BLAKE2b-256 checksum
How to use checksums
be63cb3006da1f672f462e7226d71032813148a1e133388ecef359e132182b75
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release files / chmutil-0.8.4-py2.py3-none-any.whl

Download URL chmutil-0.8.4-py2.py3-none-any.whl
Size 83.5 kB
Tags Python 2 Python 3
SHA-256 checksum
How to use checksums
51e29576d8f26d68a9d255eb8d9cabf52245e7338d0a70127b5bfbf4cccd5e4f
BLAKE2b-256 checksum
How to use checksums
80108255807b6974cba5df42cc6b66b619b4317445dd194efbf57143c9a09824
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No

Release history Release notifications | RSS feed

This release

0.8.4 This release

2 release files

0.8.2

2 release files

0.8.0

2 release files

0.7.0

2 release files

0.6.0

2 release files

0.5.1

2 release files

0.5.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page