Skip to main content

Utility package to run CHM jobs on clusters

Project description

chmutil

https://img.shields.io/pypi/v/chmutil.svg https://pyup.io/repos/github/crbs/chmutil/shield.svg https://travis-ci.org/CRBS/chmutil.svg?branch=master https://coveralls.io/repos/github/CRBS/chmutil/badge.svg?branch=master

Utility package to run Cascaded Hierarchical Model (CHM) jobs on clusters.

For more information visit our wiki page

Tools

  • createchmjob.py – Creates a set of CHM jobs to process a set of images on various compute clusters (Gordon, Comet, & Rocce)

  • checkchmjob.py – Checks status of jobs generated by createchmjob.py script

  • createchmtrainjob.py – Creates a CHM train job, runnable on various compute clusters (Comet & Rocce), which teaches CHM how to segment a desired feature. The output from this job is a trained model that is needed as an input for createchmjob.py

  • createchmimage.py – Simple image conversion utility

  • createprobmapoverlay.py – Overlays semi-transparent colored probability maps over base image

  • mergetiles.py – Merges a set of image tiles in a directory into single image

  • chmrunner.py – Internal tool that runs a CHM task created by createchmjob.py

  • mergetilerunner.py – Internal tool that runs Merge task created by createchmjob.py

Dependencies

Compatibility

  • Should work on Python 2.7 & 3+ on Linux distributions

Installation

pip install chmutil

Usage

# creates a job assuming images are in ./images and ./trainedmodel has
# chm model
createchmjob.py ./images ./trainedmodel myrun --cluster rocce

License

See LICENSE.txt

Bugs

Please report them here

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

History

0.8.0 (2017-06-23)

  • Added –gentifs to createchmjob.py to generate tif probability map images Issue #43

  • Fixed bug in checkchmjob.py –detailed where ram value was incorrect Issue #44

  • Added information about input images to checkchmjob.py –detailed Issue #28

0.7.0 (2017-06-09)

  • Added –gentiles flag to createchmimage.py to generate tiles from image that can be viewed in probability map viewer. Issue #42

  • Added –rawthreshold flag to createprobmapoverlay.py which lets caller specify exact pixel intensity value instead of percentage as offered with –threshpc. Issue #41

  • Added virtual_free to requirements for SGE jobs submitted by createchmtrainjob.py to rocce cluster. Issue #40

0.6.0 (2017-03-03)

  • Added –detailed option to checkchmjob.py. Issue #6

  • Added –addprobmap to createprobmapoverlay.py to enable additional probability maps to be overlayed. Issue #25

  • Added createchmtrainjob.py script that creates a CHM train job. Issue #19

  • Fixed incorrect script names in readme.txt generated by createchmjob.py. Issue #20

0.5.1 (2017-01-12)

  • Fixed account not being put into runjobs.gordon and runmerge.gordon. Issue #11

  • Fixed errors in checking job status examples in readme.txt created by createchmjob.py. Issue #12

0.5.0 (2017-01-11)

  • First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

chmutil-0.8.0.tar.gz (79.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

chmutil-0.8.0-py2.py3-none-any.whl (82.7 kB view details)

Uploaded Python 2Python 3

File details

Details for the file chmutil-0.8.0.tar.gz.

File metadata

  • Download URL: chmutil-0.8.0.tar.gz
  • Upload date:
  • Size: 79.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for chmutil-0.8.0.tar.gz
Algorithm Hash digest
SHA256 4bd1ad0e9f1da267525a9ad80084c5fe2c0a82cf358ca7d2ad26fa1ca9f94e10
MD5 71a208d13b343ee8c6234f2e75beb3e7
BLAKE2b-256 8efd21a615e1091bf4b1f1c311283a09ffd59e645de574eed037315a888d1cc6

See more details on using hashes here.

File details

Details for the file chmutil-0.8.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for chmutil-0.8.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 c91c300995bb551ad0664773c963446dca8508ddd2d0a3961854914c63334c0e
MD5 7533996f3d43e0e4c06f113383b6449f
BLAKE2b-256 ffb8bcfded96665fe4a16e74bbdc67b34bfc8a9b1bd4bf37e2c8b17b297d02df

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page