Skip to main content

scikit-surgerytf

Logo GitHub Actions CI status Test coverage Documentation Status

Author: Matt Clarkson

scikit-surgerytf is part of the SNAPPY software project, developed at the Wellcome EPSRC Centre for Interventional and Surgical Sciences, part of University College London (UCL).

scikit-surgerytf supports Python 3.6+, and tensorflow >= 2.0.0.

The aim of scikit-surgerytf is to provide a home for various Tensor Flow examples and utilities and to show best practice. It’s NOT meant to be a layer on-top of Tensor Flow or provide a new kind-of platform. The aim is that researchers can learn from examples, and importantly, learn how to deliver an algorithm that can be used by other people out of the box, with just a `pip install`, rather than a new user having to re-implement stuff, or struggle to get someone else’s code running. Researchers can commit their research to this repository, or use the PythonTemplate to generate their own project as a home for their new world-beating algorithm!

Features/Networks

Design Principles

Each project herein should provide the following:

  • Code that passes pylint.

  • Unit testing, as appropriate. In all likelihood, testing will cover individual functions, not large training cycles.

  • Sufficient logging, including date, time, software (git) version, runtime folder, machine name.

  • A main class containing a network that can be run separately in train/test mode.

  • Visualisation with TensorBoard.

  • Saving of learned network weights at the end of training.

  • Loading of pre-train weights, initialising the network ready for inference.

  • The ability to be run repeatedly for hyper-parameter tuning via python scripting, not bash.

  • The ability to be callable from within a Jupyter Notebook, and thereby amenable to weekly writup’s for supervisions.

  • One or more command line programs that are pip-installable, enabling a subsequent user to train and test your algorithm with almost-zero faff.

  • Visualisation for debugging purposes, such as printing example image thumbnails etc. should be done in Jupyter notebooks, or in tensorboard, not in the same class as your algorithm.

Optional features could include:

  • Small test projects that train quickly to completion won’t need checkpointing, but large ones will.

Usage

Typical instructions for use:

First create a clean python environment, just installing tox:

# Create a clean conda environment
conda create -n myenv python=3.6
conda activate myenv
pip install tox

Then you get the code, and use tox to install all other dependencies:

git clone https://github.com/UCL/scikit-surgerytf
cd scikit-surgerytf
# edit requirements.txt, changing tensorflow to tensorflow-gpu.
# The default is the CPU version just for cross platform testing,
# but for real use, you should swap it to GPU.
# Then run tox to install all dependencies.
tox

Then you can activate the tox created virtualenv and run top-level entry points directly from the root folder:

source .tox/py36/bin/activate
python sksurgeryrgbunet.py --help

Windows users would run:

.tox\py36\Scripts\activate
python sksurgeryrgbunet.py --help

So, for example, to run the sksurgeryrgbunet.py program and train on some data, you would do:

python sksurgeryrgbunet.py -d DATA -w working_dir -s output.hdf5

where DATA is a directory like:

DATA/P1/masks
DATA/P1/images
DATA/P2/masks
DATA/P2/images
.
.
DATA/PN/masks
DATA/PN/images

and P1,P2..PN just represents some patient identifier. Images and masks, though in different folders, must have the same name.

Developing

Cloning

You can clone the repository using the following command:

git clone https://github.com/UCL/scikit-surgerytf

Running tests

Pytest is used for running unit tests, but you should run using tox, as per the PythonTemplate instructions.

Linting

This code conforms to the PEP8 standard. Pylint is used to analyse the code. Again, follow the PythonTemplate instructions and run via tox.

Installing

You can pip install directly from the repository as follows:

pip install git+https://github.com/UCL/scikit-surgerytf

Contributing

Please see the contributing guidelines.

Acknowledgements

Supported by Wellcome and EPSRC.

Metadata

Release files for scikit-surgerytf 0.2.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for scikit-surgerytf 0.2.1
File Size Uploaded
scikit-surgerytf-0.2.1.tar.gz 34.8 kB Details

Release files / scikit-surgerytf-0.2.1.tar.gz

Download URL scikit-surgerytf-0.2.1.tar.gz
Size 34.8 kB
Tags Source
SHA-256 checksum
How to use checksums
0ecc5c561d1daa4d839603a3675ab76cc990a5c37fc3f272fe7caf305593dfdb
BLAKE2b-256 checksum
How to use checksums
fa631f79b0c370277190a51d1ce5a7f79cef8355e250570e6fa8e2de43836523
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.8.0 pkginfo/1.8.2 readme-renderer/34.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.9 tqdm/4.63.0 importlib-metadata/4.11.3 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.9.11

Release history Release notifications | RSS feed

This release

0.2.1 This release

1 release file

0.2.0

1 release file

0.1.1

1 release file

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page