Morphology Workflows

This project contains several workflows for processing morphologies:

Curate: from raw morphologies, ensures that morphologies can be used with the rest of BBP codes
Annotate: create various annotations on morphologies needed by specific BBP codes
Repair: process morphologies to correct for artifacts of in-vitro reconstruction

In a nutshell, the user provides a list of morphologies in a .csv file, with their names and paths and a luigi.cfg configuration file. Each workflow is run independently and creates an output folder, with one subfolder per task. In each, there will be a report.csv and a data folder containing the output files of the task if any. In the report.csv file, columns contain paths to these files, additional information, error messages if the task failed on that morphologies, as well as a flag is_valid, used in subsequent tasks to filter valid morphologies. At the end of each workflow, another report.csv file is created, with the main output columns of each tasks, and a report.pdf containing a human readable summary of the result of the workflow.

Installation

This should be installed using pip:

pip install morphology-workflows

Usage

This workflow is based on the luigi library but can be run via the command line interface:

morphology_workflows --local-scheduler Curate

NOTE This command must be executed from a directory containing a luigi.cfg file. An example of such file is given in the examples directory.

More details can be found in the command line interface section of the documentation.

Examples

The examples folder contains a simple example that will process a set of morphologies. A dataset.csv file is provided which is taken as input for the workflows. A luigi.cfg file is also provided to give a default configuration for the workflows. This example can simply be run using the following command:

./run_curation.sh

This script will create a new directory out_curated which will contain the report and all the results.

Funding & Acknowledgment

The development of this software was supported by funding to the Blue Brain Project, a research center of the École polytechnique fédérale de Lausanne (EPFL), from the Swiss government’s ETH Board of the Swiss Federal Institutes of Technology.

For license and authors, see LICENSE.txt and AUTHORS.md respectively.

Metadata

Release files for morphology-workflows 0.1.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for morphology-workflows 0.1.0
File	Size	Uploaded
morphology-workflows-0.1.0.tar.gz	1.4 MB	Dec 17, 2021	Details

Built distribution (wheel)

Table of built distributions (wheels) for morphology-workflows 0.1.0
File	Interpreter	ABI	Platform	Reset
morphology_workflows-0.1.0-py3-none-any.whl 37.0 kB Dec 17, 2021	Python 3	none	any	Details

Total release size: 1.4 MB

Release files / morphology-workflows-0.1.0.tar.gz

Download URL	morphology-workflows-0.1.0.tar.gz
Size	1.4 MB
Tags	Source
SHA-256 checksum How to use checksums	`45a95a4403628c526a69e21e55bd86db143984c31f58a0273c3aa282c3f3b445`
BLAKE2b-256 checksum How to use checksums	`71f7407134455e892beb7376e7df55674763f1e34bdc357fbb87c523ddd78cf2`
Upload date	Dec 17, 2021
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.2.0 pkginfo/1.6.0 requests/2.24.0 setuptools/50.0.3 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.8.10`

Release files / morphology_workflows-0.1.0-py3-none-any.whl

Download URL	morphology_workflows-0.1.0-py3-none-any.whl
Size	37.0 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`abe1a492e0daeff3705efb1fb6396cd8db932ea1160c52d93148f7295965cc5b`
BLAKE2b-256 checksum How to use checksums	`d78929e502f4e84d16bd547067f253ac4ddf13268f338b56929a8242eed3fea6`
Upload date	Dec 17, 2021
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/3.2.0 pkginfo/1.6.0 requests/2.24.0 setuptools/50.0.3 requests-toolbelt/0.9.1 tqdm/4.48.2 CPython/3.8.10`