Skip to main content

exaSPIM pipeline utils

License Code Style

Code repository to be installed in exaSPIM processing capsules.

Features

  • Wrapper code for ImageJ automation.
  • n5 to zarr converter to be run in a Code Ocean capsule.

ImageJ wrapper module

The ImageJ wrapper module contains Fiji macro templates and wrapper code to automatically run interest point detection and interest point based registration in the Code Ocean capsule. This functionality is set as the main entry point of the package if the whole package is invoked on the command line or the aind_exaspim_pipeline command is run.

#!/usr/bin/env bash
set -ex
cd ~/capsule
imagej_wrapper "$@"

N5 to Zarr converter

The N5 to zarr converter sets up a local dask cluster with multiple python processes as workers to read in an N5 dataset and write it out in a multiscale Zarr dataset. Both datasets may be local or directly on S3. AWS credentials must be available in the environment (Code Ocean credential assignment to environment variables).

This implementation is based on dask.array (da).

This command takes a manifest json file as the only command line argument or looks it up at the hard-wired data/manifest/exaspim_manifest.json location if not specified.

To set up a code ocean capsule, use the following run.sh script:

#!/usr/bin/env bash
set -ex
cd ~/capsule
n5tozarr_da_converter "$@"

Installation

To use the software, in the root directory, run

pip install -e .

To develop the code, run

pip install -e .[dev]

For n5tozarr and zarr multiscale conversion, install as

pip install -e .[n5tozarr]

Contributing

Linters and testing

There are several libraries used to run linters, check documentation, and run tests.

  • Please test your changes using the coverage library, which will run the tests and log a coverage report:
coverage run -m unittest discover && coverage report
  • Use interrogate to check that modules, methods, etc. have been documented thoroughly:
interrogate .
  • Use flake8 to check that code is up to standards (no unused imports, etc.):
flake8 .
  • Use black to automatically format the code into PEP standards:
black .
  • Use isort to automatically sort import statements:
isort .

Pull requests

For internal members, please create a branch. For external members, please fork the repository and open a pull request from the fork. We'll primarily use Angular style for commit messages. Roughly, they should follow the pattern:

<type>(<scope>): <short summary>

where scope (optional) describes the packages affected by the code changes and type (mandatory) is one of:

  • build: Changes that affect build tools or external dependencies (example scopes: pyproject.toml, setup.py)
  • ci: Changes to our CI configuration files and scripts (examples: .github/workflows/ci.yml)
  • docs: Documentation only changes
  • feat: A new feature
  • fix: A bugfix
  • perf: A code change that improves performance
  • refactor: A code change that neither fixes a bug nor adds a feature
  • test: Adding missing tests or correcting existing tests

Documentation

To generate the rst files source files for documentation, run

sphinx-apidoc -o doc_template/source/ src 

Then to create the documentation HTML files, run

sphinx-build -b html doc_template/source/ doc_template/build/html

More info on sphinx installation can be found here.

Metadata

Release files for aind-exaspim-pipeline-utils 0.11.3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for aind-exaspim-pipeline-utils 0.11.3
File Size Uploaded
aind_exaspim_pipeline_utils-0.11.3.tar.gz 93.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for aind-exaspim-pipeline-utils 0.11.3
File Interpreter ABI Platform
aind_exaspim_pipeline_utils-0.11.3-py3-none-any.whl Python 3 none any Details

Total release size: 163.6 kB

Release files / aind_exaspim_pipeline_utils-0.11.3.tar.gz

Download URL aind_exaspim_pipeline_utils-0.11.3.tar.gz
Size 93.7 kB
Tags Source
SHA-256 checksum
How to use checksums
1389e94de57ec2a6fd9981e2ae73667faaf50b23c2518489667cdd6beb9a46da
BLAKE2b-256 checksum
How to use checksums
038a40c0bc9db2c0e2e1ae79ebf353b8cfcda4641a68543cbd0c0d400ee0997f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.13.12

Release files / aind_exaspim_pipeline_utils-0.11.3-py3-none-any.whl

Download URL aind_exaspim_pipeline_utils-0.11.3-py3-none-any.whl
Size 69.9 kB
Tags Python 3
SHA-256 checksum
How to use checksums
aacbb62f4db64d36923ada631193ae43f8a6abebf0459f7ffe674123bba3b41a
BLAKE2b-256 checksum
How to use checksums
d53f5d1af2921ce672b368ce7ff920d03cd425e1134f6dd8b141f3674f3182b8
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.13.12

Release history Release notifications | RSS feed

This release

0.11.3 This release

2 release files

0.11.0

2 release files

0.10.0

2 release files

0.9.0

2 release files

0.8.3

2 release files

0.8.2

2 release files

0.8.1

2 release files

0.8.0

2 release files

0.7.2

2 release files

0.7.1

2 release files

0.7.0

2 release files

0.6.0

2 release files

0.5.2

2 release files

0.5.1

2 release files

0.5.0

2 release files

0.4.7

2 release files

0.4.6

2 release files

0.4.5

2 release files

0.4.4

2 release files

0.4.3

2 release files

0.4.2

2 release files

0.4.1

2 release files

0.4.0

2 release files

0.3.1

2 release files

0.3.0

2 release files

0.2.2

2 release files

0.2.1

2 release files

0.2.0

2 release files

0.1.6

2 release files

0.1.5

2 release files

0.1.4

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page