Skip to main content

Remove echosounder noise by identifying the ocean floor and entrained air at the ocean surface.

Project description

Latest Release

Latest PyPI release

License

AGPLv3 License

Documentation

Documentation

Build Status

Documentation Status GHA Status Coverage pre-commit.ci status

Code style

black pre-commit enabled

Citation

DOI

Echofilter is an application for segmenting an echogram. It takes as its input an Echoview .EV file, and produces as its output several lines and regions:

  • entrained air (turbulence) line

  • seafloor line

  • surface line

  • nearfield line

  • passive data regions

  • (unreliable) bad data regions for entirely removed periods of time, in the form of boxes covering the entire vertical depth

  • (unreliable) bad data regions for localised anomalies, in the form of polygonal contour patches

Echofilter uses a machine learning model to complete this task. The machine learning model was trained on upfacing stationary and downfacing mobile data provided by Fundy Ocean Research Centre for Energy (FORCE). The training and evaluation data is available for download. Queries regarding dataset access should be directed to FORCE, info@fundyforce.ca.

The experimental methodology and results can be found in our companion paper, published in Frontiers in Marine Science.

Full documentation of how to use echofilter can be viewed at readthedocs.

If you encounter a specific problem please open a new issue.

Usage

After installing, the model can be applied at the command prompt with:

echofilter PATH PATH2 ...

Any number of paths can be specified. Each path can either be a path to a single csv file to process (exported using the Echoview application), or a directory containing csv files. If a directory is given, all csv files within nested subfolders of the directory will be processed.

All optional parameters can be seen by running echofilter with the help argument.

echofilter --help

For more details, see the Usage Guide, and the command line interface (CLI) reference documentation.

Installation

Installing as a stand-alone executable

For your convenience, we provide a copy of Echofilter compiled as a stand-alone executable for Windows. To install this, download and unzip the echofilter-executable-M.N.P.zip file from the latest release in the releases tab. For example: echofilter-executable-1.1.1.zip

For more details, see the step-by-step instructions in the Usage Guide.

Note: The precompiled executable has only CPU support, and does not support running on GPU.

Installing in Python

Alternatively, the echofilter package can be installed for Python 3.6 or 3.7 using pip as follows.

First, install torch.

Either with CPU-only capabilities:

pip install torch==1.4.0+cpu torchvision==0.5.0+cpu -f https://download.pytorch.org/whl/torch_stable.html

Or with CUDA GPU support as well:

pip install torch==1.4.0 torchvision==0.5.0 -f https://download.pytorch.org/whl/torch_stable.html

Then install the rest of the requirements.

pip install -r frozen_requirements.txt
pip install echofilter

Citing Echofilter

For technical details about how the Echofilter model was trained, and our findings about its empirical results, please consult our companion paper:

SC Lowe, LP McGarry, J Douglas, J Newport, S Oore, C Whidden, DJ Hasselman (2022). Echofilter: A Deep Learning Segmention Model Improves the Automation, Standardization, and Timeliness for Post-Processing Echosounder Data in Tidal Energy Streams. Front. Mar. Sci., 9, 1–21. doi: 10.3389/fmars.2022.867857.

If you use Echofilter for your research, we would be grateful if you could cite this paper in any resulting publications.

For your convenience, we provide a copy of this citation in bibtex format.

You can browse papers which utilise Echofilter here.

License

Copyright (C) 2020-2022 Scott C. Lowe and Offshore Energy Research Association (OERA)

This program is free software: you can redistribute it and/or modify it under the terms of the GNU Affero General Public License as published by the Free Software Foundation, version 3.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Affero General Public License for more details.

You should have received a copy of the GNU Affero General Public License along with this program. If not, see <https://www.gnu.org/licenses/>.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

echofilter-1.1.1.tar.gz (162.1 kB view details)

Uploaded Source

Built Distribution

echofilter-1.1.1-py2.py3-none-any.whl (176.1 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file echofilter-1.1.1.tar.gz.

File metadata

  • Download URL: echofilter-1.1.1.tar.gz
  • Upload date:
  • Size: 162.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.7.15

File hashes

Hashes for echofilter-1.1.1.tar.gz
Algorithm Hash digest
SHA256 c6af34b48bf0f8f7511709a1fae8b6cb34ac82652edd17baaf44d44ce0e4117e
MD5 37af527a78f02ad0fef08d3d265551cf
BLAKE2b-256 0615516ff731e7ae32bf2c0d402b9607d93ee5b9802e475decc4209ed85920cc

See more details on using hashes here.

File details

Details for the file echofilter-1.1.1-py2.py3-none-any.whl.

File metadata

  • Download URL: echofilter-1.1.1-py2.py3-none-any.whl
  • Upload date:
  • Size: 176.1 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.7.15

File hashes

Hashes for echofilter-1.1.1-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 2b4ad034fd76858d0f2723ca751cf10d72a8aa3c10157c5c15f776c6e8f5e134
MD5 090dc924ffe0acd15064a08cf8f22fcd
BLAKE2b-256 bd23c705378861d7092da86ff61febc064e52b2788db414663615c8dd14f930d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page