Skip to main content

A collection of common tools to interact with the BigEarthNet dataset.

Project description

Common BigEarthNet Tools

A personal collection of common tools to interact with the BigEarthNet dataset.

Tests License PyPI version Conda Version Auto Release

This library provides a collection of high-level tools to better work with the BigEarthNet dataset.

bigearthnet_common tries to:

  1. Collect the most relevant constants into a single place to reduce the time spent looking for these, like:
    • The 19 or 43 class nomenclature strings
    • URL
    • Band statistics (mean/variance) as integer and float
    • Channel names
    • etc.
  2. Provide common metadata related functions
    • Safe JSON parser for S1/S2
    • Get the original split
    • Get a list of snowy/cloudy patches
    • Convert the old labels to thew new label nomenclature
    • Generate multi-hot encoded label views
  3. Easily filter patches and generate subsets as CSV files

Installation

The package is available via PyPI and can be installed with:

  • pip install bigearthnet_common

The package has Python-only dependencies and should cause no issues in more complex Conda environments with various binaries.

Review constants

To quickly search for BigEarthNet constants of interest, call:

  • ben_constants_prompt or
  • python -m bigearthnet_common.constants

Sets generator

To generate sets/subsets from the data and to store them as a CSV file, use:

  • ben_build_csv_sets --help

This command-line tool let's the user easily create subsets from common constraints. To generate a CSV file that contains all Sentinel-2 patches from Serbia only durng the Summer and Spring months, call the function as:

  • ben_build_csv_sets <FILE_PATH> S2 --seasons Winter --seasons Summer --countries Serbia --remove-unrecommended-dl-patches

Note: By default this tool will always remove the unrecommended patches, i.e. patches that contain seasonal snow, shadows, clouds, or that have no labels in the 19-class nomenclature

Contributing

Contributions are always welcome!

Please look at the corresponding ipynb notebook from the nbs folder to review the source code. These notebooks include extensive documentation, visualizations, and tests. The automatically generated Python files are available in the bigearthnet_common module.

More information is available in the contributing guidelines document.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bigearthnet_common-2.3.0.tar.gz (5.6 MB view details)

Uploaded Source

Built Distribution

bigearthnet_common-2.3.0-py3-none-any.whl (5.6 MB view details)

Uploaded Python 3

File details

Details for the file bigearthnet_common-2.3.0.tar.gz.

File metadata

  • Download URL: bigearthnet_common-2.3.0.tar.gz
  • Upload date:
  • Size: 5.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.12 CPython/3.7.12 Linux/5.11.0-1027-azure

File hashes

Hashes for bigearthnet_common-2.3.0.tar.gz
Algorithm Hash digest
SHA256 d97e49db7b135b57af7883856ca1b4385bf521b71eba66049fa58410fee064ac
MD5 efe7a9283faca88f6585bbadaa377567
BLAKE2b-256 2b7d20b3f1135838fbb32a2d45a658a700c4409072950b2becdb7abf193cae1f

See more details on using hashes here.

File details

Details for the file bigearthnet_common-2.3.0-py3-none-any.whl.

File metadata

  • Download URL: bigearthnet_common-2.3.0-py3-none-any.whl
  • Upload date:
  • Size: 5.6 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.1.12 CPython/3.7.12 Linux/5.11.0-1027-azure

File hashes

Hashes for bigearthnet_common-2.3.0-py3-none-any.whl
Algorithm Hash digest
SHA256 cfada63ea309a9ca316e5587cfb519393f3d6121506a8d8fdd06fd48639476fb
MD5 169e454a6d22675af25ca5c09522026c
BLAKE2b-256 56a0fb3698dab0a99bd6181138a39132a57486753d4ecd5ac43be3568cdb68df

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page