Skip to main content

EuroCropsML is a ready-to-use benchmark dataset for few-shot crop type classification using Sentinel-2 imagery.

Project description

EuroCropsML is a pre-processed and ready-to-use machine learning dataset for crop type classification of agricultural parcels in Europe. It consists of a total of 706,683 Sentinel-2 multi-class labeled data points with a total of 176 distinct classes. Each data point contains an annual time series of per parcel median pixel values of Sentinel-2 L1C (top-of-atmosphere) reflectance data for the year 2021. The dataset is based on Version 9 of EuroCrops, an open-source collection of remote sensing reference data.

For EuroCropsML, we acquired and aggregated data for the following countries:

Country Number of distinct classes Total number of datapoints for Sentinel-2
Estonia 127 175,906
Latvia 103 431,143
Portugal 79 99,634

Spatial distribution of labels within Estland and Latvia. Spatial distribution of labels within Portugal.

The distribution of class labels differs substantially between the regions of Estonia, Latvia, and Portugal. This makes transferring knowledge gained in one region to another region quite challenging, especially if only few labeled data points are available. Therefore, this dataset is particularly suited to explore transfer-learning methods for few-shot crop type classification.

The data acquisition, aggregation, and pre-processing steps are schematically illustrated below. A more detailed description is given in the dataset section of our documentation.

Data Acquisition Pipeline.

Getting Started

eurocropsml is a Python package hosted on PyPI.

Installation

The recommended installation method is pip-installing into a virtual environment:

$ python -Im pip install eurocropsml

Usage Guide

The quickest way to interact with the eurocropsml package and get started is to use the EuroCropsML dataset is via the provided command-line interface (CLI).

For example, to get help on available commands and options, use

$ eurocropsml-cli --help

To show the currently used (default) configuration for the eurocropsml dataset CLI, use

$ eurocropsml-cli datasets eurocrops config

To download the EuroCropsML dataset as currently configured, use

$ eurocropsml-cli datasets eurocrops download

Alternatively, the dataset can also be manually downloaded from our Zenodo repository.

A comprehensive documentation of the CLI can be found in the CLI Reference section of our documentation.

For a complete example use-case demonstrating the ready-to-use EuroCropsML dataset in action, please refer to the project's associated official repository for benchmarking meta-learning algorithms.

Project Information

The eurocropsml code repository is released under the MIT License. Its documentation lives at Read the Docs, the code on GitHub and the latest release can by found on PyPI. It is tested on Python 3.10+.

If you would like to contribute to eurocropsml you are most welcome. We have written a short guide to help you get started.

Background

The EuroCropsML dataset and associated eurocropsml code repository are provided and developed as part of the joint PretrainAppEO research project by the chair of Remote Sensing Technology at Technical University Munich and dida.

The goal of the project is to investigate methods that rely on the approach of pre-training and fine-tuning machine learning models in order to improve generalizability for various standard applications in Earth observation and remote sensing.

The ready-to-use EuroCopsML dataset is developed for the purpose of improving and benchmarking few-shot crop type classification methods.

EuroCropsML is based on Version 9 of EuroCrops, an open-source collection of remote sensing reference data for agriculture from countries of the European Union.

Citation

If you use the EuroCropsML dataset or eurocropsml code repository in your research, please cite our project as follows:

Plain text

Reuss, J., & Macdonald, J. (2024). EuroCropsML [dataset]. Zenodo. https://doi.org/10.5281/zenodo.10629610

Bibtex

@misc{reuss_macdonald_eurocropsml_2024,
  author       = {Reuss, Joana and Macdonald, Jan},
  title        = {EuroCropsML},
  year         = 2024,
  publisher    = {Zenodo},
  doi          = {10.5281/zenodo.10629610},
  url          = {https://doi.org/10.5281/zenodo.10629610}
}

Acknowledgments & Funding

The PreTrainAppEO research project is funded by the German Space Agency at DLR on behalf of the Federal Ministry for Economic Affairs and Climate Action (BMWK).

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

eurocropsml-0.4.1.tar.gz (922.0 kB view details)

Uploaded Source

Built Distribution

eurocropsml-0.4.1-py3-none-any.whl (100.6 kB view details)

Uploaded Python 3

File details

Details for the file eurocropsml-0.4.1.tar.gz.

File metadata

  • Download URL: eurocropsml-0.4.1.tar.gz
  • Upload date:
  • Size: 922.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for eurocropsml-0.4.1.tar.gz
Algorithm Hash digest
SHA256 b3060863caad27632b4bc5bbd9985c311ebe8732f0b08153edba1d808911e32f
MD5 655745900aed47b64200eeb9b949ac1a
BLAKE2b-256 d8c057a2887057cae9dd739a126b48f7f7d381b606b95ab79e93c5860bf2beac

See more details on using hashes here.

Provenance

The following attestation bundles were made for eurocropsml-0.4.1.tar.gz:

Publisher: pypi.yml on dida-do/eurocropsml

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file eurocropsml-0.4.1-py3-none-any.whl.

File metadata

  • Download URL: eurocropsml-0.4.1-py3-none-any.whl
  • Upload date:
  • Size: 100.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for eurocropsml-0.4.1-py3-none-any.whl
Algorithm Hash digest
SHA256 3450862a5b07842529ea690cc77159163fac99964d9ba9691e2f2a0d686e1a83
MD5 e77b3df10ed485c29b81f3531d676ed7
BLAKE2b-256 ab691c2d382b6b352255622db8dbe697b030b36d0f2b6aacaaf4d0157eb21ee9

See more details on using hashes here.

Provenance

The following attestation bundles were made for eurocropsml-0.4.1-py3-none-any.whl:

Publisher: pypi.yml on dida-do/eurocropsml

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page