Skip to main content

A Python package for the CropNet dataset

Project description

CropNet

CropNet is an open, large-scale, and deep learning-ready dataset, specifically targeting climate change-aware crop yield predictions for the contiguous United States (U.S.) continent at the county level. It is composed of three modalities of data, i.e., Sentinel-2 Imagery, WRF-HRRR Computed Dataset, and USDA Crop Dataset, aligned in both the spatial and temporal domains, for over 2200 U.S. counties spanning 6 years (2017-2022). It is expected to facilitate researchers in developing deep learning models for timely and precisely predicting crop yields at the county level, by accounting for the effects of both short-term growing season weather variations and long-term climate change on crop yields.

Overview

The CropNet dataset is composed of three modalities of data, i.e., Sentinel-2 Imagery, WRF-HRRR Computed Dataset, and USDA Crop Dataset, spanning from 2017 to 2022 (i.e., 6 years) across 2291 U.S. counties.

  • The dataset is available at Google Drive

  • The tutorials for each modality of data are availbale at Github

Sentinel-2 Imagery

The Sentinel-2 Imagery, obtained from the Sentinel-2 mission, provides high-resolution satellite images for monitoring crop growth on the ground. It contains 224x224 RGB satellite images, with a spatial resolution of 9x9 km, and a revisit frequency of 14 days.

WRF-HRRR Computed Dataset

The WRF-HRRR Computed Dataset, sourced from the WRF-HRRR model, contains daily and monthly meteorological parameters, with the former and the latter designed for capturing the direct effects of short-term growing season weather variations on crop growth, and for learning the indirect impacts of long-term climate change on crop yields, respectively. It contains 9 meteorological parameters gridded at 9 km in a one-day (and one-month) interval.

USDA Crop Dataset

The USDA Crop Dataset, collected from the USDA Quick Statistic website, offers valuable crop information, such as production, yield, etc., for crops grown at each available county. It offers crop information for four types of crops, i.e., corn, cotton, soybeans, and winter wheat, at a county-level basis, with a temporal resolution of one year.

Although our initial goal of crafting the CropNet dataset is for precise crop yield prediction, we believe its future applicability is broad and can benefit the deep learning, agriculture, and meteorology communities, for exploring more interesting, critical, and pertinent climate change-related applications, by using one or more modalities of data.

Pipeline

The code in this reposity:

  1. combines all three modalities of data to create $(\mathbf{x}, \mathbf{y_{s}}, \mathbf{y_{l}}, \mathbf{z})$ tuples, with $\mathbf{x}$, $\mathbf{y_{s}}$, $\mathbf{y_{l}}$, and $\mathbf{z}$ representing satellite images, short-term daily whether parameters, long-term monthly meterological parameters, and ground-truth crop yield (or production) inforamtion, resprectively, and
  2. exposes those tuples via a Dataset object.

Notably, one or more modalities of data can be used for specific deep learning tasks. For example,

  1. satellite images can be solely utilized for pre-training deep neural networks in a self-supervised learning manner (e.g., SimCLR), or
  2. a pair of $(\mathbf{x}, \mathbf{y_{s}})$ under the same 9x9 km grid can be used for exploring the local weather effect on crop growth.

Installation

MacOS and Linux users can install the latest version of CropNet with the following command:

pip install cropnet

License

CropNet has a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cropnet-0.1.3.tar.gz (6.0 kB view details)

Uploaded Source

Built Distribution

cropnet-0.1.3-py2.py3-none-any.whl (7.1 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file cropnet-0.1.3.tar.gz.

File metadata

  • Download URL: cropnet-0.1.3.tar.gz
  • Upload date:
  • Size: 6.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.8.17

File hashes

Hashes for cropnet-0.1.3.tar.gz
Algorithm Hash digest
SHA256 c6ff26da59b60173a302129ab51fdbe0c6a7a9b8484a9089d95865fc441b9b30
MD5 801e04b964e034842579651bdf83ef4a
BLAKE2b-256 2ac9d9e9d3fe8c83d48e3fe730877ba0cc9b459e7cdd3206d272a8b4fb85222b

See more details on using hashes here.

File details

Details for the file cropnet-0.1.3-py2.py3-none-any.whl.

File metadata

  • Download URL: cropnet-0.1.3-py2.py3-none-any.whl
  • Upload date:
  • Size: 7.1 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.8.17

File hashes

Hashes for cropnet-0.1.3-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 8c9830c2a0945b50f4a89cf51f1b49a10d949e4fdd4129c33edae5ee67ed3354
MD5 17271c46e3cfde638e0bd543e94a2c00
BLAKE2b-256 43322acbe6332ca363102b557782c61f56c0d6daa28e80120d0c83d091c3bd12

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page