Skip to main content

A Python package for the CropNet dataset

Project description

CropNet

CropNet is an open, large-scale, and deep learning-ready dataset, specifically targeting climate change-aware crop yield predictions for the contiguous United States (U.S.) continent at the county level. It is composed of three modalities of data, i.e., Sentinel-2 Imagery, WRF-HRRR Computed Dataset, and USDA Crop Dataset, aligned in both the spatial and temporal domains, for over 2200 U.S. counties spanning 6 years (2017-2022). It is expected to facilitate researchers in developing deep learning models for timely and precisely predicting crop yields at the county level, by accounting for the effects of both short-term growing season weather variations and long-term climate change on crop yields.

Overview

The CropNet dataset is composed of three modalities of data, i.e., Sentinel-2 Imagery, WRF-HRRR Computed Dataset, and USDA Crop Dataset, spanning from 2017 to 2022 (i.e., 6 years) across 2291 U.S. counties.

  • The dataset is available at Google Drive

  • The tutorials for each modality of data are availbale at Github

Sentinel-2 Imagery

The Sentinel-2 Imagery, obtained from the Sentinel-2 mission, provides high-resolution satellite images for monitoring crop growth on the ground. It contains 224x224 RGB satellite images, with a spatial resolution of 9x9 km, and a revisit frequency of 14 days.

WRF-HRRR Computed Dataset

The WRF-HRRR Computed Dataset, sourced from the WRF-HRRR model, contains daily and monthly meteorological parameters, with the former and the latter designed for capturing the direct effects of short-term growing season weather variations on crop growth, and for learning the indirect impacts of long-term climate change on crop yields, respectively. It contains 9 meteorological parameters gridded at 9 km in a one-day (and one-month) interval.

USDA Crop Dataset

The USDA Crop Dataset, collected from the USDA Quick Statistic website, offers valuable crop information, such as production, yield, etc., for crops grown at each available county. It offers crop information for four types of crops, i.e., corn, cotton, soybeans, and winter wheat, at a county-level basis, with a temporal resolution of one year.

Although our initial goal of crafting the CropNet dataset is for precise crop yield prediction, we believe its future applicability is broad and can benefit the deep learning, agriculture, and meteorology communities, for exploring more interesting and critical climate change-related applications, by using one or more modalities of data.

Pipeline

The code in this reposity:

  1. combines all three modalities of data to create $(\mathbf{x}, \mathbf{y_{s}}, \mathbf{y_{l}}, \mathbf{z})$ tuples, with $\mathbf{x}$, $\mathbf{y_{s}}$, $\mathbf{y_{l}}$, and $\mathbf{z}$ representing satellite images, short-term daily whether parameters, long-term monthly meteorological parameters, and ground-truth crop yield (or production) information, respectively and
  2. exposes those tuples via a Dataset object.

Notably, one or more modalities of data can be used for specific deep learning tasks. For example,

  1. satellite images can be solely utilized for pre-training deep neural networks in a self-supervised learning manner (e.g., SimCLR, MAE, etc.), or
  2. a pair of $(\mathbf{x}, \mathbf{y_{s}})$ under the same 9x9 km grid can be used for exploring the local weather effect on crop growth.

Installation

MacOS and Linux users can install the latest version of CropNet with the following command:

pip install cropnet

Note that if your Python version is older than 3.10.0, you may need to run the following commend before installation to make sure cartopy is successfully installed:

sudo apt install python3-dev libproj-dev proj-data proj-bin libgeos-dev
# If using Python 3.x, consider installing python3.x-dev
sudo apt install python3.10-dev

# install required package for Heribe
pip install ecmwflibs

License

CropNet has a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

cropnet-0.1.14.tar.gz (34.0 kB view details)

Uploaded Source

Built Distribution

cropnet-0.1.14-py2.py3-none-any.whl (43.9 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file cropnet-0.1.14.tar.gz.

File metadata

  • Download URL: cropnet-0.1.14.tar.gz
  • Upload date:
  • Size: 34.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.8.17

File hashes

Hashes for cropnet-0.1.14.tar.gz
Algorithm Hash digest
SHA256 c6e0321b0507630ca68aa9c88dc42f14d24d3f5d2b12c3e9dd93a95294789ec1
MD5 4c6433707ff89ca8c4b7eee0cf415ea2
BLAKE2b-256 7416f1a33d35648562f0adb81772029598c6935feebbd888f86eec79852437be

See more details on using hashes here.

File details

Details for the file cropnet-0.1.14-py2.py3-none-any.whl.

File metadata

  • Download URL: cropnet-0.1.14-py2.py3-none-any.whl
  • Upload date:
  • Size: 43.9 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.2 CPython/3.8.17

File hashes

Hashes for cropnet-0.1.14-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 bc61d88c345dc910c054096773c3c47efcb67566fbd27b0e2de6300dfa10e55f
MD5 532faf50c7eb5e24ff6ef018158af51b
BLAKE2b-256 229e73441e99117f72f320b8148bf49154431f1ca066017c29e4a1954cf82c68

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page