Skip to main content

Pulls data from Google Earth Engine, syncs it to Google Drive, and downloads files.

Project description

Todo List

  • catch timeout

  • quality README

  • central install file

  • strip notebooks into python files

  • tie to Jesse's google drive, might be weird because its a shared folder. Multiple writing.

  • containerize and publish

Prerequisite

Requires at least python 3.10.

As of mid-2023, Google Earth Engine access must be linked to a Google Cloud Project, even for free/non-commercial usage. So sign up for a non-commercial earth engine account. .

Google API Instructions

Make a service account and add these rolls:

  • Owner
  • Service Usage Admin
  • Service Usage Consumer
  • Storage Admin
  • Storage Object Creator

In main account add these rolls:

  • Owner
  • Service Usage Admin
  • Service Usage Consumer

We then created an oath account for google drive access. We need to create an OAuth account for Google Drive access. In the top right hamburger menu select:

  • APIs & Services/Credentials/+Create credentials/OAuth client ID
    • OAuth client ID
      • first configure OAuth screen. Select Desktop App and give it a name.
      • keep track of the Client ID and Client secret, we will need those later.
      • click download JSON from this screen, these are your credentials.

Now we need to enable the apis. In the top right hamburger menu select:

  • APIs & Services From this menu select Google Drive API and click Enable API. Do the same for Google Earth Engine API

Now we need to add ourselves as a test user in google cloud navigate to API's & Servies/OAut concent screen/Audience - Scroll down and under Test users click + Add users. Select your main account.

Install Instructions

For the experimental build

git clone git@github.com:KylesCorner/Earth-Engine-Wildfire-Data.git
cd Earth-Engine-Wildfire-Data
pip instll -e .

Command-Line Interface (CLI)

This tool can be run from the command line to generate fire configuration YAML files from GeoJSON data. Configuration can be passed directly via flags or through a YAML file using --config.

Argument Type Description
--config str Path to a YAML configuration file. Defaults to ./config_options.yml.
--year str The year of the fire events to process.
--min-size float Minimum fire size (in square meters) to include.
--output str Local directory to store generated TIFF files.
--drive-dir str Google Drive directory where TIFFs are uploaded or downloaded from.
--credentials str Path to the Google OAuth2 credentials JSON file. Required for GEE export.
--project-id str Google Cloud project ID associated with your Earth Engine access.
--geojson str Path to the input or output GeoJSON file containing fire perimeter data.
--download flag If set, the tool will download TIFF files from Google Drive.
--export-data flag If set, data will be exported to Google Drive using Earth Engine.
--show-config flag Print the currently loaded configuration and exit. Useful for debugging.
--force-new-geojson flag Force the script to generate a new GeoJSON file even if one exists.
--sync-year flag Have all config and output files sync to the year in the config.

Basic Usage

ee-wildfire --config ./config_options.yml --year 2020 --geojson data/perims/combined_fires_2020.geojson

Acknowledgements

This project builds on work from the WildfireSpreadTSCreateDataset. Credit to original authors for providing data, methods, and insights.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ee_wildfire-2025.0.1.tar.gz (21.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ee_wildfire-2025.0.1-py3-none-any.whl (22.9 kB view details)

Uploaded Python 3

File details

Details for the file ee_wildfire-2025.0.1.tar.gz.

File metadata

  • Download URL: ee_wildfire-2025.0.1.tar.gz
  • Upload date:
  • Size: 21.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.12

File hashes

Hashes for ee_wildfire-2025.0.1.tar.gz
Algorithm Hash digest
SHA256 39d7df1c8812fcb7bbaefd3936bafb21d8400a9fee4234fd7fc7b612512dabcd
MD5 5812b29cdafbd8ca55c6e2cb62cec638
BLAKE2b-256 8d299ff34b6f1e81316b57639420e23fb9768d202e6b8a1495dd5d82733fc773

See more details on using hashes here.

File details

Details for the file ee_wildfire-2025.0.1-py3-none-any.whl.

File metadata

  • Download URL: ee_wildfire-2025.0.1-py3-none-any.whl
  • Upload date:
  • Size: 22.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.10.12

File hashes

Hashes for ee_wildfire-2025.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 a7c0853fcac815eeab0dd5b63a09ee4d5cf46c640b401dbec814e7a69fda9ac3
MD5 f7fb7a27eafcbed0e2ab0dc6174d5d75
BLAKE2b-256 f465a2c9dd158e6c9cbbcba76913fb5ad3a88f76b6eaefde86cb8fd640ce27a9

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page