Pulls data from Google Earth Engine, syncs it to Google Drive, and downloads files.
Project description
Project Summary
Earth-Engine-Wildfire-Data is a Python command-line utility and library for extracting and transforming wildfire-related geospatial data from Google Earth Engine. It supports:
-
Access to MODIS, VIIRS, GRIDMET, and other remote sensing datasets.
-
Filtering wildfire perimeters by date, size, and region.
-
Combining daily and final fire perimeters.
-
Generating YAML config files for use in simulation or prediction tools.
-
Command-line configurability with persistent YAML-based settings.
-
This tool is intended for researchers, data scientists, or modelers working with wildfire data pipelines, particularly those interested in integrating Earth Engine datasets into geospatial ML workflows.
-
The Trello page contains the current development status.
Prerequisite
Requires at least python 3.10.
As of mid-2023, Google Earth Engine access must be linked to a Google Cloud Project, even for free/non-commercial usage. So sign up for a non-commercial earth engine account.
🔐 Google API Setup Instructions
To run this project with Google Earth Engine and Google Drive access, follow the steps below to create and configure your credentials.
1. ✅ Create a Service Account
In the Google Cloud Console, do the following:
- Go to IAM & Admin → Service Accounts → Create Service Account
- Assign the following roles to the Service Account:
OwnerService Usage AdminService Usage ConsumerStorage AdminStorage Object Creator
2. 🔑 Assign Roles to Your Personal Account
Make sure your main Google Cloud account (the one you'll log in with) has these roles:
OwnerService Usage AdminService Usage Consumer
3. 🧭 Create OAuth Credentials (for Google Drive Access)
Still in the Google Cloud Console:
- Go to APIs & Services → Credentials → + Create Credentials → OAuth Client ID
- If prompted, configure the OAuth consent screen:
- Choose Desktop App
- Provide a name (e.g., "Drive Access")
- Once created:
- Download the JSON file (this is your OAuth credentials)
- Save the
client_idandclient_secret(you’ll use these in your config)
4. 🚀 Enable Required APIs
In the left-hand menu:
- Go to APIs & Services → Library
- Enable the following APIs:
Google Drive APIGoogle Earth Engine API
5. 👤 Add Test Users (Required for OAuth)
- Go to APIs & Services → OAuth consent screen
- Scroll to the Test Users section
- Click + Add Users and add your personal Google account (the one you'll use for authentication)
Install Instructions
For the stable build:
pip install ee-wildfire
For the experimental build:
git clone git@github.com:KylesCorner/Earth-Engine-Wildfire-Data.git
cd Earth-Engine-Wildfire-Data
pip install -e .
Configuration
This program uses a YAML file for user configuration.
Template for configuration:
# NEEDED
# These items are necessary to function.
project_id: YOUR PROJECT ID
credentials: ~/ee_wildfire_data/OAuth/credentials.json
# OPTIONAL
# These items have default values if not provided in YAML file.
data_dir: ~/ee_wildfire_data
start_date: 2021-01-01 00:00:00
end_date: 2021-04-20 00:00:00
tiff_dir: ~/ee_wildfire_data/tiff/2021
drive_dir: EarthEngine_WildfireSpreadTS_2021
download: false
export: false
min_size: 10000000.0
max_size: 1000000000.0
To finish configuration you will need to use the -config command line argument.
Command-Line Interface (CLI)
| Argument | Parameters | Description |
|---|---|---|
-config |
PATH |
Loads a YAML config file located at PATH. This will overload any other command-line arguments. |
-show-config |
None | Prints current config to command line. |
-export |
None | Export data from Google Earth Engine to Google Drive. |
-download |
None | Downloads data from Google Drive to your local machine. |
Basic Usage
ee-wildfire -config /path/to/some/config.yml -show-config
ee-wildfire -export -download
Acknowledgements
This project builds on work from the WildfireSpreadTSCreateDataset. Credit to original authors for providing data, methods, and insights.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file ee_wildfire-2025.1.5.tar.gz.
File metadata
- Download URL: ee_wildfire-2025.1.5.tar.gz
- Upload date:
- Size: 121.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
644c4f34767c6afbab15f48a4c13970a7a831b708a6b05d57b69111d7f798ad3
|
|
| MD5 |
304596867c3ddedc0785c15d394013ec
|
|
| BLAKE2b-256 |
3a4bfbe4ad93373683d8b2e9be71dedc8a8420b3bf6ec0cbf3d1577c60df1411
|
File details
Details for the file ee_wildfire-2025.1.5-py3-none-any.whl.
File metadata
- Download URL: ee_wildfire-2025.1.5-py3-none-any.whl
- Upload date:
- Size: 138.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.10.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
e7f5815c3e9478ad6ef5be3b093de812f56646f16b71cfbb439900fc51766db1
|
|
| MD5 |
c34b9bcc0d6be53c5a64e7cc9156d6d9
|
|
| BLAKE2b-256 |
eecd585b259eb29c964a7a57956a10d37c0fce0fd6f6bb42f51ffdce1b8ff3ad
|