Skip to main content

Create catalogs, data, and metadata for hydrologic modeling in the cloud.

Project description

StormHub

CI Documentation Status Release PyPI version

StormHub is an open-source Python library designed to access and process publicly available hydrometeorological data to create catalogs, metadata, and data products for hydrologic modeling. This project automates the generation of STAC catalogs from storm and stream gage data, enabling improved analysis and simulation for flood studies and stochastic storm transposition (SST). StormHub aims to follow the principles of FAIR (Findable, Accessible, Interoperable, and Reusable) practices, ensuring that all catalogs can be easily reproduced, shared, published, and integrated into broader workflows.

Overview

StormHub consists of two primary modules, with a focus on storm data and stream gage metadata:

1. Storm Transposition Module

This module extends the work of RainyDay2 developed by Daniel Wright's Hydroclimate Extremes Research group at the University of Wisconsin-Madison. It allows users to perform stochastic storm transposition (SST) by systematically shifting a watershed over a predefined transposition region and summing precipitation from existing datasets.

Key Features:

  • Uses the recently published AORC hourly 1km gridded precipitation dataset.
  • Sums precipitation over a time slice (e.g., 72 hours).
  • Generates a catalog ranking storms by mean precipitation over the transposition region.
  • Filters storms that exceed a minimum precipitation threshold.
  • Stores qualified storms as STAC items with metadata, including:
    • Storm statistics (e.g., total precipitation, duration).
    • Centroid location of the watershed at the point of maximum mean precipitation.
  • Links to associated watershed and transposition region STAC items.
  • Supports creation of DSS files (hourly gridded) for use in HEC-HMS for hydrologic modeling.

Note on hec-dss: To export gridded time series data from xarray to hecdss, hec-dss-python is required. Please visit the repo for details and installation instructions.

2. USGS Gage Catalog Module

This module creates a STAC catalog of USGS stream gages, including frequency analysis data and metadata notes providing a moment in time copy of historic observations.

The catalog stores USGS gage items with:

  • Frequency data as assets.
  • Metadata and plots supporting flood frequency analysis.
  • Links to related datasets for direct comparison within SST workflows.

STAC Server

StormHub includes an HTTP server that serves STAC items locally, allowing users to visualize and explore catalogs for both storms and stream gages. The server integrates with Radiant Earth's STAC Browser for seamless data viewing.

FAIR Data Sharing and Publishing

StormHub facilitates FAIR data principles by enabling:

  • Exporting catalogs as zip files for easy sharing and archiving.
  • Publishing STAC items directly to a STAC API.
  • Copying catalogs and metadata to cloud blob stores for scalable access and distribution.

Installation

# Using pip
pip install stormhub

# From source: Clone the repository
git clone https://github.com/dewberry/stormhub.git

# Navigate to the project directory
cd stormhub

# Install the package
pip install -e .

Usage

See the User Guide.

Sources and References

  • AORC Dataset - 1km hourly gridded precipitation data, available through NOAA.
  • RainyDay2 - Stochastic Storm Transposition framework by the Hydroclimate Extremes Research Group
  • USGS Stream Gage Data - Accessed via NWIS API.

Output

  • STAC Catalogs for storm and gage data.
  • DSS Files for hydrologic modeling.
  • JSON metadata files for integration with existing geospatial workflows.

Attribution

This project builds on the work of Daniel Wright's RainyDay2 and leverages publicly available datasets from NOAA and USGS.

License

StormHub is licensed under the MIT License. See LICENSE for more information.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

stormhub-0.4.0.tar.gz (50.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

stormhub-0.4.0-py3-none-any.whl (56.2 kB view details)

Uploaded Python 3

File details

Details for the file stormhub-0.4.0.tar.gz.

File metadata

  • Download URL: stormhub-0.4.0.tar.gz
  • Upload date:
  • Size: 50.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.19

File hashes

Hashes for stormhub-0.4.0.tar.gz
Algorithm Hash digest
SHA256 ae99f9b75e4d158f620b77dc62571de3c9279302be7a330311145bc1dfd0f7d5
MD5 baaab1f1ced9f5538606e0bcb4d7a9ba
BLAKE2b-256 cc0674bf465350e756f2a79ea058d7255dc488160009d3b22d8a31ee5a87ae6f

See more details on using hashes here.

File details

Details for the file stormhub-0.4.0-py3-none-any.whl.

File metadata

  • Download URL: stormhub-0.4.0-py3-none-any.whl
  • Upload date:
  • Size: 56.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.10.19

File hashes

Hashes for stormhub-0.4.0-py3-none-any.whl
Algorithm Hash digest
SHA256 76e7e5914beff7cfabcbb62c98c2f12774c628eb7ea51d87183181d60d97a1d7
MD5 09be7dc140ff2f10805487501cda2f93
BLAKE2b-256 8b63956eb0724b84455909fb58ffd0191331834fe085fd94d613abdd66fdb28e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page