Skip to main content

Python package to pull PRISM weather data via web automation.

Project description

prism-pull

prism-pull is a python package made to pull data from PRISM Group using web automation. For those not familiar with PRISM Group, via the PRISM website:

The PRISM Group gathers weather observations from a wide range of monitoring networks, applies
sophisticated quality control measures, and develops spatial datasets to reveal short- and 
long-term weather patterns. The resulting datasets incorporate a variety of modeling techniques 
and are available at multiple spatial/temporal resolutions, covering the period from 1895 to 
the present. 

The types of weather data consist of:

  • precipitaion totals
  • minimum temperatures
  • mean temperatures
  • maximum temperatures
  • minimum vapor pressure deficit
  • maximum vapor pressure deficit
  • mean dewpoint temperature
  • cloud transmittance
  • horizontal surface solar radiation data
  • sloped surface solar radiation data
  • clear sky solar radiation data

These data are available across a variety of timescales for each cell of a 4km by 4km or 800m by 800m grid covering the entire continential United States. This makes it an especially great source for locations where weather stations may not be operating.

Installation

Prerequisites:

  • pip
  • Google Chrome
  • Python3.10 or higher

Install with: pip install prism-pull

Usage

Remember to follow the PRISM Group terms of use for whatever your project may be. Usage is simple, and will be familiar to anyone who has used the PRISM GUI in the past. The package consists of one class and it's associated getter methods, as well as a method to close your session:

  • PrismSession
    • close
    • get_30_year_monthly_normals
    • get_30_year_daily_normals
    • get_annual_values
    • get_single_month_values
    • get_monthly_values
    • get_daily_values

Each getter method has two to three required arguments which are common to all of them. They are:

  • is_bulk_request
    • Set to True if you are providing a .csv for bulk location request. False otherise.
      • If set to True, you must provide a string csv_path.
      • If set to False, you must provide int/float latitude and longitude.
  • csv_path
    • A string path pointing to the .csv you want to use for a bulk request.
    • Your .csv input should have three columns:
      • Column 1:
        • latitude: int/float
      • Column 2:
        • longitude: int/float
      • Column 3:
        • name: string fewer than 13 characters in length
  • latitude
    • An integer or floating point latitude coordinate.
  • longitude
    • An integer of floating point longitude coordinate.

PrismSession

Generate a new PrismSession:

import prism_pull.prism_session as pp

session = pp.PrismSession()

Your PrismSession object can be initialized with two optional arguments:

  • download_dir:
    • The directory where prism-pull will download the results of your PRISM queries.
    • Default: your current working directory
  • driver_wait:
    • The time (in seconds) prism-pull web driver will wait before moving onto the next step. Consider increasing if you have poor download speeds.
    • Default: 5 seconds

Here's an example of setting up a session with these arguments:

import prism_pull.prism_session as pp

session = pp.PrismSession(download_dir='absolute/path/to/download/to', driver_wait=10)

close

Causes your session's WebDriver to quit. Run this command at the end of your session to clean up any associated WebDriver resources. Here's an example usage:

import prism_pull.prism_session as pp

session = pp.PrismSession()

<run your prism session commands>

session.close()

get_30_year_monthly_normals

Returns the average monthly conditions over the previous three decades for the provided latitude and longitude or csv_path. Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_30_year_monthly_normals(
    is_bulk_request=False,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,
    cloud_transmittance=False,
    solar_rad_horiz_sfc=False,
    solar_rad_sloped_sfc=False,
    solar_rad_clear_sky=False
)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_30_year_monthly_normals(
    is_bulk_request=True,
    csv_path="tests/resources/small_coordinates.csv",
    max_temp=True,
    solar_rad_horiz_sfc=True,
    solar_rad_sloped_sfc=True
)

get_30_year_daily_normals

Returns the average daily conditions over the previous three decades for the provided latitude and longitude or csv_path. Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_30_year_daily_normals(
    is_bulk_request=False,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,
)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_30_year_daily_normals(
    is_bulk_request=True,
    csv_path="tests/resources/small_coordinates.csv",
    max_temp=True,
    mean_temp=False
)

get_annual_values

Returns average or total data for selected measurements for each year from start_year to end_year, for the provided latitude and longitude or csv_path. Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_annual_values(
    is_bulk_request=False,
    start_year=2015,
    end_year=2023,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,
)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_annual_values(
    is_bulk_request=False,
    start_year=1960,
    end_year=1966,
    csv_path="tests/resources/small_coordinates.csv",
    precipitation=False,
    max_temp=True,
    min_vpd=True,
    max_vpd=True,
)

get_single_month_values

Returns average or total data for selected measurements for each month each year from start_year to end_year, for the provided latitude and longitude or csv_path. NOTE: any data collected within the past six months is considered provisional and may be subject to revisions.

Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_single_month_values(
    is_bulk_request=False,
    month=4,
    start_year=1980,
    end_year=1990,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,
)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_single_month_values(
        is_bulk_request=True,
        month=11,
        start_year=2021,
        end_year=2024,
        csv_path="tests/resources/small_coordinates.csv",
        min_vpd=True,
        max_vpd=True,
)

get_monthly_values

Returns average or total data for selected measurements for every month from start_month, start_year to end_month, end_year, for the provided latitude and longitude or csv_path. NOTE: any data collected within the past six months is considered provisional and may be subject to revisions.

Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_monthly_values(
    is_bulk_request=False,
    start_month=2,
    start_year=2011,
    end_month=9,
    end_year=2024,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,

)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_monthly_values(
    is_bulk_request=True,
    start_month=2,
    start_year=2011,
    end_month=9,
    end_year=2024,
    csv_path="tests/resources/small_coordinates.csv",
    precipitation=False,
    mean_dewpoint_temp=True,
)

get_daily_values

Returns average or total data for selected measurements for each day from start_date, start_month, start_year to end_date, end_month, end_year, for the provided latitude and longitude or csv_path. NOTE: any data collected within the past six months is considered provisional and may be subject to revisions.

Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_daily_values(
    is_bulk_request=False,
    start_date=16,
    start_month=11,
    start_year=1995,
    end_date=16,
    end_month=11,
    end_year=2009,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,
)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_daily_values(
    is_bulk_request=True,
    start_date=16,
    start_month=11,
    start_year=1995,
    end_date=16,
    end_month=11,
    end_year=2009,
    csv_path="tests/resources/small_coordinates.csv",
    min_temp=True,
    min_vpd=True,
)

Testing

This repo uses pytest for testing. In order to run locally, execute the following from the terminal:

pytest tests

Contributing

If you work on this repo as a collaborator, shoot me an email at jtbaird95@gmail.com or create an issue and we'll get in touch.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

prism_pull-0.1.7.tar.gz (15.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

prism_pull-0.1.7-py3-none-any.whl (10.5 kB view details)

Uploaded Python 3

File details

Details for the file prism_pull-0.1.7.tar.gz.

File metadata

  • Download URL: prism_pull-0.1.7.tar.gz
  • Upload date:
  • Size: 15.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for prism_pull-0.1.7.tar.gz
Algorithm Hash digest
SHA256 b0a1ae85812ea9d0a374690f351bd05d32ee329e7d15d7f8df1503f7e6d57e9e
MD5 b3e2daca5455f8f3185812a9d92254d3
BLAKE2b-256 11b3eb95589e2f56c08a273414483cc76c4aab20975e335ee762308cb7b90642

See more details on using hashes here.

File details

Details for the file prism_pull-0.1.7-py3-none-any.whl.

File metadata

  • Download URL: prism_pull-0.1.7-py3-none-any.whl
  • Upload date:
  • Size: 10.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for prism_pull-0.1.7-py3-none-any.whl
Algorithm Hash digest
SHA256 cd0cc9265d55df312bc494f56011416fc58736381b0754a0294701f501f30f47
MD5 d28e50333966065f177d086cc2d27038
BLAKE2b-256 53d2620dccba69637bb769bea4ba1104fb6190299f8421f72e625d223402787c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page