Skip to main content

Python package to pull PRISM weather data via web automation.

Project description

prism-pull

prism-pull is a python package made to pull data from PRISM Group using web automation. For those not familiar with PRISM Group, via the PRISM website:

The PRISM Group gathers weather observations from a wide range of monitoring networks, applies
sophisticated quality control measures, and develops spatial datasets to reveal short- and 
long-term weather patterns. The resulting datasets incorporate a variety of modeling techniques 
and are available at multiple spatial/temporal resolutions, covering the period from 1895 to 
the present. 

The types of weather data consist of:

  • precipitaion totals
  • minimum temperatures
  • mean temperatures
  • maximum temperatures
  • minimum vapor pressure deficit
  • maximum vapor pressure deficit
  • mean dewpoint temperature
  • cloud transmittance
  • horizontal surface solar radiation data
  • sloped surface solar radiation data
  • clear sky solar radiation data

These data are available across a variety of timescales for each cell of a 4km by 4km or 800m by 800m grid covering the entire continential United States. This makes it an especially great source for locations where weather stations may not be operating.

Installation

Prerequisites:

  • pip
  • Google Chrome
  • Python3.10 or higher

Install with: pip install prism-pull

Usage

Remember to follow the PRISM Group terms of use for whatever your project may be. Usage is simple, and will be familiar to anyone who has used the PRISM GUI in the past. The package consists of one class and it's associated getter methods, as well as a method to close your session:

  • PrismSession
    • close
    • get_30_year_monthly_normals
    • get_30_year_daily_normals
    • get_annual_values
    • get_single_month_values
    • get_monthly_values
    • get_daily_values

Each getter method has two to three required arguments which are common to all of them. They are:

  • is_bulk_request
    • Set to True if you are providing a .csv for bulk location request. False otherise.
      • If set to True, you must provide a string csv_path.
      • If set to False, you must provide int/float latitude and longitude.
  • csv_path
    • A string path pointing to the .csv you want to use for a bulk request.
    • Your .csv input should have three columns:
      • Column 1:
        • latitude: int/float
      • Column 2:
        • longitude: int/float
      • Column 3:
        • name: string fewer than 13 characters in length
  • latitude
    • An integer or floating point latitude coordinate.
  • longitude
    • An integer of floating point longitude coordinate.

PrismSession

Generate a new PrismSession:

import prism_pull.prism_session as pp

session = pp.PrismSession()

Your PrismSession object can be initialized with two optional arguments:

  • download_dir:
    • The directory where prism-pull will download the results of your PRISM queries.
    • Default: your current working directory
  • driver_wait:
    • The time (in seconds) prism-pull web driver will wait before moving onto the next step. Consider increasing if you have poor download speeds.
    • Default: 5 seconds

Here's an example of setting up a session with these arguments:

import prism_pull.prism_session as pp

session = pp.PrismSession(download_dir='absolute/path/to/download/to', driver_wait=10)

close

Causes your session's WebDriver to quit. Run this command at the end of your session to clean up any associated WebDriver resources. Here's an example usage:

import prism_pull.prism_session as pp

session = pp.PrismSession()

<run your prism session commands>

session.close()

get_30_year_monthly_normals

Returns the average monthly conditions over the previous three decades for the provided latitude and longitude or csv_path. Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_30_year_monthly_normals(
    is_bulk_request=False,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,
    cloud_transmittance=False,
    solar_rad_horiz_sfc=False,
    solar_rad_sloped_sfc=False,
    solar_rad_clear_sky=False
)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_30_year_monthly_normals(
    is_bulk_request=True,
    csv_path="tests/resources/small_coordinates.csv",
    max_temp=True,
    solar_rad_horiz_sfc=True,
    solar_rad_sloped_sfc=True
)

get_30_year_daily_normals

Returns the average daily conditions over the previous three decades for the provided latitude and longitude or csv_path. Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_30_year_daily_normals(
    is_bulk_request=False,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,
)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_30_year_daily_normals(
    is_bulk_request=True,
    csv_path="tests/resources/small_coordinates.csv",
    max_temp=True,
    mean_temp=False
)

get_annual_values

Returns average or total data for selected measurements for each year from start_year to end_year, for the provided latitude and longitude or csv_path. Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_annual_values(
    is_bulk_request=False,
    start_year=2015,
    end_year=2023,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,
)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_annual_values(
    is_bulk_request=False,
    start_year=1960,
    end_year=1966,
    csv_path="tests/resources/small_coordinates.csv",
    precipitation=False,
    max_temp=True,
    min_vpd=True,
    max_vpd=True,
)

get_single_month_values

Returns average or total data for selected measurements for each month each year from start_year to end_year, for the provided latitude and longitude or csv_path. NOTE: any data collected within the past six months is considered provisional and may be subject to revisions.

Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_single_month_values(
    is_bulk_request=False,
    month=4,
    start_year=1980,
    end_year=1990,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,
)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_single_month_values(
        is_bulk_request=True,
        month=11,
        start_year=2021,
        end_year=2024,
        csv_path="tests/resources/small_coordinates.csv",
        min_vpd=True,
        max_vpd=True,
)

get_monthly_values

Returns average or total data for selected measurements for every month from start_month, start_year to end_month, end_year, for the provided latitude and longitude or csv_path. NOTE: any data collected within the past six months is considered provisional and may be subject to revisions.

Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_monthly_values(
    is_bulk_request=False,
    start_month=2,
    start_year=2011,
    end_month=9,
    end_year=2024,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,

)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_monthly_values(
    is_bulk_request=True,
    start_month=2,
    start_year=2011,
    end_month=9,
    end_year=2024,
    csv_path="tests/resources/small_coordinates.csv",
    precipitation=False,
    mean_dewpoint_temp=True,
)

get_daily_values

Returns average or total data for selected measurements for each day from start_date, start_month, start_year to end_date, end_month, end_year, for the provided latitude and longitude or csv_path. NOTE: any data collected within the past six months is considered provisional and may be subject to revisions.

Here's an example usage showing a non-bulk request, and all the available weather inputs (precipitation, min_temp, etc.) set to their defaults:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_daily_values(
    is_bulk_request=False,
    start_date=16,
    start_month=11,
    start_year=1995,
    end_date=16,
    end_month=11,
    end_year=2009,
    latitude=40.9473,
    longitude=-112.2170,
    precipitation=True,
    min_temp=False,
    mean_temp=True,
    max_temp=False,
    min_vpd=False,
    max_vpd=False,
    mean_dewpoint_temp=False,
)

Here's an example using a .csv for a bulk request, and setting a few non-default weather inputs:

import prism_pull.prism_session as pp

session = pp.PrismSession()

session.get_daily_values(
    is_bulk_request=True,
    start_date=16,
    start_month=11,
    start_year=1995,
    end_date=16,
    end_month=11,
    end_year=2009,
    csv_path="tests/resources/small_coordinates.csv",
    min_temp=True,
    min_vpd=True,
)

Testing

This repo uses pytest for testing. In order to run locally, execute the following from the terminal:

pytest tests

Contributing

If you work on this repo as a collaborator, shoot me an email at jtbaird95@gmail.com or create an issue and we'll get in touch.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

prism_pull-0.1.9.tar.gz (15.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

prism_pull-0.1.9-py3-none-any.whl (10.9 kB view details)

Uploaded Python 3

File details

Details for the file prism_pull-0.1.9.tar.gz.

File metadata

  • Download URL: prism_pull-0.1.9.tar.gz
  • Upload date:
  • Size: 15.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for prism_pull-0.1.9.tar.gz
Algorithm Hash digest
SHA256 8c5c756cb8503e9832437b47c9636246ca3ef9953ae0f0b7e1a69c6eb93aefec
MD5 54e55220b1beb059fe44574de9f3dee5
BLAKE2b-256 126556e5cb7d345354ae63db49b16836130b88820cdef6529c274f161d26adf1

See more details on using hashes here.

File details

Details for the file prism_pull-0.1.9-py3-none-any.whl.

File metadata

  • Download URL: prism_pull-0.1.9-py3-none-any.whl
  • Upload date:
  • Size: 10.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for prism_pull-0.1.9-py3-none-any.whl
Algorithm Hash digest
SHA256 2af93ec3d7244dba803d2e33804e0aae89a36ab43b53f431f0c738f7758a138d
MD5 f4f282882466a934c6609519dba71ab5
BLAKE2b-256 abd5b018e6dd74f4059889d44eed4877df850c7fb653d2dca7e9767e08ac8b9f

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page