wrf_to_int 0.1.2

Utility to convert wrf output to WPS intermediate files

wrf_to_int

Utility to convert wrf output to WPS intermediate files

---

Source Code: https://github.com/wrf_to_int

---

Overview

This package provides two things:

1. A command line utility that converts wrfout files to WPS intermediate files for use with metgrid.exe
2. A shared library for writing WPS intermediate files, used by era5_to_int and cfdb-ingest

WRF stores data on native eta/sigma levels using an Arakawa C-grid with staggered variables. The CLI tool handles:

• Vertical interpolation from eta levels to pressure levels (linear interpolation in ln(pressure) space)
• Unstaggering of U, V, and geopotential height fields
• Wind rotation from grid-relative to earth-relative using COSALPHA/SINALPHA
• Variable derivation (temperature from potential temperature, geopotential height from PH+PHB, relative humidity, dewpoint, sea level pressure, specific humidity)
• All standard WRF projections: Lambert Conformal, Polar Stereographic, Mercator, and Lat-Lon

Installation

pip install wrf_to_int
# or
uv add wrf_to_int

Usage

Basic usage

Convert wrfout files from a directory, specifying a date range:

wrf_to_int /path/to/wrfout/files/ -s 2023-02-10 -e 2023-02-10_12

Multiple input files

Pass individual wrfout files directly:

wrf_to_int wrfout_d02_2023-02-10_00:00:00.nc wrfout_d02_2023-02-11_00:00:00.nc -s 2023-02-10 -e 2023-02-11

Options

wrf_to_int <wrfout_paths...> --start-date DATE --end-date DATE [options]

Arguments:
  wrfout_paths              One or more wrfout file paths, or a single directory

Required options:
  -s, --start-date DATE     Starting date-time to convert
  -e, --end-date DATE       Ending date-time to convert

Optional:
  -h, --hour-interval N     Interval in hours between records (default: 6)
  -d, --domain DOMAIN       WRF domain to process (e.g., d01, d02). Required
                            when a directory contains files from multiple domains.
  -l, --pressure-levels L   Comma-separated pressure levels in hPa
                            (default: 1000,975,950,...,30,20,10)
  -p, --prefix PREFIX       Prefix for output files (default: WRF)
  -v, --variables VARS      Comma-separated WPS variable names to process

Date formats supported: YYYY-MM-DD, YYYY-MM-DD_HH, YYYY-MM-DDTHH:MM:SS.

Output

One WPS intermediate file per timestep, named {PREFIX}:{YYYY-MM-DD_HH} (e.g., WRF:2023-02-10_00).

Domain auto-detection

When a directory contains wrfout files from multiple domains (e.g., wrfout_d01_* and wrfout_d02_*), you must specify which domain to process with --domain:

wrf_to_int /path/to/wrfout/ -s 2023-02-10 -e 2023-02-10 -d d02

If the directory contains only one domain, it is auto-detected.

Custom pressure levels

By default, the tool interpolates to 26 standard pressure levels. To specify custom levels:

wrf_to_int /path/to/wrfout/ -s 2023-02-10 -e 2023-02-10 -l 1000,850,700,500,300,200,100

WPS pipeline

After generating intermediate files, use them with metgrid.exe by setting fg_name in your namelist.wps:

&metgrid
 fg_name = '/path/to/output/WRF'
 ...
/

Then run metgrid.exe as usual. The intermediate files contain all the fields metgrid needs for the target subdomain (pressure-level and surface meteorological fields, soil fields, land-sea mask, etc.).

WPS intermediate file output

Pressure-level fields (one slab per level)

WPS Field	Description	WRF Source
TT	Temperature (K)	T, P, PB (theta to actual T)
UU	U-wind (m/s)	U (unstaggered, earth-relative)
VV	V-wind (m/s)	V (unstaggered, earth-relative)
GHT	Geopotential height (m)	PH, PHB (unstaggered)
RH	Relative humidity (%)	T, QVAPOR, P, PB
SPECHUMD	Specific humidity (kg/kg)	QVAPOR

Surface fields

WPS Field	Description	WRF Source
PSFC	Surface pressure (Pa)	PSFC
PMSL	Mean sea level pressure (Pa)	PSFC, T2, HGT
SKINTEMP	Skin temperature (K)	TSK
TT	2m temperature (K)	T2
UU	10m U-wind (m/s)	U10 (earth-relative)
VV	10m V-wind (m/s)	V10 (earth-relative)
DEWPT	2m dewpoint (K)	Q2, PSFC
RH	2m relative humidity (%)	T2, Q2, PSFC
LANDSEA	Land-sea mask (0/1)	XLAND
SEAICE	Sea ice fraction	SEAICE
SST	Sea surface temperature (K)	SST
SOILHGT	Terrain height (m)	HGT
SNOW	Snow water equivalent (kg/m2)	SNOW
SNOWH	Physical snow depth (m)	SNOWH
SM/ST	Soil moisture/temperature	SMOIS, TSLB (per layer from DZS)

Library API

This package exports shared tools for writing WPS intermediate files. Other *_to_int converters can depend on wrf_to_int instead of duplicating the Fortran I/O and WPS format code.

from wrf_to_int import IntermediateFile, Projections, MapProjection, write_slab

Projections

Enum of WPS intermediate file projection codes:

Projections.LATLON   # 0 - Cylindrical equidistant
Projections.MERC     # 1 - Mercator
Projections.LC       # 3 - Lambert Conformal
Projections.GAUSS    # 4 - Gaussian
Projections.PS       # 5 - Polar Stereographic
Projections.CASSINI  # 6 - Cassini

MapProjection

Stores projection parameters for the WPS intermediate file header:

proj = MapProjection(
    projType=Projections.LC,
    startLat=-47.43, startLon=165.32,
    startI=1.0, startJ=1.0,
    deltaLat=0.0, deltaLon=0.0,
    dx=3.0, dy=3.0,           # km (not meters)
    truelat1=-41.24, truelat2=-41.24,
    xlonc=178.29,
)

IntermediateFile

Opens and writes a WPS intermediate format binary file:

intfile = IntermediateFile('ERA5', '2023-02-10_00')  # creates ERA5:2023-02-10_00
# ... write slabs ...
intfile.close()

write_slab

Writes a single 2D field to an open intermediate file. Handles NaN masking, bytes-to-string decoding, and numpy array conversion automatically:

write_slab(intfile, slab, xlvl, proj, 'TT', hdate, 'K', 'ERA5 reanalysis', 'Temperature')

Parameters:

• intfile — an IntermediateFile instance
• slab — 2D numpy array (ny, nx)
• xlvl — pressure level in Pa, or special values: 200100.0 (surface), 201300.0 (MSL), 1.0 (terrain)
• proj — a MapProjection instance
• WPSname — WPS field name (e.g., 'TT', 'UU', 'GHT')
• hdate — date string in WPS format ('YYYY-MM-DD_HH:00:00')
• units, map_source, desc — metadata strings

Example: building a custom converter

from wrf_to_int import IntermediateFile, Projections, MapProjection, write_slab
import numpy as np

proj = MapProjection(
    projType=Projections.LATLON,
    startLat=-10.0, startLon=120.0,
    startI=1.0, startJ=1.0,
    deltaLat=-0.25, deltaLon=0.25,
)

intfile = IntermediateFile('MYDATA', '2023-02-10_00')

slab = np.random.randn(201, 321).astype(np.float32)
write_slab(intfile, slab, 200100.0, proj, 'TT', '2023-02-10_00:00:00',
           'K', 'Custom source', '2m Temperature')

intfile.close()

Implementation notes

WPS intermediate file format

This tool was initially based on the WPS intermediate file writing code from era5_to_int. During testing with metgrid.exe, several issues were discovered in the shared WPSUtils.py module that only manifested when writing non-LATLON projections (Lambert Conformal, Polar Stereographic, Mercator). These issues were invisible in era5_to_int because ERA5 data always uses the LATLON projection.

Projection codes: The WPS intermediate file format uses different integer codes for projections than the WPS internal codes. The correct mapping for the intermediate file is:

Projection	File code	WPS internal code
Lat-Lon	0	PROJ_LATLON
Mercator	1	PROJ_MERC
Lambert Conformal	3	PROJ_LC
Gaussian	4	PROJ_GAUSS
Polar Stereographic	5	PROJ_PS
Cassini	6	PROJ_CASSINI

The original WPSUtils.py had LC=1, PS=2, MERC=3 (matching WPS internal codes, not the file format codes). Using the wrong projection code causes metgrid to misread the projection-specific record, since each projection has a different number of fields (e.g., LC has 8 floats, MERC has 6). This resulted in garbage values for truelat1 and the error: Set true latitude 1 for all projections!

dx/dy units: metgrid reads dx and dy from the intermediate file and multiplies by 1000 (i.e., it expects values in km, not meters). WRF stores DX/DY in meters, so the values must be divided by 1000 before writing. Writing meters (e.g., 3000.0) results in metgrid interpreting it as 3000 km.

earth_radius units: Same convention as dx/dy. metgrid multiplies the earth_radius value from the intermediate file by 1000, so it expects the value in km (6371.229), not meters (6371229.0). ERA5 (era5_to_int) writes meters but this doesn't cause issues because the LATLON projection doesn't use earth_radius for grid positioning. For Lambert Conformal and other projected grids, the incorrect earth radius causes projection math errors, leading to missing values during interpolation.

Development

Setup environment

We use UV to manage the development environment and production build.

uv sync

Run unit tests

You can run all the tests with:

uv run pytest

Format the code

Execute the following commands to apply linting and check typing:

uv run ruff check .
uv run black --check --diff .
uv run mypy --install-types --non-interactive wrf_to_int

To auto-format:

uv run black .
uv run ruff check --fix .

License

This project is licensed under the terms of the Apache Software License 2.0.