Skip to main content

ICON Grid Generator

Tests Docs PyPI Python License

Pure Python generation of deterministic ICON-style triangular grids.

Global ICON grid resolutions

The package provides spherical R<n>B<k> grids, planar triangular grids, limited-area extraction, geometry diagnostics and transforms, xarray conversion, and ICON-compatible NetCDF export. The same file-oriented API handles every grid family. File-oriented generation computes NetCDF-only fields in bounded chunks; large global grids and large global construction parents for limited-area grids also use compact staged generation and resumable disk checkpoints.

Installation

The base package requires Python 3.10 or newer and NumPy:

python -m pip install icon-grid-generator

With uv, add the package to an existing project:

uv add icon-grid-generator

For a standalone uv-managed virtual environment, use:

uv venv
uv pip install icon-grid-generator

The NetCDF calls in the quick start require the netcdf extra. Install acceleration and common output integrations for high-resolution work with:

python -m pip install "icon-grid-generator[accelerate,netcdf,xarray]"

The equivalent uv command for an existing project is:

uv add "icon-grid-generator[accelerate,netcdf,xarray]"

Numba acceleration is optional for in-memory grids and required for the high-resolution export-first path.

Quick Start

Generate an in-memory grid and write the complete NetCDF schema:

from grid_generator import generate_grid

grid = generate_grid("R2B4")
print(grid.name, grid.dims)
grid.to_netcdf("icon_grid_R02B04.nc")

NetCDF grid_geometry follows ICON's geometry enum: spherical global and limited-area grids use 1, planar tori use 2, planar channels use 3, and general planar grids use 4. Regional spherical files carry a separate open_boundary=1 attribute; openness is not a coordinate-geometry type. ICON 2024.10's standard NWP interpolation path supports spherical grids and planar tori, but not its channel or general-plane enum values; those additional planar families remain useful for diagnostics and consumers with matching operators rather than as standard ICON-NWP simulation grids. Planar files write domain_length and domain_height from the physical spec extents; they never inherit spherical-Earth dimensions.

Planar tori use rectangular, independently wrapped x/y periods by default and therefore require an even number of rows. The former coupled skew lattice remains available explicitly:

from grid_generator import TorusGridSpec, generate_grid

torus = generate_grid(TorusGridSpec(nx=12, ny=6, edge_length=1_000.0))
skew_torus = generate_grid(
    TorusGridSpec(nx=12, ny=5, edge_length=1_000.0, periodic_layout="skew")
)

Generate any grid directly to NetCDF when the in-memory object is not needed:

from grid_generator import TorusGridSpec, generate_grid_to_netcdf

generate_grid_to_netcdf(
    TorusGridSpec(nx=12, ny=6, edge_length=1_000.0),
    "torus.nc",
)

The same call automatically selects compact checkpoint stages for a large global grid, or for the global parent of a limited-area request:

from grid_generator import generate_grid_to_netcdf

generate_grid_to_netcdf(
    "R2B8",
    "icon_grid_R02B08.nc",
    max_cells=None,
    accelerator="numba",
    work_dir="icon-grid-R2B08-work",
    fields="reduced",
)

All grid types use the same validated, chunked, atomic file-publication path. Global grids and limited-area construction parents add resumable bisection checkpoints when they exceed the in-memory base-stage budget. Regional selection is evaluated in chunks directly against that compact parent, so a LAM based on R2B12 no longer requires a complete global R2B11/R2B12 IconGrid; only the selected regional result is materialized. Planar grids have no multilevel refinement stages to checkpoint, and use preallocated array builders that avoid per-cell and per-edge Python object graphs. R2B8 is a practical first large-grid example at about 9.86 km resolution; check the resource tables before requesting finer grids.

The default full profile contains 88 fields, including the established quadrilateral_area, vlon_vertices, and vlat_vertices fields. reduced contains the 46-field union required by the standard ICON and icon4py global-grid readers. Dedicated icon and icon4py profiles and exact custom field lists are also available. Place large outputs and checkpoint directories on disk-backed storage. Each checkpoint manifest atomically selects a complete array snapshot, so an interrupted overwrite leaves the preceding completed checkpoint resumable. The final NetCDF file is also published atomically after it closes successfully. Allow extra disk headroom when replacing checkpoints or an existing output: old and new snapshots/files can coexist temporarily. After a successful export, the work directory can be deleted unless it is being kept for a later resume.

Performance

Measurements used an exclusive dual-socket AMD EPYC 7713 node with 128 physical cores and about 446 GiB of available memory. Times cover independent generation and uncompressed NetCDF export; shared-filesystem I/O varies with storage load. R2B12 has approximately 0.616 km resolution and is the largest standard R2 grid whose one-based exported identifiers fit signed 32-bit integers.

R2B12 output Generation NetCDF export Total Peak RSS Checkpoints NetCDF
Full (85-field timing) 43.51 min 91.24 min 134.74 min 328.18 GiB 162.46 GiB 1,047.50 GiB
Reduced 42.03 min 42.05 min 84.08 min 328.18 GiB 162.46 GiB 485.00 GiB

The full timing predates the three added grid-description fields. The current 88-field R2B12 payload is approximately 1,122.5 GiB; it requires a new scaling run before quoting an updated export time.

See Performance and Scaling for R2B8–R2B12 measurements, component timings, validation details, and all field-profile storage sizes.

Documentation

Citation metadata is provided in CITATION.cff. The package is distributed under the BSD 3-Clause License.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

icon_grid_generator-0.8.1.tar.gz (1.1 MB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

icon_grid_generator-0.8.1-py3-none-any.whl (104.1 kB view details)

Uploaded Python 3

File details

Details for the file icon_grid_generator-0.8.1.tar.gz.

File metadata

  • Download URL: icon_grid_generator-0.8.1.tar.gz
  • Upload date:
  • Size: 1.1 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/7.0.0 CPython/3.13.14

File hashes

Hashes for icon_grid_generator-0.8.1.tar.gz
Algorithm Hash digest
SHA256 72056f169ee235aafa3377557a043cffa3f950be465fef9c886a31c0abc17c17
MD5 61617e0f3757b85095e6754c67148722
BLAKE2b-256 e5a2d77d407cccae64c624a591e530522a17f240b068a78053f5025d12f820b8

See more details on using hashes here.

Provenance

The following attestation bundles were made for icon_grid_generator-0.8.1.tar.gz:

Publisher: release.yml on ofuhrer/icon-grid-generator

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file icon_grid_generator-0.8.1-py3-none-any.whl.

File metadata

File hashes

Hashes for icon_grid_generator-0.8.1-py3-none-any.whl
Algorithm Hash digest
SHA256 35b61c23d9bcb56a7339000cbba8710f62431188293f6d01f258e1ee69b1bd3c
MD5 de22bf07cb5613ce7dcccc4b61a0e2d4
BLAKE2b-256 c2cf02b7932d1fb4c9d00a93271258da04a785d227bdd56e1244324836771eb8

See more details on using hashes here.

Provenance

The following attestation bundles were made for icon_grid_generator-0.8.1-py3-none-any.whl:

Publisher: release.yml on ofuhrer/icon-grid-generator

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

0.9.0

2 files

This release

0.8.1 This release

2 files

0.8.0

2 files

0.7.0

2 files

0.6.2

2 files

0.6.1

2 files

0.6.0

2 files

0.5.0

2 files

0.4.1

2 files

0.4.0

2 files

0.3.2

2 files

0.3.1

2 files

0.3.0

2 files

0.2.1

2 files

0.2.0

2 files

0.1.0

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page