Skip to main content

A Python client for UK Met Office MIDAS via CEDA Archives

Project description

MIDAS Client

Features

  • MIDAS tables – supports all hourly / daily rain, temperature, weather, wind, radiation & soil temp tables (RH, RD, TD, WH, WD, WM, RY, SH).
  • Helper functionsdownload_station_year() for a single station/year, or download_locations() to bulk-grab multiple nearest stations for many locations.
  • Cache Location – current config defaults to data/raw/weather/ (edit in settings).
  • Cache Format - customizable cashe format; supports csv, parquet, json . Defaults to csv.
  • Config: JSON – tweak dataset version, default columns, cache directory, etc. in settings.json.
  • CEDA auth – automatically gets a bearer token using your CEDA_USER and CEDA_PASS env vars.

Quick start

pip install uk-midas-client
from midas_client import download_station_year, download_locations

Set your CEDA credentials using either username/password:

export CEDA_USER="me@example.com"
export CEDA_PASS="••••••••"

and/or use a token:

export CEDA_TOKEN="••••••••..."

Fetch a single station-year

df = download_station_year("TD", station_id="03743", year=2020)
print(df.head())

Bulk Download Nearest Stations

Given a DataFrame containing observation locations with associated latitude and longitude coordinates, the algorithm:

  1. Identifies the nearest MIDAS stations:

    • Finds the k-nearest MIDAS stations for each observation location that support a specified observation type (e.g., Rain Hourly — RH).
  2. Downloads datasets:

    • Attempts to download datasets for each station-year combination, prioritizing nearest stations.
  3. Fallback mechanism:

    • If a dataset for the closest station-year combination is unavailable, the algorithm sequentially attempts downloads from the next nearest stations until either:

      • A valid dataset is successfully retrieved, or
      • All k nearest stations have been attempted unsuccessfully.

Caching and Output Structure

The resulting datasets are stored in a specified cache directory (cache_dir), following the naming convention:

{obs}_{year}.{fmt}

Additionally, the process generates a JSON mapping file (station_map.json) within cache_dir. This file maps each observation location's input loc_id to the corresponding downloaded station identifiers.

Example Usage

import pandas as pd

locs = pd.DataFrame({
    "loc_id": ["here"],
    "lat": [51.5],
    "long": [-0.1],
})

station_map = download_locations(
    locs,
    years=range(2021, 2022),
    tables={"TD": ["max_air_temp", "min_air_temp"]}
)

Status

This project is currently in a pre-1.0 prototype stage and may change without notice.

License

Released under the MIT License. You are free to use, modify and distribute this software.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

uk_midas_client-0.573.tar.gz (16.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

uk_midas_client-0.573-py3-none-any.whl (13.6 kB view details)

Uploaded Python 3

File details

Details for the file uk_midas_client-0.573.tar.gz.

File metadata

  • Download URL: uk_midas_client-0.573.tar.gz
  • Upload date:
  • Size: 16.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for uk_midas_client-0.573.tar.gz
Algorithm Hash digest
SHA256 b03b27fa5c3144e23a0afce52c35e42abf5324a7776b811436da0690930cdba9
MD5 c840540109ecf4422bd85cc53c2e94c7
BLAKE2b-256 824d182e47bacd150f7fc51d3e0e1079d74c33dc7ad4419b1236a4d5007e6fe9

See more details on using hashes here.

Provenance

The following attestation bundles were made for uk_midas_client-0.573.tar.gz:

Publisher: publish.yml on Katielocks/uk-midas-client

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file uk_midas_client-0.573-py3-none-any.whl.

File metadata

File hashes

Hashes for uk_midas_client-0.573-py3-none-any.whl
Algorithm Hash digest
SHA256 ecb58285ef28435a18fefd4baabf7a2f54f774dfbb3c8acc323af14a8b349542
MD5 3c161042a13efd0699b6e3b1548b27ee
BLAKE2b-256 1e431601dd64161ce9123892b7eca5a8fc657a30e06f11a30a4e0f372a4d3bfb

See more details on using hashes here.

Provenance

The following attestation bundles were made for uk_midas_client-0.573-py3-none-any.whl:

Publisher: publish.yml on Katielocks/uk-midas-client

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page