Skip to main content

A Python client for UK Met Office MIDAS via CEDA Archives

Project description

MIDAS Client

Features

  • MIDAS tables – supports all hourly / daily rain, temperature, weather, wind, radiation & soil temp tables (RH, RD, TD, WH, WD, WM, RY, SH).
  • Helper functionsdownload_station_year() for a single station/year, or download_locations() to bulk-grab multiple nearest stations for many locations.
  • Cache Location – current config defaults to data/raw/weather/ (edit in settings).
  • Cache Format - customizable cashe format; supports csv, parquet, json . Defaults to csv.
  • Config: JSON – tweak dataset version, default columns, cache directory, etc. in settings.json.
  • CEDA auth – automatically gets a bearer token using your CEDA_USER and CEDA_PASS env vars.

Quick start

pip install uk-midas-client
from midas_client import download_station_year, download_locations

Set your CEDA credentials using either username/password:

export CEDA_USER="me@example.com"
export CEDA_PASS="••••••••"

and/or use a token:

export CEDA_TOKEN="••••••••..."

Fetch a single station-year

df = download_station_year("TD", station_id="03743", year=2020)
print(df.head())

Bulk Download Nearest Stations

Given a DataFrame containing observation locations with associated latitude and longitude coordinates, the algorithm:

  1. Identifies the nearest MIDAS stations:

    • Finds the k-nearest MIDAS stations for each observation location that support a specified observation type (e.g., Rain Hourly — RH).
  2. Downloads datasets:

    • Attempts to download datasets for each station-year combination, prioritizing nearest stations.
  3. Fallback mechanism:

    • If a dataset for the closest station-year combination is unavailable, the algorithm sequentially attempts downloads from the next nearest stations until either:

      • A valid dataset is successfully retrieved, or
      • All k nearest stations have been attempted unsuccessfully.

Caching and Output Structure

The resulting datasets are stored in a specified cache directory (cache_dir), following the naming convention:

{obs}_{year}.{fmt}

Additionally, the process generates a JSON mapping file (station_map.json) within cache_dir. This file maps each observation location's input loc_id to the corresponding downloaded station identifiers.

Example Usage

import pandas as pd

locs = pd.DataFrame({
    "loc_id": ["here"],
    "lat": [51.5],
    "long": [-0.1],
})

station_map = download_locations(
    locs,
    years=range(2021, 2022),
    tables={"TD": ["max_air_temp", "min_air_temp"]}
)

Status

This project is currently in a pre-1.0 prototype stage and may change without notice.

License

Released under the MIT License. You are free to use, modify and distribute this software.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

uk_midas_client-0.557.tar.gz (14.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

uk_midas_client-0.557-py3-none-any.whl (11.4 kB view details)

Uploaded Python 3

File details

Details for the file uk_midas_client-0.557.tar.gz.

File metadata

  • Download URL: uk_midas_client-0.557.tar.gz
  • Upload date:
  • Size: 14.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for uk_midas_client-0.557.tar.gz
Algorithm Hash digest
SHA256 dc4f77ccc74481c9545f4d03ca79fef788292cd4f64781b7c2848544b71607e2
MD5 58a9e8140a21d91ed789343089d7df20
BLAKE2b-256 7a0ad306b5a4fb4118b0422e9a6474b9bc596981544e8b052e86bd9a5873bec4

See more details on using hashes here.

Provenance

The following attestation bundles were made for uk_midas_client-0.557.tar.gz:

Publisher: publish.yml on Katielocks/uk-midas-client

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file uk_midas_client-0.557-py3-none-any.whl.

File metadata

File hashes

Hashes for uk_midas_client-0.557-py3-none-any.whl
Algorithm Hash digest
SHA256 9fc06f887f72992abab94b3961fb3496e3c6cc008050e5e052ef481596103c9e
MD5 9f72e27265c16fa3fdfd7a239774ec55
BLAKE2b-256 77c96718d762b3d295d526a621d3c37fe72de24c6e2351ba090116502a4356e2

See more details on using hashes here.

Provenance

The following attestation bundles were made for uk_midas_client-0.557-py3-none-any.whl:

Publisher: publish.yml on Katielocks/uk-midas-client

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page