hot-open

Helpers for loading the Hill of Towie open wind farm dataset into pandas: 10-minute SCADA, ~1 Hz turbine fastlog, ZX300/ZXTM LiDAR, turbine metadata and ERA5 reanalysis. Input files are downloaded from Zenodo on first use, and intermediate results are cached as parquet.

The package is developed alongside the analyses in resgroup/hill-of-towie-open-source-analysis, which uses it with wind-up to assess upgrades at Hill of Towie.

Installation

pip install hot-open

Python 3.10 or newer is required. The import name is hot_open.

Example

import pandas as pd

from hot_open.fastlog_helpers import load_hot_fl_data
from hot_open.scada_helpers import load_hot_10min_data
from hot_open.settings import get_data_dir, get_filestore_dir

start_dt = pd.Timestamp("2026-02-20", tz="UTC")
end_dt_excl = pd.Timestamp("2026-02-21", tz="UTC")

# 10-minute SCADA, wide format with (turbine, field) columns
scada_df = load_hot_10min_data(
    data_dir=get_data_dir(), wtg_numbers=[3, 7], start_dt=start_dt, end_dt_excl=end_dt_excl
)

# ~1 Hz controller fastlog for the same turbines
fastlog_df = load_hot_fl_data(
    data_dir=get_filestore_dir(), wtg_numbers=[3, 7], start_dt=start_dt, end_dt_excl=end_dt_excl
)

The first call downloads the files it needs from Zenodo (~12 GB for the fastlog).

What's in the package

Field definitions, reference frames and known data quality issues are documented in Hill_of_Towie_data_dictionary.md in the Zenodo data pack.

Configuration

All paths are set by optional environment variables, which can also go in a .env file. If a variable isn't set, a folder under ~/temp/hill-of-towie-open-source-analysis/ is used.

Versioning

Releases follow semantic versioning. While the version is 0.x, a minor version bump may contain breaking changes. Release notes are on the GitHub releases page.

License

BSD 3-Clause. Contact: Alex.Clerc@res-group.com