basinex 0.2.0

A basin extractor.

basinex

The mHM basin extractor. Extract basins for given gauging stations.

Dependencies

• numpy v1.14.5 or later
• netCDF4
• GDAL
• pyyaml
• C++ compiler (for development version)

Installation

If you have GDAL already installed, basinex can be installed via pip:

pip install basinex

GDAL installation

Getting GDAL installed with pip is allways a bit cumbersome. Therefore we compiled instructions for the main target systems.

Ubuntu

To get a recent version of GDAL, you can use the ppa of ubuntugis:

sudo add-apt-repository ppa:ubuntugis/ppa
sudo apt-get update
sudo apt install gdal-bin libgdal-dev
pip install wheel numpy
pip install GDAL==$(gdal-config --version)

MacOS

GDAL can be installed with homebrew:

brew install gdal
pip install wheel numpy
pip install GDAL==$(gdal-config --version)

Windows

You can use the unoffical wheels of Christoph Gohlke to install GDAL. The easiest way to do so, is using pipwin:

pip install pipwin
pipwin install gdal

Development version in conda environment

It is best to use basinex with conda to have gdal and NetCDF installed properly. To use the development version of basinex, download this repository and do the following in your conda environment:

conda install -y gdal netcdf4 pyyaml cxx-compiler
pip install .

Then you can execute basinex in that conda environment.

Documentation

Here is a short introduction about how to use the basin extractor. Have a look at the example directory or try it out directly with:

basinex -c examples

Usage

A command line script basinex will be installed with this package. You can execute it in your terminal and it will search for an input.yml file in your current directory.

To get more information about how to use the command line interface, you can have a look at the help message:

$ basinex -h
usage: basinex [-h] [-n LINE] [-i INPUT] [-v] [-c CWD] [--version]

mHM basin extractor

optional arguments:
  -h, --help            show this help message and exit
  -n LINE, --line LINE  the gauge to extract, given as its (0-based) line number in the look up table
  -i INPUT, --input INPUT
                        the input yaml file to read (default: 'input.yml')
  -v, --verbose         give some status output
  -c CWD, --cwd CWD     the working directory
  --version             show program's version number and exit

The input file

The main input file input.yml is documented and should (hopefully) give an overview

The default input file looks like this:

outpath: /path/to/output/
flowacc: /path/to/facc.asc
flowdir: /path/to/fdir.asc
gauges: /path/to/lut.txt
matching:
  scaling_factor: 0.001
  max_distance: 800
  max_error: 0.8
mask:
  fname: basin.asc
  outpath: morph
gauge:
  fname: idgauges.asc
  outpath: morph
gridfiles:
  - fname: /path/to/input/facc.asc
    outpath: morph
  - fname: /path/to/input/input1.asc
    outpath: morph
  - fname: /path/to/input/input2.asc
    outpath: luse
ncfiles:
  - fname: /path/to/input/input1.nc
    outpath: meteo
    ydim: northing
    xdim: easting
    y_shift: 0.5
    x_shift: 0.5
  - fname: /path/to/input/input2.nc
    outpath: meteo
    ydim: 'y'
    xdim: 'x'

Description

• outpath: outpath/gauge_id/ - Required: Output location, all data will be writen to outpath/gauge_id/
• flowacc: /path/to/facc.asc - Required: flowaccumulation
• flowdir: /path/to/fdir.asc - Required: flowdirection
• gauges: /path/to/lut.txt - Required: gauging data lookup table Structure of the table:
  • A simple text table with seperator ';'
  • if the basin should be delineated, the following fields are required:
    • id: an unique gauging station identifier
    • size: size of the catchment
    • y: y coordinate of the gauging station
    • x: x coordinate of the gauging station
  • if an pre processed basin mask should be used, the following fields are required:
    • id: an unique basin identifier
    • path: path to the mask file
    • varname: name of the mask variable (optional, only needed if the mask is stored in a netcdf file)
• latitude-size-correction: False - Optional: perform a latitude correction for the given basin size (default: False)
  • AREA = N_cells * res_x * ( cos(LAT) * res_y ) * scaling factor^2
• matching: - Required: gauge matching parameters
  • Note: The gauge matching is based on the flowaccumulation data. The value for any given cell in the flowaccumulation grid is interpreted as the size [in cells] of a river basin drainig into the respective cell. During gauge matching the flowaccumulation grid is searched for a cell with a corresponding basin size close to the given gauge basin size. The search radius will be increased succesively and can be limited to a maximum size. As soon as a matching cell is found (error between catchment sizes is smaller than the given maximum error) the search ends.
  • scaling_factor: .001 - scaling factor to account for the (possible) unit differences between the flowaccumulation and the gauging data. In order to make the data comparable the effective flowaccumulation will be caclulated as:
    • flowaccumulation_value * (cellsize * scaling_factor)^2
  • max_distance: 800 - maximum distance [in map units] around a given gauging station location to search for a matching cell
  • max_error: 0.8 - maximum error, as a fraction of the given basin size
• mask: - Optional: Write the delineated basin
  • fname: basin.asc - Optional: file name of the mask grid (default: mask.asc)
  • outpath: morph - output subdirectory
• gauge: - Optional: Write the gauge basin
  • fname: idgauges.asc - Optional: file name of the gauge grid (default: idgauges.asc)
  • outpath: morph - output subdirectory
• gridfiles: - Optional: Any number of grid files to extract.
  • Note: currently only the formats ArcAscii and GeoTIFF are supported
  • fname: /path/to/input/facc.asc - flow accumulation and flow direction won't be written unless listed here
  • outpath: morph - Optional: output subdirectory under outpath/gauge_id
• ncfiles: - Optional: Any number of netcdf files to extract.
  • Note: In order to extract from netcdf, coordinate values must be given.
    • Example: If your data variables depend on the three dimensions time, y, x your file should also contain the two one-dimensional (!) variables y (depending solely on the dimension y) and x (depending solely on the dimension x). Tools like cdo tend to silently remove variables, so double check, that this information is avaialable
  • fname: /path/to/input/input1.nc
  • outpath: meteo - Optional: output subdirectory under outpath/gauge_id
  • ydim: northing - Required: name of the (1D-) variable holding the y coordinates
  • xdim: easting - Required: name of the (1D-) variable holding the x coordinates
  • y_shift: .5 and x_shift: .5 - Optional: Coordinates of spatial data are definied on a certain location of the cell they belong to (e.g. upper or lower left corner). All the supported file formats handle coordinates transparently, with excpetion of netcdf. To account for the flexibility the format offers, it is possible to specify the fraction of a cell the origin is shifted from the upper left corner in x and y direction. The bounding box of the dataset (an imaginary box, that contains exactly the entire spatial domain) is then caclulated as:
    • ymin = min(y_values) - (cellsize * (1 - y_shift))
    • ymax = max(y_values) + (cellsize * y_shift)
    • xmin = min(x_values) - (cellsize * (1 - x_shift))
    • xmax = max(x_values) + (cellsize * x_shift)
    • Examples:
      • Your coordinate values specify the upper left corner of a cell
        • y_shift: 0
        • x_shift: 0
      • Your coordinate values specify the center of a cell:
        • y_shift: 0.5
        • x_shift: 0.5
      • Your coordinate values specify the lower left corner of a cell
        • y_shift: 1
        • x_shift: 0
    • Default: lower left corner, i.e:
      • y_shift: 1
      • x_shift: 0

Notes

This package was orginally developed by David Schäfer who also provides a standalone version of the geoarray subpackage.

The netcdf4 and geoarray subpackages have been taken from the jams-python package, that was formerly developed at the CHS department at the UFZ and is now released under the MIT license.

License

LGPLv3