Skip to main content

OpenEO Processes Dask

Poetry PyPI - Status PyPI Python Version codecov

openeo-processes-dask is a collection of Python implementations of OpenEO processes based on the xarray/dask ecosystem. It is intended to be used alongside with openeo-pg-parser-networkx, which handles the parsing and execution of OpenEO process graphs. There you'll also find a tutorial on how to register process implementations from an arbitrary source (e.g. this repo) to the registry of available processes.

Installation

Conda-forge provides GDAL system libraries and Python bindings as a single coherent package. Once installed, pip does not need to touch GDAL at all.

conda create -n openeo_processes_dask -c conda-forge python=3.12 gdal
conda activate openeo_processes_dask
pip install openeo-processes-dask[implementations]

Micromamba (lightweight alternative):

micromamba create -n openeo_processes_dask -c conda-forge python=3.12 gdal
micromamba activate openeo_processes_dask
pip install openeo-processes-dask[implementations]

System packages (Ubuntu/Debian)

If you already have GDAL system libraries, pin the pip gdal wheel to the matching version. Ubuntu 24.04 ships GDAL 3.8.4 — the minimum version required for system-level installation:

sudo apt-get install gdal-bin libgdal-dev python3-gdal
pip install "gdal==$(gdal-config --version)" openeo-processes-dask[implementations]

This pin avoids the common mismatch between a pip gdal wheel and your system libgdal. When using conda (above) this is unnecessary because conda-forge provides both the library and the Python binding together.

Note that by default pip install openeo-processes-dask only installs the JSON process specs. In order to install the actual implementations, add the implementations extra as shown in the examples above.


Extra build variants

A subset of process implementations with heavy or unstable dependencies are hidden behind these extras:

  • ML processes:

    pip install openeo-processes-dask[ml]
    

⚠️ Note on GDAL: The implementations extra depends on GDAL transitively via rasterio, rioxarray, odc-stac, and geopandas. Always install GDAL first (via conda-forge or system packages) before pip-installing extras. The ml (xgboost) and deforestation (rqadeforestation) extras do not directly depend on GDAL. This project requires GDAL >=3.8.4 (the version shipped by Ubuntu 24.04) and is CI-tested against conda-forge GDAL on Python 3.10–3.13.

Version-ceiling policy: Library dependencies in pyproject.toml declare only minimum versions (>=X). Any upper bounds (<Y) needed for CI go into [tool.poetry.group.ci.dependencies] (or the conda ci-environment.yml pin) so downstream consumers are never blocked. Install the civersions extra if your environment also needs the ceiling.


Development environment

This package requires at least Poetry 2.2, see their docs for installation instructions.

Clone the repository with --recurse-submodules to also fetch the process specs:

git clone --recurse-submodules git@github.com:Open-EO/openeo-processes-dask.git

Development setup (CI pattern — conda-forge GDAL + Poetry):

# 1. Create conda env with GDAL (mirrors `.github/ci-environment.yml`)
conda create -n openeo_processes_dask_dev -c conda-forge python=3.12 gdal
conda activate openeo_processes_dask_dev

# 2. Install Poetry deps into the conda env
poetry config virtualenvs.create false
poetry install --with dev,ci --all-extras

# 3. Verify GDAL
gdalinfo --version
python -c "from osgeo import gdal; print('GDAL Python:', gdal.__version__)"

poetry config virtualenvs.create false ensures GDAL from conda-forge is visible to pip-installed geospatial packages (rasterio, rioxarray, etc.). Without this, Poetry's isolated venv may not find the conda-forge GDAL libraries.


To add a new core dependency run:

poetry add some_new_dependency

To add a new development dependency run:

poetry add some_new_dependency --group dev

To run the test suite run:

poetry run python -m pytest

Note that you can also use the virtual environment that's generated by poetry as the kernel for the ipynb notebooks.

Pre-commit hooks

This repo makes use of pre-commit hooks to enforce linting & a few sanity checks. In a fresh development setup, install the hooks using poetry run pre-commit install. These will then automatically be checked against your changes before making the commit.

Specs

The json specs for the individual processes are tracked as a git submodule in openeo_processes_dask/specs/openeo-processes. The raw json for a specific process can be imported using from openeo_processes_dask.specs import reduce_dimension.

To bump these specs to a later version use: git -C openeo_processes_dask/specs/openeo-processes checkout <tag> git add openeo_processes_dask/specs/openeo-processes

Metadata

Release files for openeo-processes-dask 2026.9.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for openeo-processes-dask 2026.9.1
File Size Uploaded
openeo_processes_dask-2026.9.1.tar.gz 170.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for openeo-processes-dask 2026.9.1
File Interpreter ABI Platform
openeo_processes_dask-2026.9.1-py3-none-any.whl Python 3 none any Details

Total release size: 473.7 kB

Release files / openeo_processes_dask-2026.9.1.tar.gz

Download URL openeo_processes_dask-2026.9.1.tar.gz
Size 170.8 kB
Tags Source
SHA-256 checksum
How to use checksums
b8c737d55a21b6c91e21ead72ee69a9fc6b75984aa2f179330a5f6eea72e6372
BLAKE2b-256 checksum
How to use checksums
191d7122d862abf5004f241cf6642ab24114021bdd2b7b5e6c7beb97f5f19c5c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.3.3 CPython/3.12.14 Linux/6.17.0-1022-azure

Release files / openeo_processes_dask-2026.9.1-py3-none-any.whl

Download URL openeo_processes_dask-2026.9.1-py3-none-any.whl
Size 303.0 kB
Tags Python 3
SHA-256 checksum
How to use checksums
9f9abd506a50a66b28d626c051afcdba8f9c5627a8129ddcad4a608e887b946f
BLAKE2b-256 checksum
How to use checksums
cfe2253d6bd11fac1534c00487c0e8267ef532fd2e0e48fbb67b423f9e43fa38
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/2.3.3 CPython/3.12.14 Linux/6.17.0-1022-azure

Release history Release notifications | RSS feed

This release

2026.9.1 This release

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page