eodm 0.2.0

Library and extensible CLI application for ETL (extract, transform, load) operations on EO data.

eodm - EO Data Mover

Library and extensible CLI application for ETL (extract, transform, load) operations on EO data.

Concept

Below are the main ideas on how to use the application. Note the shell piping operator, the intended use case is such that output of one command is piped into the next. With this a clear interface is required between the commands. For this purpose the STAC Item is chosen.

eodm extract stac-api items https://earth-search.aws.element84.com/v1 sentinel-2-l2a --bbox 49.1,18.1,49.2,18.2 --datetime-interval 2023-06-01/2023-06-30 \
| eodm transform metadata band-subset red,green,blue,nir \
| eodm load stac-catalog items s3://my-bucket/catalog.json \
| eodm load stac-api items https://stac2.hub-dev.eox.at/

eodm extract stac-catalog items s3://my-bucket/catalog.json \
| eodm load stac-api items https://stac2.hub-dev.eox.at/

There are also library functions which are thin wrappers around popular libraries, with some custom implementations for certain sources.

Current support

Extract

extract features	CLI	lib
stac-api items	✅	✅
stac-api collection(s)	✅	❌
stac-catalog items	✅	✅
stac-catalog collection(s)	✅	❌
OData	❌	✅
Opensearch	❌	✅
OGCAPI - Records	❌	✅

Transform

transform features	CLI	lib
subset bands	✅	❌
clean metadata	✅	❌

Load

extract features	CLI	lib
stac-api items	✅	✅
stac-api collection(s)	✅	❌
stac-catalog items	✅	✅
stac-catalog collection(s)	✅	❌

Plugins

There is support for writing plugins for extract and load from and to custom endpoints as well as transformers. Refer to the docs for more information.