firecube 0.1.8

A plugin-driven batch ingestion engine for building and maintaining operational analysis-ready data cubes

Firecube handles the operational work of building and maintaining cubes, so you can focus on the data.

Documentation | Quickstart | Plugin Development

Installation

Firecube requires Python 3.12+. Install the released package from PyPI in an isolated environment:

mkdir firecube-quickstart
cd firecube-quickstart
uv venv --python 3.12
source .venv/bin/activate
uv pip install firecube
firecube --version

See the Installation guide for the user quickstart. To change Firecube itself, use the setup in Contributing to Firecube.

Use A Plugin

Install an external plugin using the package name or local checkout documented by that plugin:

firecube plugins install <plugin-package>
firecube plugins list
firecube plugins describe <plugin>

Then follow the plugin documentation for its source data and options. Ingestion requires a target and write mode, plus a product name from the command or plugin class. This example also spells out the storage and output choices:

firecube ingest <plugin> \
  --input-data "file://${PWD}/source-data" \
  --target "file://${PWD}/my_product.zarr" \
  --product-name my_product \
  --storage-type local \
  --storage-driver fsspec \
  --output-format zarr \
  --write-mode direct

# use another supported storage driver explicitly
firecube ingest <plugin> \
  --input-data "file://${PWD}/source-data" \
  --target "file://${PWD}/my_product.zarr" \
  --product-name my_product \
  --storage-type local \
  --storage-driver obstore \
  --output-format zarr \
  --write-mode direct

For the full first-run path, use the Quickstart.

Documentation

• Installation
• Create the example plugin
• Prepare source data
• Run ingestion
• Configure S3 access
• Create an Intake catalog
• CLI reference

Build or serve the docs locally:

uv sync --group docs
uv run mkdocs serve
uv run mkdocs build

Development

Install test extras and run the main local gate:

uv sync --extra test
uv run pytest --strict-deps -m "not slow and not s3 and not docs_static and not snapshot and not race"

Software Bill Of Materials

Regenerate the CycloneDX 1.5 SBOM and the dependency-license report locally with:

mkdir -p reports
uv export --format cyclonedx1.5 --all-groups --all-extras --output-file reports/sbom.cdx.json
uv run --isolated --all-groups --all-extras --with hatchling --with pip-licenses pip-licenses --format=json --with-urls > reports/dependency-licenses.json

The SBOM covers all uv dependency groups and extras. Use the dependency license report and package metadata for license review; do not rely on CycloneDX license fields alone.

Included third-party components: none declared.

Direct Runtime And Optional Dependencies

The following dependencies are not included in the package but are required or available as optional runtime extras:

Direct Build, Edit, And Test Dependencies

The following dependencies are only required for building, editing, documentation, or testing:

Copyright and License

Copyright © EUMETSAT 2025-2026

The provided code and instructions are licensed under Apache License, Version 2.0.

Contact EUMETSAT for details on the usage and distribution terms.

Authors

See AUTHORS.md.