HESTIA Data Validation

Pipeline Status Coverage Report Documentation Status

Install

pip install hestia_earth_validation

Usage

from hestia_earth.validation.preload_requests import enable_preload
from hestia_earth.validation import validate

# enable request preloading
enable_preload()
# for each node, this will return a list containing all the errors/warnings (empty list if no errors/warnings)
errors = validate(nodes)

Note: if you want to validate existing data (with @type and @id fields), please set the following environment variable:

VALIDATE_EXISTING_NODES=true

Spatial validation

Some validations need geospatial data: whether a Site's coordinates fall inside the country or region it declares, how far outside they are, whether the region is small enough for the models to gap-fill, and whether the declared siteType matches the MODIS land cover there.

There are two ways to provide it, and either is enough:

# 1. the HESTIA Caching API, if it holds the land cover and GADM assets
VALIDATION_CACHING_API_URL=https://<host>/api
VALIDATION_CACHING_API_KEY=<token>

# 2. Earth Engine, which needs an account and credentials
pip install "hestia-earth-validation[spatial]"

The Caching API is preferred when it can answer, and anything it has no asset for still goes to Earth Engine — so the two combine rather than compete. MODELS_CACHING_API_* is read as a fallback for the variables above, which is what most deployments already set.

Set VALIDATE_SPATIAL=false to skip these validations entirely. Without either backend they are skipped anyway, with an error in the log: validating coordinates against data nobody can fetch would report every Site as being outside its own country.

Project links

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Latest release

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for hestia-earth from gravatar.com hestia-earth

Credits

Author: Guillaume Royer

License

MIT

Requires

Python >=3

Provides Extra

models spatial distribution

Tags

hestia data validation

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

hestia_earth_validation-0.41.1.tar.gz (71.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

hestia_earth_validation-0.41.1-py3-none-any.whl (83.8 kB view details)

Uploaded Python 3

File details

Details for the file hestia_earth_validation-0.41.1.tar.gz.

File metadata

  • Download URL: hestia_earth_validation-0.41.1.tar.gz
  • Upload date:
  • Size: 71.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.12.13

File hashes

Hashes for hestia_earth_validation-0.41.1.tar.gz
Algorithm Hash digest
SHA256 13c72a70f39f86a83495ac2191591e4af81d8959efa37d7625387e3c12e9c1a7
MD5 238d6014529665c32fd6b066b140aee7
BLAKE2b-256 3fcc1bcefcce1aa451de40c69c8ec0f67679bf57bf6eb3a5651f3ea37fbf1f4a

See more details on using hashes here.

File details

Details for the file hestia_earth_validation-0.41.1-py3-none-any.whl.

File metadata

File hashes

Hashes for hestia_earth_validation-0.41.1-py3-none-any.whl
Algorithm Hash digest
SHA256 8d241ba10b03b4110265c7a255dafad6d226509e9caff9006b94c407613fed4a
MD5 95234714697331cd636b1d025d52565a
BLAKE2b-256 3ce4cef1585217f01a46e0235e953934fb719c49ec8a423c55a1795ca0ad53af

See more details on using hashes here.

Release history Release notifications | RSS feed

This release

0.41.1

0.41.0

0.40.6

0.40.5

0.40.4

0.40.3

0.40.2

0.40.1

0.40.0

0.39.2

0.39.1

0.39.0

0.38.6

0.38.5

0.38.4

0.38.3

0.38.2

0.38.1

0.38.0

0.37.22

0.37.21

0.37.20

0.37.19

0.37.18

0.37.17

0.37.16

0.37.15

0.37.14

0.37.13

0.37.12

0.37.11

0.37.10

0.37.9

0.37.8

0.37.7

0.37.6

0.37.4

0.37.3

0.37.2

0.37.1

0.36.10

0.36.9

0.36.8

0.36.7

0.36.6

0.36.5

0.36.4

0.36.3

0.36.2

0.36.1

0.36.0

0.35.5

0.35.4

0.35.3

0.35.2

0.35.1

0.35.0

0.34.3

0.34.2

0.34.1

0.34.0

0.33.3

0.33.2

0.33.1

0.33.0

0.32.29

0.32.28

0.32.27

0.32.26

0.32.25

0.32.24

0.32.23

0.32.22

0.32.21

0.32.20

0.32.19

0.32.18

0.32.17

0.32.16

0.32.15

0.32.14

0.32.13

0.32.12

0.32.11

0.32.10

0.32.9

0.32.8

0.32.7

0.32.6

0.32.5

0.32.4

0.32.3

0.32.2

0.32.1

0.32.0

0.31.3

0.31.2

0.31.1

0.31.0

0.30.0

0.29.8

0.29.7

0.29.6

0.29.5

0.29.4

0.29.3

0.29.2

0.29.1

0.29.0

0.28.10

0.28.9

0.28.8

0.28.7

0.28.6

0.28.5

0.28.4

0.28.3

0.28.2

0.28.1

0.28.0

0.27.0

0.26.0

0.25.4

0.25.3

0.25.2

0.25.1

0.25.0

0.24.0

0.23.4

0.23.3

0.23.2

0.23.1

0.23.0

0.22.7

0.22.6

0.22.5

0.22.4

0.22.3

0.22.2

0.22.1

0.22.0

0.21.0

0.20.3

0.20.2

0.20.1

0.20.0

0.19.0

0.18.0

0.17.0

0.16.2

0.16.1

0.16.0

0.15.1

0.15.0

0.14.5

0.14.4

0.14.3

0.14.2

0.14.1

0.14.0

0.13.0

0.12.0

0.11.9

0.11.8

0.11.7

0.11.5

0.11.4

0.11.3

0.11.2

0.11.1

0.11.0

0.10.14

0.10.13

0.10.12

0.10.11

0.10.10

0.10.9

0.10.8

0.10.7

0.10.6

0.10.5

0.10.4

0.10.3

0.10.2

0.10.1

0.10.0

0.9.3

0.9.2

0.9.1

0.9.0

0.8.8

0.8.7

0.8.6

0.8.5

0.8.4

0.8.3

0.8.2

0.8.1

0.8.0

0.7.6

0.7.5

0.7.4

0.7.3

0.7.2

0.7.1

0.7.0

0.6.2

0.6.1

0.6.0

0.5.4

0.5.3

0.5.2

0.5.1

0.5.0

0.4.1

0.4.0

0.3.7

0.3.6

0.3.5

0.3.4

0.3.3

0.3.2

0.3.1

0.3.0

0.2.1

0.2.0

0.1.30

0.1.29

0.1.28

0.1.27

0.1.26

0.1.25

0.1.24

0.1.23

0.1.22

0.1.21

0.1.20

0.1.19

0.1.18

0.1.17

0.1.16

0.1.15

0.1.14

0.1.13

0.1.12

0.1.11

0.1.10

0.1.9

0.1.8

0.1.7

0.1.6

0.1.5

0.1.4

0.1.3

0.1.2

0.1.1

0.1.0

0.0.14

0.0.13

0.0.12

0.0.11

0.0.10

0.0.9

0.0.8

0.0.7

0.0.6

0.0.5

0.0.4

0.0.3

0.0.2

0.0.1

0.0.0

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page