atmos-validation
A library containing validation checks to be run on hindcast or measurement data to ensure API compliance and standardization.
Atmos is a project to streamline discoverability and data access for weather data sources through APIs. The first step to building a lean and efficient API is converting data to the standard format.
Data Validation
In order to ingest measurement or hindcast data into the Atmos Data Store, each source file needs to pass validation. Validation ensures that the file is compliant with the data conventions specified in Conventions. The standard file formats for source files are NetCDF files for hindcasts and ASCII or NetCDF for measurements.
Measurements by definition contain data for a single geographical location, whereas hindcasts are bigger models containing time series for a multitude of locations in (possibly rotated) grids. A measurement file is therefore expected to contain all of its data in a single file. A hindcast is comprised of a set of NetCDF files - all with the same coordinates, attributes, and variables, - where a single file contains data for a unique time period. Depending on the size of the files, the time separation should be either monthly or yearly. A rule-of-thumb is that if the file size grows more than 4 GB, it should be split into smaller files. See docs or example for how to name hindcast files.
To run validation on NetCDF and ASCII source files, we have built the atmos_validation CLI/library. The documentation below describes these checks, the standard format, and how to run validation using the CLI tool.
Documentation
Examples
Contributing
We welcome different types of contributions, including code, bug reports, issues, feature requests, and documentation. The preferred method of submitting a contribution is either to make an issue on GitHub or to fork the project on GitHub and make a pull request. In the case of bug reports, please provide a detailed explanation describing how to reproduce before submitting.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file atmos_validation-2.1.0.tar.gz.
File metadata
- Download URL: atmos_validation-2.1.0.tar.gz
- Upload date:
- Size: 1.7 MB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
d2503d9c255f806f002aba72bb40d308b9e1e4c77243cb58cc02222bb9b2d984
|
|
| MD5 |
1594ffbeae08fed7f72d325ee014ddbb
|
|
| BLAKE2b-256 |
48cc5b174f4666b934968085e28dd232a5df630495c9426c48ba83551ef94853
|
Provenance
The following attestation bundles were made for atmos_validation-2.1.0.tar.gz:
Publisher:
pypi-publisher.yml on equinor/atmos-validation
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
atmos_validation-2.1.0.tar.gz -
Subject digest:
d2503d9c255f806f002aba72bb40d308b9e1e4c77243cb58cc02222bb9b2d984 - Sigstore transparency entry: 2466787643
- Sigstore integration time:
-
Permalink:
equinor/atmos-validation@c954569ce7ee125c7bced8732c4f5549fbd6ac47 -
Branch / Tag:
refs/tags/v2.1.0 - Owner: https://github.com/equinor
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
pypi-publisher.yml@c954569ce7ee125c7bced8732c4f5549fbd6ac47 -
Trigger Event:
release
-
Statement type:
File details
Details for the file atmos_validation-2.1.0-py3-none-any.whl.
File metadata
- Download URL: atmos_validation-2.1.0-py3-none-any.whl
- Upload date:
- Size: 74.4 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via:
twine/7.0.0 CPython/3.13.14
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
1d7855ab122d53e274bfcbb78842e6a2294f9946d520b14b399c125289f6716a
|
|
| MD5 |
ea21edbe11b431dcac13364c5818bc76
|
|
| BLAKE2b-256 |
dce443550f5452077a763f65e8065013df1c278dedcc49ced4584d2a2f5962a2
|
Provenance
The following attestation bundles were made for atmos_validation-2.1.0-py3-none-any.whl:
Publisher:
pypi-publisher.yml on equinor/atmos-validation
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
atmos_validation-2.1.0-py3-none-any.whl -
Subject digest:
1d7855ab122d53e274bfcbb78842e6a2294f9946d520b14b399c125289f6716a - Sigstore transparency entry: 2466787698
- Sigstore integration time:
-
Permalink:
equinor/atmos-validation@c954569ce7ee125c7bced8732c4f5549fbd6ac47 -
Branch / Tag:
refs/tags/v2.1.0 - Owner: https://github.com/equinor
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
pypi-publisher.yml@c954569ce7ee125c7bced8732c4f5549fbd6ac47 -
Trigger Event:
release
-
Statement type:
