Skip to main content

Validator and linter for Portolan catalogs

Project description

rashid

PyPI Python versions CI License

Validator and linter for Portolan catalogs. The name comes from the Arabic root ر ش د, whose participles رَاشِدٌ and رَشِيدٌ mean "taking, or following, a right way or course or direction".

rashid reads a catalog directory and reports every rule it breaks.

Install

uv tool install rashid

Check a catalog

rashid check path/to/catalog

An exit code of 0 means the catalog broke no MUST. An exit code of 1 means it broke at least one.

The default run covers the metadata, structural, and data passes, all offline for local assets. Two passes stay opt-in: --schema (redundant with the hand rules by construction; useful as a cross-check on catalogs from other tooling) and --live (probes the hosting servers, so it needs the network and a published catalog).

rashid check path/to/catalog --live --live-base-url https://data.example.org/my-catalog/

--no-data skips byte verification when the assets are huge or remote and only the metadata verdict is needed. Add --json for a machine-readable report.

What it checks

Validation runs as five separable passes.

Metadata. Every spec requirement rashid can check from the catalog's JSON, without reading asset bytes.

Structural. STAC 1.1.0 core validity, checked offline against the schemas vendored in the wheel. Only the core schema applies. Declared extensions belong to the metadata pass, which keeps an unpublished extension schema from failing the tree.

Schema. The published Portolan profile schema, applied to every object. rashid also implements those requirements in code, which yields precise messages and fix hints. Running both catches drift between them, at the cost of reporting some defects twice. Opt in with --schema.

Data. Asset bytes, local files and remote https URLs alike, checked against the declared metadata and the format rules. rashid recomputes checksum and size, confirms media type by magic number, and enforces storage rules a metadata reader cannot see. Expect a real catalog to fail here on rules its metadata satisfies, because this pass is stricter than what current tooling emits. On by default; --no-data skips it.

Live hosting. The servers behind remote https assets, probed for HTTP range support and CORS. Those are properties of the server rather than of any file. Range and CORS cost one probe per host, and each asset costs one HEAD. Opt in with --live.

A pass that cannot run reports a warning rather than passing quietly.

Use it as a library

from rashid import validate

report = validate("path/to/catalog")
for finding in report.errors:
    print(finding.message)

validate() runs the metadata, structural, and data passes by default, matching the CLI; schema and live opt the remaining two in, and structural=False / data=False opt the defaults out.

RulesConfig skips rules or changes their severity.

from rashid import RulesConfig, Severity, validate

config = RulesConfig(
    disabled=frozenset({"PTL-VIZ-004"}),
    severity_overrides={"PTL-TTL-002": Severity.ERROR},
)
report = validate("path/to/catalog", config=config)

Report also carries passed, warnings, infos, and to_dict().

Helpers for tools that fix what rashid reports

A tool that rewrites catalog metadata has to read that metadata the way rashid reads it. Reimplementing a check produces code that passes its own tests and still disagrees with the rule it was written against. rashid.api publishes the helpers rashid's rules use.

from rashid.api import has_cog, is_cog_media_type, links_of, roles_of

if has_cog(item):  # true only for image/tiff ... profile=cloud-optimized
    ...

The module also exports STRUCTURAL_RELS and parse_rfc3339, along with the multihash codec behind file:checksum.

import hashlib
from rashid.api import SHA2_256, encode_multihash

checksum = encode_multihash(SHA2_256, hashlib.sha256(data).digest())

decode_multihash and is_well_formed_multihash read those values back.

A name imported from rashid.api stays available across 0.x releases. The modules behind it are private, and importing from them directly can break in any patch release.

Rules

Every finding carries a stable id shaped PTL-GROUP-NNN, a severity, a message, and the file path. MUST requirements become errors, and SHOULD requirements become warnings.

docs/rules.md lists the rule groups, the severity exceptions, and the codes rashid emits when a pass degrades.

Contributing

docs/contributing.md covers hook setup, the two-stage gate, and how to run the tests.

SPEC_REF records the portolan-spec commit the vendored fixtures were built from. A nightly workflow re-vendors them and opens a pull request when the spec moves.

License

Apache-2.0.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rashid-0.1.2.tar.gz (372.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

rashid-0.1.2-py3-none-any.whl (104.9 kB view details)

Uploaded Python 3

File details

Details for the file rashid-0.1.2.tar.gz.

File metadata

  • Download URL: rashid-0.1.2.tar.gz
  • Upload date:
  • Size: 372.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for rashid-0.1.2.tar.gz
Algorithm Hash digest
SHA256 b8e1c0dbe14cf5a13c308e4da4886c079a74855bbac7a2f8896fe45085f4a14c
MD5 08c2cbb1c25774d4e60e0d8e8b93febb
BLAKE2b-256 fad3f5a2e6758538ba93a0b367be9ce24ec645c277841aa4cb20bfb3a201e04b

See more details on using hashes here.

Provenance

The following attestation bundles were made for rashid-0.1.2.tar.gz:

Publisher: publish.yml on portolan-sdi/rashid

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file rashid-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: rashid-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 104.9 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: twine/6.1.0 CPython/3.13.14

File hashes

Hashes for rashid-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 bdf282915a13a668a5dc8e1f31a85bc983e021b1ba7b9e188a932bce556cc0ee
MD5 4b91a08b1cb86e7af0020201633f3721
BLAKE2b-256 b9a11ee8887c1a5e06fba6c3d6d09e7f70184b7d2277d7cf98f2cba69d2bc087

See more details on using hashes here.

Provenance

The following attestation bundles were made for rashid-0.1.2-py3-none-any.whl:

Publisher: publish.yml on portolan-sdi/rashid

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page