Skip to main content

SDMX structural metadata library for Python

Project description

sdmxlib

Note: This library has been written extensively with AI assistance (Claude Code). Users who are not comfortable with AI-generated code should take that into account before adopting it.

SDMX structural metadata library for Python. Fetch and navigate Data Structure Definitions, Codelists, Dataflows, and related artefacts from any SDMX REST endpoint — with plain attribute access, no XML or URN chasing required.

Quick start

import sdmxlib as sl

with sl.RestRegistry(sl.Provider.BIS) as reg:
    dsd = reg.get(sl.DataStructure, agency="BIS", id="WS_CBPOL").resolve()

    for dim in dsd.dimensions:
        if dim.is_enumerated:
            cl = dim.representation()
            print(f"{dim.id}: {cl.id} ({len(cl.codes)} codes)")
FREQ: CL_FREQ (7 codes)
REF_AREA: CL_BIS_IF_REF_AREA (44 codes)
INSTR_ASSET: CL_INSTR_ASSET (12 codes)
BORROWER_CTY: CL_BIS_IF_REF_AREA (44 codes)

Installation

uv add "sdmxlib @ git+https://gitlab.com/gabrielgellner/sdmxlib.git"

What it does

  • Connects to any SDMX 2.1 or 3.0 REST endpoint; built-in shortcuts for ECB, BIS, ESTAT, IMF, OECD, and the SDMX Global Registry via sl.Provider
  • Three resolution modes: browse() for catalogue scanning, fetch() for unresolved artefacts, resolve() for the full reference graph (with optional constraint-trimming via partial=True/False)
  • Returns fully resolved domain objects with plain attribute access — no XML, no URN chasing
  • Filter collections with lambdas or the item() expression API
  • Build SDMX artefacts locally and serialise to SDMX-ML or SDMX-JSON
  • LocalRegistry -- a DuckDB-backed persistent store for offline access with lazy codelist loading, automatic Ref resolution, and direct SQL code maps; supports shared connections and any-language queries
  • Reference metadata via MetadataStructure (MSD), Metadataflow, and MetadataSet — attach typed footnotes, methodology notes, or quality reports to any identifiable artefact. Definitions ride in StructureMessage; populated payloads ride in MetadataMessage (<mes:GenericMetadata> in SDMX-ML 3.0; metadata-schema envelope in SDMX-JSON 2.0). Both message kinds round-trip through LocalRegistry, JSON, and XML.
  • Integrates with Polars for schema generation and data validation
  • Fully typed — IDE completion and static analysis work throughout

Documentation

See the docs for the full cookbook, including:

  • Connecting to registries and choosing a resolution mode
  • Persisting artefacts in a local DuckDB store with LocalRegistry
  • Fetching observation data with sl.dim() filters and pivoting to wide format
  • Inspecting DSDs and building code maps for ETL pipelines
  • Generating Polars schemas from SDMX Data Structure Definitions
  • Browsing data catalogs and filtering dataflows
  • Working with constraints, hierarchies, and serialisation

Development

just check           # lint + typecheck
just test            # unit tests
just test-integration  # live endpoint tests (requires network)
just ci              # full pre-commit gate

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sdmxlib-0.21.0.tar.gz (160.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sdmxlib-0.21.0-py3-none-any.whl (197.8 kB view details)

Uploaded Python 3

File details

Details for the file sdmxlib-0.21.0.tar.gz.

File metadata

  • Download URL: sdmxlib-0.21.0.tar.gz
  • Upload date:
  • Size: 160.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.8 {"installer":{"name":"uv","version":"0.11.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for sdmxlib-0.21.0.tar.gz
Algorithm Hash digest
SHA256 b4229872afc5729d2895cdf04c8e0d42a6e87cfe1ed3fdf2612c41a5a3807ba3
MD5 d0d5ea09dd8c9c397f64c09bb6a80868
BLAKE2b-256 5d2d27bf33cae5b60b49aa20f497428a0edfa86cba56591e46a7f1780294d4b3

See more details on using hashes here.

File details

Details for the file sdmxlib-0.21.0-py3-none-any.whl.

File metadata

  • Download URL: sdmxlib-0.21.0-py3-none-any.whl
  • Upload date:
  • Size: 197.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: uv/0.11.8 {"installer":{"name":"uv","version":"0.11.8","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}

File hashes

Hashes for sdmxlib-0.21.0-py3-none-any.whl
Algorithm Hash digest
SHA256 5c8cd111566d86874e9abb8fc32e7ff0ad31e4f7706b1e5af5e489b605baa075
MD5 74ca2fa9ca87ca863fef1abad444f883
BLAKE2b-256 23c05e3be76e6de3264c52b61d775d0adf2d1eb530f5d54711d3a2910c76a4ce

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page