Skip to main content

Common utilities for DFM adapter libraries

Project description

nv-dfm-lib-common

Shared schemas and utilities for NVIDIA Data Federation Mesh (DFM) adapter libraries.

What is DFM?

Data Federation Mesh (DFM) is a Python-based framework for creating and orchestrating complex workflows that process data from various distributed sources and stream results into applications. DFM determines where to run each operation of a data processing pipeline and handles data movement between sites automatically.

Overview

nv-dfm-lib-common provides common building blocks used across DFM adapter libraries such as nv-dfm-lib-weather:

Component Description
Output Schemas Pydantic models for adapter return types: GeoJsonFile, TextureFile, TextureFileList
XArray Schemas Schema definitions and validation for xarray Datasets (XArraySchema, coordinate/variable checks)

This package is part of the DFM ecosystem:

Package Description
nv-dfm-core Core framework — Pipeline API, execution engine, code generation, and CLI
nv-dfm-lib-weather Experimental weather and climate data adapters (GFS, ECMWF, HRRR, SFNO, cBottle)

Installation

This package is typically installed as a dependency of other nv-dfm-lib-* packages:

pip install nv-dfm-lib-common

Or from source with uv:

git clone https://github.com/NVIDIA/data-federation-mesh.git
cd data-federation-mesh
uv sync --package nv-dfm-lib-common

Usage

from nv_dfm_lib_common.schemas import GeoJsonFile, TextureFile, TextureFileList
from nv_dfm_lib_common.schemas.xarray import XArraySchema, check_dims, check_dtype

Documentation

License

Apache License 2.0. See the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

nv_dfm_lib_common-3.1.31-py3-none-any.whl (31.7 kB view details)

Uploaded Python 3

File details

Details for the file nv_dfm_lib_common-3.1.31-py3-none-any.whl.

File metadata

File hashes

Hashes for nv_dfm_lib_common-3.1.31-py3-none-any.whl
Algorithm Hash digest
SHA256 bb27ff3f41e0f79cf14728ad60ca9d9665cee1e178e06c44f2e16972b0774dee
MD5 09733c75f4a2b60c0a69dce1df8ade74
BLAKE2b-256 16d79b248b631e1796dbe253938e864522e2e1baac15db65c9df68d01c8acbeb

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page