Common utilities for DFM adapter libraries
Project description
nv-dfm-lib-common
Shared schemas and utilities for NVIDIA Data Federation Mesh (DFM) adapter libraries.
What is DFM?
Data Federation Mesh (DFM) is a Python-based framework for creating and orchestrating complex workflows that process data from various distributed sources and stream results into applications. DFM determines where to run each operation of a data processing pipeline and handles data movement between sites automatically.
Overview
nv-dfm-lib-common provides common building blocks used across DFM adapter libraries such as nv-dfm-lib-weather:
| Component | Description |
|---|---|
| Output Schemas | Pydantic models for adapter return types: GeoJsonFile, TextureFile, TextureFileList |
| XArray Schemas | Schema definitions and validation for xarray Datasets (XArraySchema, coordinate/variable checks) |
This package is part of the DFM ecosystem:
| Package | Description |
|---|---|
nv-dfm-core |
Core framework — Pipeline API, execution engine, code generation, and CLI |
nv-dfm-lib-weather |
Experimental weather and climate data adapters (GFS, ECMWF, HRRR, SFNO, cBottle) |
Installation
This package is typically installed as a dependency of other nv-dfm-lib-* packages:
pip install nv-dfm-lib-common
Or from source with uv:
git clone https://github.com/NVIDIA/data-federation-mesh.git
cd data-federation-mesh
uv sync --package nv-dfm-lib-common
Usage
from nv_dfm_lib_common.schemas import GeoJsonFile, TextureFile, TextureFileList
from nv_dfm_lib_common.schemas.xarray import XArraySchema, check_dims, check_dtype
Documentation
License
Apache License 2.0. See the LICENSE file for details.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file nv_dfm_lib_common-3.1.29-py3-none-any.whl.
File metadata
- Download URL: nv_dfm_lib_common-3.1.29-py3-none-any.whl
- Upload date:
- Size: 31.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.14.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
fcf76e0b4a63fd64abe4c558c600cf5b2781bcb11b6304b6fe184bbab69a7bcd
|
|
| MD5 |
1372f7a6b49e3d1c84435557a3b5f7ff
|
|
| BLAKE2b-256 |
3c741661f3ff13bc646775d873dc27b44c721210c115c99a3af34a7f98e8741e
|