nv-dfm-core 3.1.27

Data Federation Mesh Core Framework

nv-dfm-core

Core framework for the Data Federation Mesh (DFM) project.

Overview

nv-dfm-core provides the foundation for building and running federated data processing pipelines:

Component	Description
Pipeline API	Declarative Python API for defining pipelines (Pipeline, Yield, PlaceParam, ForEach, etc.)
Compilation	IRGen and ModGen convert pipelines to executable Petri nets
Execution	NetRunner, JobController, and Router for distributed execution
CLI	dfm command for development, federation management, and deployment
Targets	Flare (distributed) and Local (multiprocessing) execution backends

Installation

pip install nv-dfm-core

Or with uv in the monorepo:

uv sync --package nv-dfm-core

Quick Start

from nv_dfm_core.api import Pipeline, Yield, PlaceParam
from nv_dfm_core.session import Session

# Define a pipeline
with Pipeline() as p:
    result = SomeOperation(...)
    Yield(value=result)

# Execute with a session (see tutorials for federation setup)
with Session(federation="my_federation") as session:
    job = session.execute(p)
    for result in job.results():
        print(result)

Documentation

• DFM Documentation
• Installation
• CLI Reference
• Tutorials

License

Apache License 2.0. See the LICENSE file for details.