Pre-release

This release is a pre-release and may not be stable for production use.

License GitHub Release Codecov PyPI npm node Crates.io Crates.io Crates.io Ask DeepWiki

NeMo Relay

nemo-relay is the NeMo Relay package for Python applications. It gives Python code access to a portable agent runtime for execution scopes, middleware, plugins, lifecycle events, adaptive behavior, and observability around tool and LLM calls.

The package wraps the shared Rust runtime, so Python applications use the same runtime semantics as the Rust and Node.js surfaces.

Why Use It?

Use the Python binding for the following tasks:

  • Own execution context in Python: Group agent, tool, and LLM work into one scope tree from Python application code.
  • Package policy around callbacks: Use guardrails and intercepts to block work, sanitize observability payloads, rewrite requests, or wrap execution.
  • Emit one lifecycle stream: Send runtime events to in-process subscribers, Agent Trajectory Interchange Format (ATIF), or typed OpenTelemetry workflows.
  • Integrate without a framework migration: Wrap framework or provider callbacks while preserving the application’s orchestration model.

What You Get

The Python package provides the following capabilities:

  • Scope, tool, and LLM helpers: Managed boundaries that emit lifecycle events and run middleware in a consistent order.
  • Middleware APIs: Guardrails and intercepts for tool and LLM requests, responses, and execution, plus mark and scope event sanitizers for data, category_profile, and metadata.
  • Subscribers and exporters: OpenTelemetrySubscriber accepts one required full, gen_ai, or openinference endpoint configuration. The nemo_relay.observability helpers configure plugin-owned endpoint fan-out.
  • Plugin and typed helpers: Public modules for plugins, codecs, typed wrappers, adaptive runtime behavior, and observability plugin configuration.
  • Shared Rust runtime semantics: Python behavior aligned with the Rust and Node.js surfaces.

Installation

Install the published package with uv:

uv add nemo-relay

If you are not using uv, install it with pip:

pip install nemo-relay

Optional Dependencies

LangChain Integration

LangChain integration is available with the langchain extra:

# With uv
uv add "nemo-relay[langchain]"

# With pip
pip install "nemo-relay[langchain]"

LangGraph Integration

LangGraph integration is available with the langgraph extra, this builds upon and includes the langchain extra as well.

# With uv
uv add "nemo-relay[langgraph]"

# With pip
pip install "nemo-relay[langgraph]"

Deep Agents Integration

Deep Agents integration is available with the deepagents extra. This extra builds upon and includes the langgraph and langchain extras.

# With uv
uv add "nemo-relay[deepagents]"

# With pip
pip install "nemo-relay[deepagents]"

LangChain NVIDIA Integration

The LangChain NVIDIA extra builds upon the langchain extra adding a compatible version of the langchain-nvidia-ai-endpoints package.

# With uv
uv add "nemo-relay[langchain-nvidia]"

# With pip
pip install "nemo-relay[langchain-nvidia]"

To install this along with the langgraph extra, use:

# With uv
uv add "nemo-relay[langgraph,langchain-nvidia]"
# With pip
pip install "nemo-relay[langgraph,langchain-nvidia]"

Getting Started

Register a subscriber, create a scope, and emit a mark event:

import nemo_relay


def on_event(event) -> None:
    print(f"{event.kind} {event.name}")


nemo_relay.subscribers.register("printer", on_event)

with nemo_relay.scope.scope("demo-agent", nemo_relay.ScopeType.Agent) as handle:
    nemo_relay.scope.event("initialized", handle=handle, data={"binding": "python"})

nemo_relay.subscribers.flush()
nemo_relay.subscribers.deregister("printer")

Native subscriber delivery is asynchronous, so call nemo_relay.subscribers.flush() before you read subscriber output or exit. From an asyncio task, use await nemo_relay.subscribers.flush_async() so async event sanitizers can continue running on that event loop.

For host integrations that need a serialized event shape, consume the canonical JSON payload from the subscriber event object:

import json
import nemo_relay


def on_event(event) -> None:
    payload = event.to_dict()
    print(payload["kind"], payload["name"])
    assert json.loads(event.to_json()) == payload


nemo_relay.subscribers.register("host-exporter", on_event)
try:
    with nemo_relay.scope.scope("demo-agent", nemo_relay.ScopeType.Agent):
        nemo_relay.scope.event("initialized", data={"binding": "python"})
finally:
    nemo_relay.subscribers.flush()
    nemo_relay.subscribers.deregister("host-exporter")

Package Surface

The public package modules are:

  • nemo_relay.scope
  • nemo_relay.tools
  • nemo_relay.llm
  • nemo_relay.guardrails
  • nemo_relay.intercepts
  • nemo_relay.subscribers
  • nemo_relay.plugin
  • nemo_relay.adaptive
  • nemo_relay.observability
  • nemo_relay.typed
  • nemo_relay.codecs

Integrations

  • nemo_relay.integrations.langchain
  • nemo_relay.integrations.langgraph
  • nemo_relay.integrations.deepagents

The compiled extension is exposed as nemo_relay._native.

Documentation

NeMo Relay Documentation: https://docs.nvidia.com/nemo/relay

Project links

Data verified by PyPI on Jul 31, 2026
Data provided by the project maintainers, verified at the time the release was uploaded to PyPI.

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.7.3)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for willkill07 from gravatar.com willkill07

Credits

Author: NVIDIA Corporation & Affiliates

GitHub Statistics

Data verified by PyPI on Jul 31, 2026
The GitHub source repository was provided by the project maintainers and verified by PyPI at the time of upload. Stars, forks, and open issues/PRs are derived from that repository and have not been independently verified.

License expression

Apache-2.0
View SPDX License List

Requires

Python >=3.11

Provides Extra

cli deepagents langchain langchain-nvidia langgraph

Tags

agents ai llm middleware nemo-relay observability runtime tools

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distributions

If you're not sure about the file name format, learn more about wheel file names.

nemo_relay-0.7.0rc2-cp311-abi3-win_arm64.whl (12.3 MB view details)

Uploaded CPython 3.11+Windows ARM64

nemo_relay-0.7.0rc2-cp311-abi3-win_amd64.whl (13.0 MB view details)

Uploaded CPython 3.11+Windows x86-64

nemo_relay-0.7.0rc2-cp311-abi3-musllinux_1_2_x86_64.whl (15.0 MB view details)

Uploaded CPython 3.11+musllinux: musl 1.2+ x86-64

nemo_relay-0.7.0rc2-cp311-abi3-musllinux_1_2_aarch64.whl (14.7 MB view details)

Uploaded CPython 3.11+musllinux: musl 1.2+ ARM64

nemo_relay-0.7.0rc2-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.9 MB view details)

Uploaded CPython 3.11+manylinux: glibc 2.17+ x86-64

nemo_relay-0.7.0rc2-cp311-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (12.2 MB view details)

Uploaded CPython 3.11+manylinux: glibc 2.17+ ARM64

nemo_relay-0.7.0rc2-cp311-abi3-macosx_11_0_arm64.whl (12.9 MB view details)

Uploaded CPython 3.11+macOS 11.0+ ARM64

File details

Details for the file nemo_relay-0.7.0rc2-cp311-abi3-win_arm64.whl.

File metadata

File hashes

Hashes for nemo_relay-0.7.0rc2-cp311-abi3-win_arm64.whl
Algorithm Hash digest
SHA256 595d6114583556247d077488d2ecafd1faa0021010c95716a1cae003a16c2353
MD5 4ba9126600d0102d8803117e04200be1
BLAKE2b-256 15ff89b83055372c1ed06b003da7238915948866af48ca8492b097b01ffd799c

See more details on using hashes here.

Provenance

The following attestation bundles were made for nemo_relay-0.7.0rc2-cp311-abi3-win_arm64.whl:

Publisher: ci.yaml on NVIDIA/NeMo-Relay

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nemo_relay-0.7.0rc2-cp311-abi3-win_amd64.whl.

File metadata

File hashes

Hashes for nemo_relay-0.7.0rc2-cp311-abi3-win_amd64.whl
Algorithm Hash digest
SHA256 26c9f33dee0103efa1da64ed07d2386908c6b47de940559f40ffeed778bb84d4
MD5 98b7ec50646888c907f5df7d83888e8b
BLAKE2b-256 51ee2f3f0fd885b0e503982b0276928fae9a7bdd4b74e818c3aa7be30283bcc8

See more details on using hashes here.

Provenance

The following attestation bundles were made for nemo_relay-0.7.0rc2-cp311-abi3-win_amd64.whl:

Publisher: ci.yaml on NVIDIA/NeMo-Relay

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nemo_relay-0.7.0rc2-cp311-abi3-musllinux_1_2_x86_64.whl.

File metadata

File hashes

Hashes for nemo_relay-0.7.0rc2-cp311-abi3-musllinux_1_2_x86_64.whl
Algorithm Hash digest
SHA256 8b36b7aadc069e89825ba40b09393a0d86a36b0cb5e9207f354f7c95eac7dc8e
MD5 f4a67c26c3b72ae9c2932c594e0a8a30
BLAKE2b-256 b83687927ac18bf74f4fca6837d658572d8d71b2f381e074ee318938eeb5a481

See more details on using hashes here.

Provenance

The following attestation bundles were made for nemo_relay-0.7.0rc2-cp311-abi3-musllinux_1_2_x86_64.whl:

Publisher: ci.yaml on NVIDIA/NeMo-Relay

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nemo_relay-0.7.0rc2-cp311-abi3-musllinux_1_2_aarch64.whl.

File metadata

File hashes

Hashes for nemo_relay-0.7.0rc2-cp311-abi3-musllinux_1_2_aarch64.whl
Algorithm Hash digest
SHA256 4350fa13345c58e23d60a6948fc6fe01ba9afa6235db56a79b425bb40bc7f16e
MD5 6db955251c9abd9c4b53fbdd1ba45cfd
BLAKE2b-256 ec9de6e8d8ba128f62493712e3c0114a862018d84a3e56577c864e38f0c83341

See more details on using hashes here.

Provenance

The following attestation bundles were made for nemo_relay-0.7.0rc2-cp311-abi3-musllinux_1_2_aarch64.whl:

Publisher: ci.yaml on NVIDIA/NeMo-Relay

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nemo_relay-0.7.0rc2-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.

File metadata

File hashes

Hashes for nemo_relay-0.7.0rc2-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Algorithm Hash digest
SHA256 5cf8ef047550b757c3f858340a7aee2dce01e7e3e4caf83740e7f59473309901
MD5 81938128814e637bc5ad1bb923e4fdec
BLAKE2b-256 cde4a8262b5b5a991cbfdac71fdb62940b32b15292c501be85f5968037ff5405

See more details on using hashes here.

Provenance

The following attestation bundles were made for nemo_relay-0.7.0rc2-cp311-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl:

Publisher: ci.yaml on NVIDIA/NeMo-Relay

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nemo_relay-0.7.0rc2-cp311-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl.

File metadata

File hashes

Hashes for nemo_relay-0.7.0rc2-cp311-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Algorithm Hash digest
SHA256 b4a67adfb2bc3786d56b736032799a4789134c44c5bc32e8cc2738bd134d9fdf
MD5 095386e696a3218484f9f0e7426abd01
BLAKE2b-256 8114c094eb5e623d77b351d23ebd9036564a36ecca3eb32c5466635133c3a280

See more details on using hashes here.

Provenance

The following attestation bundles were made for nemo_relay-0.7.0rc2-cp311-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl:

Publisher: ci.yaml on NVIDIA/NeMo-Relay

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

File details

Details for the file nemo_relay-0.7.0rc2-cp311-abi3-macosx_11_0_arm64.whl.

File metadata

File hashes

Hashes for nemo_relay-0.7.0rc2-cp311-abi3-macosx_11_0_arm64.whl
Algorithm Hash digest
SHA256 abf905de02059b8ddff3bd66a8fcfc58a62b889d165bb322257f7197a4806c96
MD5 a2a348c4f19c38cd10d815ae491b9a94
BLAKE2b-256 891c72b4c956a99193490d2202b9db9a05f54ff3559410c8bf9f22f919a16414

See more details on using hashes here.

Provenance

The following attestation bundles were made for nemo_relay-0.7.0rc2-cp311-abi3-macosx_11_0_arm64.whl:

Publisher: ci.yaml on NVIDIA/NeMo-Relay

Attestations: Values shown here reflect the state when the release was signed and may no longer be current.

Release history Release notifications | RSS feed

Pre-release

0.8.0rc1

8 files

0.7.3

8 files

0.7.2

8 files

0.7.1

8 files

0.7.0

8 files

Pre-release

0.7.0rc6

8 files

Pre-release

0.7.0rc5

8 files

Pre-release

0.7.0rc4

7 files

Pre-release

0.7.0rc3

7 files

This release
Pre-release

0.7.0rc2 This release

7 files

Pre-release

0.7.0rc1

7 files

0.6.0

8 files

Pre-release

0.6.0rc4

5 files

Pre-release

0.6.0rc3

5 files

Pre-release

0.6.0rc2

5 files

Pre-release

0.6.0rc1

5 files

0.5.0

5 files

0.4.0

5 files

0.3.0

5 files

Pre-release

0.3.0rc1

5 files

Pre-release

0.3.0b2

5 files

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page