This release is a pre-release and may not be stable for production use.
NVIDIA NeMo Fabric Adapter Utilities
nemo-fabric-adapters-common provides shared Python helpers for NeMo
NeMo Fabric adapter implementations. Adapter packages normally install
this package as a dependency.
Install the package directly when developing an adapter:
pip install nemo-fabric-adapters-common
Refer to the NeMo Fabric documentation for adapter and configuration guidance. Source code is available in the NVIDIA NeMo Fabric repository.
Persistent Local Hosts
Every local Process or Python adapter implements the ordered persistent-host
wire protocol. Python adapters can use
nemo_fabric_adapters.common.lifecycle. Supply a factory that creates one
adapter-owned runtime with asynchronous start, invoke, and stop methods:
from nemo_fabric_adapters.common import lifecycle
class AdapterRuntime:
async def start(self, payload):
self.client = await connect_client(payload)
async def invoke(self, payload):
return await self.client.run(payload["request"]["input"])
async def stop(self):
await self.client.close()
lifecycle.serve(AdapterRuntime)
NeMo Fabric calls the factory once per local host to create one runtime instance and
serializes invocations through that instance. The host keeps one event loop
alive for the complete lifecycle so SDK clients, compiled graphs,
checkpointers, and harness databases can remain live safely. NeMo Fabric sends the
resolved configuration and capability plan during start. Each subsequent
invoke wire payload contains only runtime_context and request, and the
helper passes that payload to AdapterRuntime.invoke unchanged. An adapter that
needs configuration during invocation retains it as runtime-owned state during
start. Adapter stdout is reserved for the protocol; diagnostics are redirected
to stderr. A host crash or protocol timeout terminates that runtime.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file nemo_fabric_adapters_common-0.1.0rc2.tar.gz.
File metadata
- Download URL: nemo_fabric_adapters_common-0.1.0rc2.tar.gz
- Upload date:
- Size: 5.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/6.2.0 CPython/3.14.6
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
f64f71c15801d4fd341bdc898542a761f9ce457bd5f1bb649fab9d7f125a4cb7
|
|
| MD5 |
f46864fcc873bdf559de87a84c8a93a0
|
|
| BLAKE2b-256 |
051c74d5eb88fc4c448123ec902bafb473816c2f504b4b22ca0c6d1debd77cd5
|
