Last released Jul 8, 2025
nvFSDP - NVIDIA fork of Fully Sharded Data Parallelism that is cross-compatible with Megatron / TransformerEngine and native PyTorch.
Supported by