17 projects
megatron-bridge
Megatron Bridge: Training Recipes for Megatron-based LLM and VLM models
NeMo-Export-Deploy
NeMo Export and Deploy - a library to export and deploy LLMs and MMs
nemo-run
A powerful tool designed to streamline the configuration, execution and management of Machine Learning experiments across various computing environments.
megatron-fsdp
**Megatron-FSDP** is an NVIDIA-developed PyTorch extension that provides a high-performance implementation of Fully Sharded Data Parallelism (FSDP)
megatron-core
Megatron Core - a library for efficient and scalable training of transformer based models
nemo-automodel
DTensor-native pretraining and fine-tuning for LLMs/VLMs with day-0 Hugging Face support, GPU-acceleration, and memory efficiency.
nemo-toolkit
NeMo - a toolkit for Conversational AI
nemo-curator
Scalable Data Preprocessing Tool for Training Large Language Models
emerging-optimizers
A research project for emerging optimizers other than AdamW
nemo-lens
Shared OpenTelemetry library for NVIDIA NeMo ecosystem (Megatron-LM, NeMo-RL, NeMo-Gym)
nemo-evaluator
NeMo Evaluator — benchmark environments, pluggable solvers, interceptor proxy, and decision-grade scoring for LLMs
nemo-evaluator-launcher
Launcher for the evaluations provided by NeMo Evaluator containers with different runtime backends
nv-grouped-gemm
GEMM Grouped
nemo-eval
NeMo Eval: Evaluation Utilities for LLM and VLM models
nvFSDP
nvFSDP - NVIDIA fork of Fully Sharded Data Parallelism that is cross-compatible with Megatron / TransformerEngine and native PyTorch.
nemo-rl
NeMo RL: A Scalable and Efficient Post-Training Library for Models Ranging from 1 GPU to 1000s, and from Tiny to >100B Parameters
nemo-aligner
NeMo-Aligner - a toolkit for model alignment
