The open source coding agent.

Defeating the Training-Inference Mismatch via FP16

Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, and full end-to-end reference examples to build with Nemotron models

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

An Easy-to-use, Scalable and High-performance RLHF Framework based on Ray (PPO & GRPO & REINFORCE++ & vLLM & Ray & Dynamic Sampling & Async Agentic RL)

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilizatio…

A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment…

AgentScope: Agent-Oriented Programming for Building LLM Applications

verl: Volcano Engine Reinforcement Learning for LLMs

Scalable toolkit for efficient model reinforcement

Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling

CUDA Templates for Linear Algebra Subroutines

Development repository for the Triton language and compiler

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

Brevitas: neural network quantization in PyTorch

A project to improve skills of large language models

[ICLR2025 Spotlight] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models

Ongoing research training transformer models at scale

Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

A Datacenter Scale Distributed Inference Serving Framework

NVIDIA Isaac GR00T N1.5 is the world's first open foundation model for generalized humanoid robot reasoning and skills.

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch