LLM training in simple, raw C/CUDA

Instant neural graphics primitives: lightning fast NeRF and more

DeepEP: an efficient expert-parallel communication library

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

Tile primitives for speedy kernels

This package contains the original 2012 AlexNet code.

how to optimize some algorithm in cuda.

Sample codes for my CUDA programming book

Flash Attention in ~100 lines of CUDA (forward pass only)

Fast CUDA matrix multiplication from scratch

Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)

Code from the "CUDA Crash Course" YouTube series by CoffeeBeforeArch

A CUDA implementation of SIFT for NVidia GPUs (1.2 ms on a GTX 1060)

Examples demonstrating available options to program multiple GPUs in a single node or a cluster

GPU accelerated decision optimization

UNet diffusion model in pure CUDA

CUDA Learning guide

Learnings and programs related to CUDA

Step-by-step optimization of CUDA SGEMM

EGGROLL in C, integer-first training

CUDA Matrix Multiplication Optimization

Parrot is a C++ library for fused array operations using CUDA/Thrust. It provides efficient GPU-accelerated operations with lazy evaluation semantics, allowing for chaining of operations without un…

A CUDA reimplementation of the line/plane odometry of LIO-SAM. A point cloud hash map (inspired by iVox of Faster-LIO) on GPU is used to accelerate 5-neighbour KNN search. Run on Jetson Orin NX 8GB.

Some CUDA example code with READMEs.

High-Performance FP32 GEMM on CUDA devices