Development repository for the Triton language and compiler

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

21 Lessons, Get Started Building with Generative AI

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Curated collection of papers in machine learning systems

FlagGems is an operator library for large language models implemented in the Triton Language.

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Puzzles for learning Triton

LeetGPU Challenges

High performance inference engine for diffusion models

📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉

Nano vLLM

Triton based sparse quantization attention kernel collection

《Hello 算法》：动画图解、一键运行的数据结构与算法教程。支持 Python, Java, C++, C, C#, JS, Go, Swift, Rust, Ruby, Kotlin, TS, Dart 代码。简体版和繁体版同步更新，English version in translation

Distributed parallel 3D-Causal-VAE for efficient training and inference

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

A light llama-like llm inference framework based on the triton kernel.

OpenCamp 训练营通用学习工具

2025夏季训练营CUDA方向项目

A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a fast serving framework for large language models and vision language models.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…