Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3, Qwen3-MoE, DeepSeek-R1, GLM4.5, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Llava, …

Supercharge Your LLM with the Fastest KV Cache Layer

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

Repository for nvCOMP docs and examples. nvCOMP is a library for fast lossless compression/decompression on the GPU that can be downloaded from https://developer.nvidia.com/nvcomp.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Examples in the MLX framework

MLX: An array framework for Apple silicon

An open-source time-series SQL database optimized for fast ingest and complex queries. Packaged as a PostgreSQL extension.

Collection of hyperparameter optimization benchmark problems

Tuning hyperparams fast with Hyperband

Python bindings for nvCOMP

cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

Code for Neural Architecture Search without Training (ICML 2021)

A unified, comprehensive and efficient recommendation library