🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.

SGLang is a fast serving framework for large language models and vision language models.

VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.

An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.

EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty

High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and versatility of software and hardware.

Open deep learning compiler stack for cpu, gpu and specialized accelerators

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies. Note: the repository does not accept github pull requests at this moment. Please submit your patches at…

记录备份互联网高质量资料与咨询

Caffe: a fast open framework for deep learning.

GPT-3: Language Models are Few-Shot Learners

CTP 高频量化交易平台 C++ Trade Platform for quant developer

TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Simple Reinforcement learning tutorials

Reference implementations of training benchmarks

Open-source software for robot simulation, integrated with OpenAI Gym.

An educational resource to help anyone learn deep reinforcement learning.