NVIDIA GPUDirect Storage Driver

Tutorial for building a custom CUDA function for Pytorch

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

A user-space test platform for testing the p2pdma Linux kernel framework with NVMe CMBs and other PCIe BAR memory.

Stack trace visualizer

Running large language models on a single GPU for throughput-oriented scenarios.

⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.

LLM inference in C/C++

High-speed Large Language Model Serving for Local Deployment

A graph-based distributed in-memory store that leverages efficient graph exploration to provide highly concurrent and low-latency queries over big linked data

Benchmark Test Suite for RDMA Networks

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Ongoing research training transformer models at scale

A curated list of awesome Distributed Deep Learning resources.

code for graduation design

Infiniband Verbs Performance Tests

Latex code for making neural networks diagrams

👨🏻‍💻👩🏻‍💻 Use Ant Design like a Pro!

OpenMMLab Detection Toolbox and Benchmark