Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Minimal and annotated implementations of key ideas from modern deep learning research.

ArcticInference: vLLM plugin for high-throughput, low-latency inference

A high-throughput and memory-efficient inference and serving engine for LLMs

A PyTorch native platform for training generative AI models

A Spotify player in the terminal with full feature parity

Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020

Pipeline Parallelism for PyTorch

Codebase for Autothrottle (NSDI 2024)

Resource Allocation for Dynamic Demands

NeonVM: QEMU-based virtualization API and controller for Kubernetes

A custom discord client that supports streaming with audio on Linux.

C at Nvim

Codeforces CLI for a fast competitive programming experience

A runtime for writing reliable asynchronous applications with Rust. Provides I/O, networking, scheduling, timers, ...

Distributed transactional key-value database, originally created to complement TiDB

Distributed systems runtime daemon written in Rust.

An open-source C++ library developed and used at Facebook.

Rust programming, in Vietnamese.

A Terminal UI to browse Hacker News

Secure and fast microVMs for serverless computing.

wasmCloud is an open source Cloud Native Computing Foundation (CNCF) project that enables teams to build, manage, and scale polyglot apps across any cloud, K8s, or edge.

Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.

CS 199 Rust Group Project // Anthony, Harsh, & Neil

An interpreted programming language for our CS128 final project

Download market data from Yahoo! Finance's API

C++ library to get stock data from Yahoo Finance

Anime Girls Holding Programming Books