Train transformer language models with reinforcement learning.

Large Language Model Text Generation Inference

FlashInfer: Kernel Library for LLM Serving

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

An awesome repository of local AI tools

SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

Serving multiple LoRA finetuned LLM as one

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyp…

Contributed modules to ray

Kubernetes Helm Charts for the ORY ecosystem.

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch…

Ludwig's documentation

The lightweight PyTorch wrapper for ML researchers. Scale your models. Write less boilerplate

Useful extra functionality for TensorFlow 2.x maintained by SIG-addons

Ludwig is a toolbox built on top of TensorFlow that allows to train and test deep learning models without the need to write code.

Collective communications library with various primitives for multi-machine training.