An autoregressive character-level language model for making more things

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Best practices & guides on how to write distributed pytorch training code

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

🕹️ A diverse suite of scalable reinforcement learning environments in JAX