Minimal and annotated implementations of key ideas from modern deep learning research.

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

Pretty fancy and modern terminal file manager

Simulated Annealing Parallelization Experiments

Experiments from Dual Process Learning Paper

Neural network model repository for highly sparse and sparse-quantized models with matching sparsification recipes

A library for mechanistic interpretability of GPT-style language models

Planning to keep a blog of cool topics and thoughts -- might eventually change to make more distill.pub type style, but for now here's what we got. Much of this is from the astropaper repository.

The WeightWatcher tool for predicting the accuracy of Deep Neural Networks

Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.

A delightfully minimal, yet remarkably powerful AI Shell Assistant.

Relaxed Skin Tension Lines App Working

Standalone Ghost Theme

An index of algorithms for learning causality with data

A data index for learning causality.