Thanks to visit codestin.com
Credit goes to notes.kvfrans.com

Skip to main content

Ctrl+K

An Alchemist's Notes on Deep Learning

Numerical Toolkit

Overview of JAX
Building NNs with Flax
The jaxtransformer Library

Training Neural Networks

Why Neural Networks?
Backpropagation
Optimization

Building Blocks

Dense Layers
Activation Functions
Normalization Functions
Residual Networks
Convolutional Layers
Recurrent Layers
Attention
The Transformer

Models

Classifiers
Variational Auto-Encoders
Generative Adversarial Networks
Diffusion and Flow Matching

Misc

Model Agnostic Meta Learning
Learning Rate Scheduling
Second-Order Optimization
Matrix Optimizers
PSGD and Relative Gradients
Optimzing our LLM RL Pipeline

Index

By Kevin Frans

© Copyright 2023.