A ground-up technical course on how large language models are built and trained. Starting from the map of the whole system, it works through tokenization, self-attention, the transformer block, the loss function, backpropagation, optimizers, fine-tuning, and inference — with full derivations at each step.

Audience: technically comfortable, new to ML.
Prerequisites: linear algebra, multivariate calculus, basic probability.


#Lesson
1The Big Picture
2Tokenization & Embeddings
3Self-Attention
4The Transformer Block
5Output Head & Objective
6The Loss Function
7Backpropagation & Gradient Descent
8Optimizers, Learning Rate & Batches
9Fine-Tuning, SFT & RLHF
10Inference in Depth

Appendices

AAcronyms
A²Chinchilla Scaling Laws
BFormulas
CAttention Variants
DPositional Encodings