Cheatsheets on Ship of Theseus

LLM Tokenizers Cheatsheet

Wed, 07 Oct 2026 00:00:00 +0000

How LLM tokenizers turn text into token IDs, and why the choice of BPE, WordPiece or SentencePiece matters.

Wed, 07 Oct 2026 00:00:00 +0000

pip and the classic Python workflow around it: installs, requirements files, virtual environments and reproducible pins.

Wed, 07 Oct 2026 00:00:00 +0000

Self-attention in transformers: queries, keys and values, scaling, masking and multi-head attention.

Wed, 07 Oct 2026 00:00:00 +0000

The reserved tokens that mark document boundaries, chat turns, tool calls and stop conditions in LLM inputs.

Wed, 07 Oct 2026 00:00:00 +0000

UV, Astral's Rust-based Python package and project manager: installs, environments, lockfiles, tools and publishing.