Blog
LLM Inference Parallelism, Explained with Animations
An animated, self-contained guide to LLM inference parallelism: DP, TP, PP, EP, their combinations, and the attention designs (MHA, GQA, MQA, MLA) that make them work.
Next-Concept Modeling (NCM), Explained with Animations
How a language model can write a whole paragraph in ~12 parallel steps instead of hundreds of sequential ones: a learned coarse-to-fine hierarchy of discrete codes, generated one level at a time.