Frontier Post Training Pipelines
Post-training analysis & summaries from frontier base model tech reports (continuously updated).
Deepseek
Advanced LLMs 1: Attentions
Frontier LLM's Attention (MQA, GQA, MLA, Linear Attention Family, Flash Attention Family, Sparse Attention Family, Advanced Attentions)