https://xiyuanyang-code.github.io/llm/tags/nll/ Recent content in Nll on Frontier LLM Notes Hugo zh-cn Mon, 02 Nov 2026 20:39:37 +0800 https://xiyuanyang-code.github.io/llm/posts/pre-training/pretraining-basics/ Mon, 02 Nov 2026 20:39:37 +0800 https://xiyuanyang-code.github.io/llm/posts/pre-training/pretraining-basics/ Pre-training math basics (autoregressive token modeling, MLE / NLL training objectives, training gradients, KL divergence)