https://xiyuanyang-code.github.io/llm/tags/normalization/ Recent content in Normalization on LLM Notes Hugo en Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/posts/model-arch/normalizations-ffn-rope/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/posts/model-arch/normalizations-ffn-rope/ Pre-Norm / Post-Norm 与 RMSNorm 的推导、激活函数与 SwiGLU FFN，以及 RoPE 的旋转矩阵与长度外推（PI / NTK-aware / YaRN）。