Tags on LLM Notes https://xiyuanyang-code.github.io/llm/tags/ Recent content in Tags on LLM Notes Hugo en Tue, 22 Sep 2026 00:00:00 +0000 Activation https://xiyuanyang-code.github.io/llm/tags/activation/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/activation/ Architecture https://xiyuanyang-code.github.io/llm/tags/architecture/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/architecture/ Attention https://xiyuanyang-code.github.io/llm/tags/attention/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/attention/ Batchnorm https://xiyuanyang-code.github.io/llm/tags/batchnorm/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/batchnorm/ Decoding https://xiyuanyang-code.github.io/llm/tags/decoding/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/decoding/ Deepseek https://xiyuanyang-code.github.io/llm/tags/deepseek/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/deepseek/ Ffn https://xiyuanyang-code.github.io/llm/tags/ffn/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/ffn/ Flash-Attention https://xiyuanyang-code.github.io/llm/tags/flash-attention/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/flash-attention/ Glm https://xiyuanyang-code.github.io/llm/tags/glm/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/glm/ Gqa https://xiyuanyang-code.github.io/llm/tags/gqa/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/gqa/ Inference https://xiyuanyang-code.github.io/llm/tags/inference/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/inference/ Kv-Cache https://xiyuanyang-code.github.io/llm/tags/kv-cache/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/kv-cache/ Layernorm https://xiyuanyang-code.github.io/llm/tags/layernorm/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/layernorm/ Length-Extrapolation https://xiyuanyang-code.github.io/llm/tags/length-extrapolation/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/length-extrapolation/ Linear-Attention https://xiyuanyang-code.github.io/llm/tags/linear-attention/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/linear-attention/ Load-Balancing https://xiyuanyang-code.github.io/llm/tags/load-balancing/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/load-balancing/ Mamba https://xiyuanyang-code.github.io/llm/tags/mamba/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/mamba/ Memory-Bound https://xiyuanyang-code.github.io/llm/tags/memory-bound/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/memory-bound/ Mha https://xiyuanyang-code.github.io/llm/tags/mha/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/mha/ Minimax https://xiyuanyang-code.github.io/llm/tags/minimax/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/minimax/ Mixture-of-Experts https://xiyuanyang-code.github.io/llm/tags/mixture-of-experts/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/mixture-of-experts/ Mla https://xiyuanyang-code.github.io/llm/tags/mla/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/mla/ Model-Architecture https://xiyuanyang-code.github.io/llm/tags/model-architecture/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/model-architecture/ Moe https://xiyuanyang-code.github.io/llm/tags/moe/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/moe/ Mqa https://xiyuanyang-code.github.io/llm/tags/mqa/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/mqa/ Multi-Token-Prediction https://xiyuanyang-code.github.io/llm/tags/multi-token-prediction/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/multi-token-prediction/ Normalization https://xiyuanyang-code.github.io/llm/tags/normalization/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/normalization/ Ntk https://xiyuanyang-code.github.io/llm/tags/ntk/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/ntk/ Optimizer https://xiyuanyang-code.github.io/llm/tags/optimizer/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/optimizer/ Position-Encoding https://xiyuanyang-code.github.io/llm/tags/position-encoding/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/position-encoding/ Pre-Training https://xiyuanyang-code.github.io/llm/tags/pre-training/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/pre-training/ Prefill https://xiyuanyang-code.github.io/llm/tags/prefill/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/prefill/ Qwen https://xiyuanyang-code.github.io/llm/tags/qwen/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/qwen/ Rmsnorm https://xiyuanyang-code.github.io/llm/tags/rmsnorm/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/rmsnorm/ Roofline https://xiyuanyang-code.github.io/llm/tags/roofline/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/roofline/ Rope https://xiyuanyang-code.github.io/llm/tags/rope/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/rope/ Routing https://xiyuanyang-code.github.io/llm/tags/routing/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/routing/ Sparse-Attention https://xiyuanyang-code.github.io/llm/tags/sparse-attention/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/sparse-attention/ Sparse-Model https://xiyuanyang-code.github.io/llm/tags/sparse-model/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/sparse-model/ Speculative-Decoding https://xiyuanyang-code.github.io/llm/tags/speculative-decoding/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/speculative-decoding/ Swiglu https://xiyuanyang-code.github.io/llm/tags/swiglu/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/swiglu/ Training-Stability https://xiyuanyang-code.github.io/llm/tags/training-stability/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/training-stability/ Transformer https://xiyuanyang-code.github.io/llm/tags/transformer/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/transformer/ Yarn https://xiyuanyang-code.github.io/llm/tags/yarn/ Tue, 22 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/yarn/ Actor https://xiyuanyang-code.github.io/llm/tags/actor/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/actor/ Codebase https://xiyuanyang-code.github.io/llm/tags/codebase/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/codebase/ Distributed-Training https://xiyuanyang-code.github.io/llm/tags/distributed-training/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/distributed-training/ Inference-System https://xiyuanyang-code.github.io/llm/tags/inference-system/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/inference-system/ Infra https://xiyuanyang-code.github.io/llm/tags/infra/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/infra/ Llm https://xiyuanyang-code.github.io/llm/tags/llm/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/llm/ Megatron https://xiyuanyang-code.github.io/llm/tags/megatron/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/megatron/ Mid-Training https://xiyuanyang-code.github.io/llm/tags/mid-training/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/mid-training/ Overview https://xiyuanyang-code.github.io/llm/tags/overview/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/overview/ Post-Training https://xiyuanyang-code.github.io/llm/tags/post-training/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/post-training/ Ray https://xiyuanyang-code.github.io/llm/tags/ray/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/ray/ Rl https://xiyuanyang-code.github.io/llm/tags/rl/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/rl/ Roadmap https://xiyuanyang-code.github.io/llm/tags/roadmap/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/roadmap/ Rollout https://xiyuanyang-code.github.io/llm/tags/rollout/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/rollout/ Sglang https://xiyuanyang-code.github.io/llm/tags/sglang/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/sglang/ Slime https://xiyuanyang-code.github.io/llm/tags/slime/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/slime/ Training-Recipes https://xiyuanyang-code.github.io/llm/tags/training-recipes/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/training-recipes/ Training-System https://xiyuanyang-code.github.io/llm/tags/training-system/ Fri, 18 Sep 2026 00:00:00 +0000 https://xiyuanyang-code.github.io/llm/tags/training-system/