Agentic RL 2: RL for LLMs

RL Methods for LLM PostTraining (vanilla-ppo, RLHF-PPO, DPO, RLVR, DeepSeek-Math-GRPO)

2026-11-02 · 11 min · 2180 words · Xiyuan Yang

Agentic RL 3: From Tokens to Trajectories, Long-Horizon Reinforcement Learning

What is after GRPO? Advanced long-horizon agentic reinforcement learning. (DAPO, GSPO, SAO, FlashREINFORCE, more advanced training recipes.)

2026-10-19 · 8 min · 1604 words · Xiyuan Yang

MidTraining Overview

Mid-training paper list & tech reports. (Continual pretraining, retention, RL scaling)

2026-10-12 · 1 min · 76 words · Xiyuan Yang

Agentic RL 1: From Policy Gradient to PPO

From RL Basis to Policy Gradient (reward-to-go, advantage estimations), REINFORCE, Actor-Critic, PPO (Importance Sampling and Clipping)

2026-10-12 · 6 min · 1195 words · Xiyuan Yang

Slime101: Slime Core Training Pipeline

Core Slime training pipeline analysis. (Ray, Megatron, SGLang)

2026-10-08 · 4 min · 711 words · Xiyuan Yang

Frontier Post Training Pipelines

Post-training analysis & summaries from frontier base model tech reports (continuously updated).

2026-10-08 · 3 min · 516 words · Xiyuan Yang