Anchored Policy Optimization: Mitigating Exploration Collapse via Support-Constrained Rectification

This work analyzes exploration collapse in RLVR and proposes APO to balance stability and efficiency through support coverage on high-confidence regions.

Recommended citation: @misc{wang2026anchoredpolicyoptimizationmitigating, title={Anchored Policy Optimization: Mitigating Exploration Collapse Via Support-Constrained Rectification}, author={Tianyi Wang and Long Li and Hongcan Guo and Yibiao Chen and Yixia Li and Yong Wang and Yun Chen and Guanhua Chen}, year={2026}, eprint={2602.05717}, archivePrefix={arXiv}, primaryClass={cs.AI}, url={https://arxiv.org/abs/2602.05717}, }
Download Paper