NeurIPS 2026 arXiv 2610.03361
Follow the Winners: Conservative Policy Improvement with the Cross-Entropy Method for Critic-Free RFT
Methods like GRPO train an agent by running each task several times from the same start and comparing the runs. An agent at work in a live service or a security sandbox cannot do that: each run changes the system, and an investigation may give one useful attempt.
Follow the Winners keeps the attempts it has, picks the best few from random batches of them, and learns from those in small, careful steps.








