arXiv:2611.26252v1 Announce Type: new
Abstract: Continual reinforcement learning (CRL) aims to enable agents to adapt to changing tasks while preserving previously acquired capabilities. Evaluation often relies on final aggregate metrics that can hide temporary performance degradation during adaptation. This work introduces a simple CRL benchmark that varies observation representations while preserving environment dynamics and rewards, supporting proof-of-concept demonstrations, inexpensive experimentation, and easily reproducible sanity checks. Using this benchmark, we demonstrate the stability gap in CRL: a substantial drop in prior-task performance after the introduction of new tasks, followed by partial or complete recovery. This pattern occurs despite the agent having complete access to past tasks.
Trending
- Is It Actually Worth Upgrading To The Pixel 11?
- Flow Matching from Non-Gaussian Sources: A Theory of Efficient Sampling
- How To Calibrate Your 3D Printer (And Why You Should)
- The Stability Gap in Continual Reinforcement Learning
- This Is What Can Happen If Too Many Devices Are Sharing Your Home Network
- A Large Language Model-based Agentic Framework Accelerating Structural Relaxation and Electronic Band Prediction for First-Principle Calculation
- Your PC’s USB Port Can Charge Your Phone, Even When It’s Turned Off — Here’s How
- [2611.26232] Time Series Structure Learning with Local Causal Parent Discovery
