arXiv:2611.25208v1 Announce Type: new
Abstract: Distributional Reinforcement Learning methods aim to learn the entire distribution of returns, yet current algorithmic approaches are limited to a narrow class of distributions. We propose $\varphi$TD, a method to overcome this limitation by computing the loss in the frequency domain. We demonstrate that this further unifies quantile and categorical approaches to distributional RL, and enables the learning of distributions that were previously impossible to capture, such as mixtures of continuous distributions. We empirically study $\varphi$TD, across synthetic benchmarks and large-scale deep RL environments and demonstrate that the flexibility obtained from wider parametric families can lead to improved performance.
Trending
- Bradley-Terry Training Can Distort Outcome Probabilities of Initially Accurate Language World Models
- Exact Bayesian layers via characteristic functions
- Few-Shot Cross-City Traffic Prediction with Conditional Diffusion
- Simulation-pretrained autoencoders versus PCA for compressing multimode fibre transmission matrices
- Design and Evaluation of Epira: An Automated Interview System for Case Investigation and Contact Tracing
- [2611.26291] Who Moved My $Z$ Boson? Revealing Resonance Features Inside a Neural Network
- [2611.25570] Reinforcement-Aligned Probabilistic Weather Forecasting with Discrete Tokens
- Backbone Matters: Benchmarking Encoder-Decoder Networks for Semantic Segmentation of Driving Scenes on BDD100K
