arXiv:2611.26426v1 Announce Type: cross
Abstract: Bayesian neural networks provide principled uncertainty estimates, but training them with Monte Carlo sampling can be expensive. Sampling-free variational inference algorithms make training Bayesian neural networks feasible, but existing approaches assume a Gaussian output distribution, which can be inaccurate in applied problems. Here, we introduce CF-Prop, an uncertainty propagation method that uses characteristic functions to compute the exact output distribution of a Bayesian ReLU layer, without any sampling, even in non-Gaussian settings. Because CF-Prop propagates characteristic functions, the evidence lower bound—the objective of variational training—can be computed in closed form for a broad class of likelihoods, including the Gaussian, Poisson, and Gamma. This allows to implement an efficient resulting variational inference algorithm, CF-VI. On CIFAR-100, CF-VI achieves the lowest calibration error of any tested method, improving on the next best method by about 35%. On a heavy-tailed insurance claim dataset, CF-VI accurately captures tail uncertainty that is severely underestimated by both other sampling-free methods and Monte Carlo methods.
Trending
- Exact Bayesian layers via characteristic functions
- Few-Shot Cross-City Traffic Prediction with Conditional Diffusion
- Simulation-pretrained autoencoders versus PCA for compressing multimode fibre transmission matrices
- Design and Evaluation of Epira: An Automated Interview System for Case Investigation and Contact Tracing
- [2611.26291] Who Moved My $Z$ Boson? Revealing Resonance Features Inside a Neural Network
- [2611.25570] Reinforcement-Aligned Probabilistic Weather Forecasting with Discrete Tokens
- Backbone Matters: Benchmarking Encoder-Decoder Networks for Semantic Segmentation of Driving Scenes on BDD100K
- Is a Description Worth a Thousand Demonstrations? Specificity and Reliability of Task Descriptions in In-Context Learning
