analiza aiqbench
This research introduces Density-Informed Pseudo-count EDL to resolve a critical flaw in standard Evidential Deep Learning where epistemic and aleatoric uncertainties are conflated, causing overconfidence on out-of-distribution data. By decoupling class predictions from uncertainty magnitude through hierarchical Bayesian modeling, the method achieves theoretically proven asymptotic concentration while empirically enhancing robustness under distributional shifts. The work advances the theoretical foundations of probabilistic machine learning by providing a principled interpretation that improves interpretability and calibration for safety-critical AI applications.
Density-Informed Pseudo-Counts for Calibrated Evidential Deep Learning
arXiv:2602.01477v3 Announce Type: replace-cross Abstract: Evidential Deep Learning (EDL) is a popular framework for uncertainty-aware classification that models predictive uncertainty via Dirichlet distributions parameterized by neural networks. Despite its popularity, its theoretical foundations and behavior under distributional shift remain poorly understood. In this work, we provide a principled statistical interpretation by proving that EDL training corresponds to amortized variational inference in a hierarchical Bayesian model with a tempered pseudo-likelihood. This perspective reveals a major drawback: standard EDL conflates epistemic and aleatoric uncertainty, leading to systematic overconfidence on out-of-distribution (OOD) inputs. To address this, we introduce Density-Informed Pseudo-count EDL (DIP-EDL), a new parametrization that decouples class prediction from the magnitude of uncertainty by separately estimating the conditional label distribution and the marginal covariate density. This separation preserves evidence in high-density regions while shrinking predictions toward a uniform prior for OOD data. Theoretically, we prove that DIP-EDL achieves asymptotic concentration. Empirically, we show that our method enhances interpretability and improves robustness and uncertainty calibration under distributional shift.
Abstract:Evidential Deep Learning (EDL) is a popular framework for uncertainty-aware classification that models predictive uncertainty via Dirichlet distributions parameterized by neural networks. Despite its popularity, its theoretical foundations and behavior under distributional shift remain poorly understood. In this work, we provide a principled statistical interpretation by proving that EDL training corresponds to amortized variational inference in a hierarchical Bayesian model with a tempered pseudo-likelihood. This perspective reveals a major drawback: standard EDL conflates epistemic and aleatoric uncertainty, leading to systematic overconfidence on out-of-distribution (OOD) inputs. To address this, we introduce Density-Informed Pseudo-count EDL (DIP-EDL), a new parametrization that decouples class prediction from the magnitude of uncertainty by separately estimating the conditional label distribution and the marginal covariate density. This separation preserves evidence in high-density regions while shrinking predictions toward a uniform prior for OOD data. Theoretically, we prove that DIP-EDL achieves asymptotic concentration. Empirically, we show that our method enhances interpretability and improves robustness and uncertainty calibration under distributional shift.
Machine Learning (stat.ML); Machine Learning (cs.LG)
arXiv:2602.01477 [stat.ML]
(or arXiv:2602.01477v3 [stat.ML] for this version)
Text integral sub licența deschisă a publicației · 174 cuvinte
Subiecte conexe
Game Design Creativity evals
LessWrong · 12 oct. 2026
Deconfusing Corrigibility
AI Alignment Forum · 17 oct. 2026
The Entangled Dimensions of Decision Theory
LessWrong · 30 iul. 2026
Synthesis Superintelligence: from Semiconductors to Superconductors — Periodic Labs’ Liam Fedus and Ekin Dogus Cubuk
Latent Space · 8 oct. 2026