aiqbench analysis
This paper introduces Bregman neural operators, a theoretical framework that reformulates operator layers as minimizers of Bregman regularized optimization problems within Banach function spaces. By interpreting activation operators as proximity operators between dual and primal spaces, the approach enables the construction of deeper, more accurate Fourier neural operator models without sacrificing expressivity. The work advances the mathematical foundations of learning infinite-dimensional mappings, offering a rigorous pathway to improve training stability and accuracy in physics-informed machine learning applications.
A Bregman Proximal Viewpoint on Neural Operators
arXiv:2610.20120v1 Announce Type: new Abstract: We present several advances on neural operators by viewing the action of operator layers as the minimizers of Bregman regularized optimization problems over Banach function spaces. The proposed framework allows interpreting the activation operators as Bregman proximity operators from dual to primal space. This novel viewpoint is general enough to recover classical neural operators as well as a new variant, coined Bregman neural operators, which includes the inverse activation operator and features the same expressivity of standard neural operators. Numerical experiments support the added benefits of the Bregman variant of Fourier neural operators for training deeper and more accurate models.
Abstract:We present several advances on neural operators by viewing the action of operator layers as the minimizers of Bregman regularized optimization problems over Banach function spaces. The proposed framework allows interpreting the activation operators as Bregman proximity operators from dual to primal space. This novel viewpoint is general enough to recover classical neural operators as well as a new variant, coined Bregman neural operators, which includes the inverse activation operator and features the same expressivity of standard neural operators. Numerical experiments support the added benefits of the Bregman variant of Fourier neural operators for training deeper and more accurate models.
Machine Learning (cs.LG)
arXiv:2610.20120 [cs.LG]
(or arXiv:2610.20120v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2610.20120 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 194 words
Related coverage
How do neural networks regress cubic polynomials? Apparently, they use a trick invented in Milan 500 years ago
LessWrong · Jul 22, 2026
Deep learning methods for inverse problems using connections between proximal operators and Hamilton-Jacobi equations
arXiv · Sep 14, 2026
RINS: Residual-Image Neural Subspace Solvers for Large Sparse Linear Systems
arXiv · Oct 5, 2026
Flux-form spatiotemporal neural operators for coarse-grained dynamics of multiscale PDEs
arXiv · Aug 20, 2026