StablePDENet: Enhancing Neural Operator Stability through Physics-Informed Residual-Sensitivity Regularization

arXiv:2601.06472v2 Announce Type: replace Abstract: Learning solution operators for differential equations with neural networks has shown great potential in scientific computing, but ensuring their stability under input perturbations remains a critical challenge. We introduce the StablePDENet, a physics-informed adversarial training method that regularizes the residual sensitivity with respect to an input perturbation. The operator learning task is formulated as a min--max optimization problem, where the inner model searches admissible input perturbations by physics-based projected-gradient adversary, while the outer problem combines the attacked physics loss with a normalized residual-sensitivity penalty. Moreover, residual-sensitivity regularization is included to ensure that the local Lipschitz constant of the learned operator is a more accurate approximation to that of the exact operator. We evaluate the StablePDENet on several benchmark problems. Compared with PI-DeepONet and its adversarially trained variant, StablePDENet achieves higher accuracy under adversarial input perturbations while maintaining competitive accuracy on clean inputs. The numerical results also demonstrate that the StablePDENet can effectively improve the generalization accuracy for operator learning. The Helmholtz study further distinguishes learned-model sensitivity from amplification intrinsic to an ill-conditioned solution operator. The results support residual-sensitivity regularization as a practical route to more stable and physically consistent neural PDE operators.

Abstract:Learning solution operators for differential equations with neural networks has shown great potential in scientific computing, but ensuring their stability under input perturbations remains a critical challenge. We introduce the StablePDENet, a physics-informed adversarial training method that regularizes the residual sensitivity with respect to an input perturbation. The operator learning task is formulated as a min--max optimization problem, where the inner model searches admissible input perturbations by physics-based projected-gradient adversary, while the outer problem combines the attacked physics loss with a normalized residual-sensitivity penalty. Moreover, residual-sensitivity regularization is included to ensure that the local Lipschitz constant of the learned operator is a more accurate approximation to that of the exact operator. We evaluate the StablePDENet on several benchmark problems. Compared with PI-DeepONet and its adversarially trained variant, StablePDENet achieves higher accuracy under adversarial input perturbations while maintaining competitive accuracy on clean inputs. The numerical results also demonstrate that the StablePDENet can effectively improve the generalization accuracy for operator learning. The Helmholtz study further distinguishes learned-model sensitivity from amplification intrinsic to an ill-conditioned solution operator. The results support residual-sensitivity regularization as a practical route to more stable and physically consistent neural PDE operators.

Machine Learning (cs.LG)

arXiv:2601.06472 [cs.LG]

(or arXiv:2601.06472v2 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2601.06472 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

aiqbench analysis

StablePDENet: Enhancing Neural Operator Stability through Physics-Informed Residual-Sensitivity Regularization

Related coverage