PE-MHL: Physics-Encoded Modular Hybrid Layers for Scalable Learning of Complex Systems

Abstract:Hybrid models that combine physics-based and data-driven components have shown strong potential for achieving accuracy and interpretability in control applications. While recent methods have made progress in incorporating physical consistency, challenges remain in scalability, robustness to noise, and control of model complexity. This paper proposes a Physics-Encoded Modular Hybrid Layer (PE-MHL) framework, in which a baseline physics-based model is incrementally refined through the addition of new sub-models, where each new component adds complexity while preserving what previous components have already learned. We establish a theoretical guarantee for this construction: with a least-squares initialization of each new sub-model, the training error is monotonically non-increasing in the number of sub-models and provably converges. Empirical evaluations on a nonlinear NARX benchmark and the Quanser Aero 2 platform demonstrate that PE-MHL matches or outperforms its fully connected monolithic relaxation (over five times more parameters) in accuracy and generalization, while also providing more stable training dynamics and better preservation of underlying data structures.

Machine Learning (cs.LG); Optimization and Control (math.OC)

arXiv:2606.04290 [cs.LG]

(or arXiv:2606.04290v2 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2606.04290 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.