Introductory Notes on Learning$^2$

Abstract:Although machine learning can be used to predict the evolution of physical systems from data, a formulation that learns only the system state at each time leaves the temporal and dynamical structure of the solution to be resolved within a broad hypothesis space. We introduce Learning$^2$, a representation-level framework that structures this space by coupling a primary representation to a second representation through a known physical transformation. The resulting cross-representation constraint restricts the effective hypothesis space and provides an ante-hoc, physically interpretable criterion for excluding solutions that satisfy the primary representation alone. We instantiate Learning$^2$ through EuLaNet, an Eulerian--Lagrangian representation for fluid dynamics. Given the velocity state $u(\mathbf{x},t)$, EuLaNet constructs its induced Lagrangian flow map $X(\mathbf{a},t)$ through $\dot{X}(\mathbf{a},t)=u(X(\mathbf{a},t),t)$, from which material transport and finite-time deformation are derived. The resulting representation couples the predicted state to the dynamical consequences it induces, providing a second consistency criterion beyond state-level agreement. We formalize this construction through an effective hypothesis space $\mathcal{H}_{L^2}\subseteq\mathcal{H}$ and define the conditions under which a consequence representation provides discriminative constraints on candidate solutions. EuLaNet is implemented as a model-independent representation module, separating the physical constraint from the downstream learning architecture. This construction provides an ante-hoc mechanism for physically interpretable constraint in scientific learning and offers a basis for developing and evaluating broader classes of Learning$^2$ architectures. The implementation is open-sourced to support the development and extension of the architecture across scientific domains.

11 pages. Code and implementation: this https URL

Numerical Analysis (math.NA); Machine Learning (cs.LG)

arXiv:2609.06546 [math.NA]

(or arXiv:2609.06546v1 [math.NA] for this version)

https://doi.org/10.48550/arXiv.2609.06546 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.