aiqbench analysis
This research introduces a physics-guided deep learning framework that enhances the interpretability and stability of coastal wave monitoring using only raw video inputs. By integrating physical constraints into spatiotemporal architectures like Transformers, the model effectively prevents physically meaningless predictions in data-scarce environments. The study validates this approach as a viable strategy for long-term oceanographic observation without requiring intermediate sensor processing.
Physics-Guided Spatiotemporal Learning for Coastal Wave Peak Period Estimation from Video
arXiv:2606.13302v2 Announce Type: replace Abstract: Direct estimation of physically interpretable periodic signals from raw video constitutes a spatiotemporally grounded learning problem that proves to be difficult especially when facing label sparsity, lack of physical grounding and standardization benchmarks. The wave monitoring at coastal sites is one such real-world example where current deep learning approaches for estimating wave parameters using video as input suffer from physical interpretability and require some kind of intermediate data processing. In this study we propose a framework for wave peak period estimation using only video as input through three components: automated region-of-interest detection using temporal pixel variance, multi-stage Sim-to-Real transfer learning process, and physics-guided regularization of the output predictions. Various spatiotemporal architectures, including Transformer and recurrent-convolutional were compared during the stages of synthetic pretraining, silver label adaptation, and expert fine-tuning. It has been found out that LtViViT achieves the highest accuracy in its estimates, while TinyWaveNet shows superior temporal stability and oceanographic skill. Additionally, ablation studies have demonstrated that physics-guided regularization helps to follow the trends in predictions more consistently and prevent physically meaningless predictions. Moreover, Grad-CAM-based explainability analysis of the physics-guided TinyWaveNet showed that its spatial focus aligns with hydrodynamically active surf-zone regions. Overall, the findings support physics-guided, video-based deep learning as a cost-effective and operationally viable approach for long-term coastal wave monitoring, and demonstrate a transferable strategy for physically-constrained spatiotemporal regression from video under data-scarce conditions.
Abstract:Direct estimation of physically interpretable periodic signals from raw video constitutes a spatiotemporally grounded learning problem that proves to be difficult especially when facing label sparsity, lack of physical grounding and standardization benchmarks. The wave monitoring at coastal sites is one such real-world example where current deep learning approaches for estimating wave parameters using video as input suffer from physical interpretability and require some kind of intermediate data processing. In this study we propose a framework for wave peak period estimation using only video as input through three components: automated region-of-interest detection using temporal pixel variance, multi-stage Sim-to-Real transfer learning process, and physics-guided regularization of the output predictions. Various spatiotemporal architectures, including Transformer and recurrent-convolutional were compared during the stages of synthetic pretraining, silver label adaptation, and expert fine-tuning. It has been found out that LtViViT achieves the highest accuracy in its estimates, while TinyWaveNet shows superior temporal stability and oceanographic skill. Additionally, ablation studies have demonstrated that physics-guided regularization helps to follow the trends in predictions more consistently and prevent physically meaningless predictions. Moreover, Grad-CAM-based explainability analysis of the physics-guided TinyWaveNet showed that its spatial focus aligns with hydrodynamically active surf-zone regions. Overall, the findings support physics-guided, video-based deep learning as a cost-effective and operationally viable approach for long-term coastal wave monitoring, and demonstrate a transferable strategy for physically-constrained spatiotemporal regression from video under data-scarce conditions.
Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
arXiv:2606.13302 [cs.AI]
(or arXiv:2606.13302v2 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2606.13302 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 322 words
Related coverage
Physics-Guided Spatiotemporal Learning for Coastal Wave Peak Period Estimation from Video
arXiv · Jun 12, 2026
Synthesis Superintelligence: from Semiconductors to Superconductors — Periodic Labs’ Liam Fedus and Ekin Dogus Cubuk
Latent Space · Oct 8, 2026
BridgeCast: Bridging Ocean Wave Forecasts to Reanalysis via Flow Matching with Exogenous Variables
arXiv · Oct 7, 2026
Import AI 474: Platonic mindspace; TPUs in space; Zhipu starts an outer RSI loop
Import AI · Sep 28, 2026