Models Got Talent: Identifying High Performing Wearable Human Activity Recognition Models Without Training

Abstract:Discovering high performing model architectures for wearables-based Human Activity Recognition (HAR) applications is challenging. The astonishing diversity and variability due to differing sensor locations, recording apparatus, activities, etc., can cause established architectures to perform worse on datasets/tasks they were not designed for. A promising complement to Neural Architecture Search (NAS) involves the development of Zero Cost Proxies (ZCPs), which correlate well with trained performance, but can be computed through a single forward/backward pass on a randomly sampled batch of data. In this paper, we investigate the effectiveness of eight ZCPs on six benchmark HAR datasets, and demonstrate that the top-predicted architectures obtain performance within 7% of that attained by full-scale training of 2,000 randomly sampled architectures. Furthermore, training the top-10 predicted architectures results in performance within 2% of full-scale training, leading to substantial computational savings. Our experiments introduce ZCPs to sensor-based HAR and demonstrate their suitability as an addition to NAS pipelines in practical scenarios.

Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

arXiv:2511.06157 [cs.LG]

(or arXiv:2511.06157v3 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2511.06157 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.