aiqbench analysis
This paper critically audits the claimed benefits of exercise-specific joint selection in skeleton-based action recognition, revealing that gains often vanish under rigorous within-person controls and random baseline comparisons. The study emphasizes that establishing causal efficacy for such architectural choices requires explicit estimands and structurally appropriate experimental designs rather than relying on pooled metrics alone. It serves as a necessary caution against overstating algorithmic improvements without robust validation in machine learning research.
When Does Exercise-Specific Joint Selection Help? An Audit of Evaluation and Control Design
arXiv:2610.01188v1 Announce Type: new Abstract: Exercise-specific joint selection can improve skeleton-based correctness classification, but what does that gain establish? We audit 1,057 repetitions from ten REHAB24-6 subjects, separating evaluation aggregation, subset structure, and temporal representation. The manual-subset kNN gain changes from 0.055 for pooled out-of-fold AUROC to 0.020 for equal-weight within-person AUROC; both paired intervals include zero. Among 1,000 dimension-matched random maps, 14 match or exceed the manual pooled result, versus 145 when bilateral structure and trunk inclusion are also matched. RBF-SVM retains a positive within-person gain, whereas logistic regression and a random-convolution comparator have negative point gains under that estimand. Sequence-order and paired-seed controls further qualify the interpretation. This exploratory audit shows why joint-selection claims require explicit estimands and structurally appropriate controls; it does not establish a new algorithm or clinical benefit.
Title:When Does Exercise-Specific Joint Selection Help? An Audit of Evaluation and Control Design
Abstract:Exercise-specific joint selection can improve skeleton-based correctness classification, but what does that gain establish? We audit 1,057 repetitions from ten REHAB24-6 subjects, separating evaluation aggregation, subset structure, and temporal representation. The manual-subset kNN gain changes from 0.055 for pooled out-of-fold AUROC to 0.020 for equal-weight within-person AUROC; both paired intervals include zero. Among 1,000 dimension-matched random maps, 14 match or exceed the manual pooled result, versus 145 when bilateral structure and trunk inclusion are also matched. RBF-SVM retains a positive within-person gain, whereas logistic regression and a random-convolution comparator have negative point gains under that estimand. Sequence-order and paired-seed controls further qualify the interpretation. This exploratory audit shows why joint-selection claims require explicit estimands and structurally appropriate controls; it does not establish a new algorithm or clinical benefit.
Artificial Intelligence (cs.AI)
arXiv:2610.01188 [cs.AI]
(or arXiv:2610.01188v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2610.01188 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 235 words
Related coverage
A Red Line and Oversight Framework for Government AI Contracts
AI Alignment Forum · Jul 18, 2026
News Archive 2026
Quantum Computing Report · Jul 25, 2026
Links #3: 2026/06 Part 1
LessWrong · Jun 15, 2026

Building trust in AI agents: A production-ready evaluation framework with Amazon Bedrock AgentCore
AWS · Oct 16, 2026