analiza aiqbench
Composing insight from the full article — this may take a moment.
pico-WAM: Evaluating Counterfactual Prediction and Planning Error in a Compact World Action Model
arXiv:2611.01039v1 Announce Type: cross Abstract: When a World Action Model fails at control, is the bottleneck proposal generation or trajectory scoring? We introduce pico-WAM, a compact model with supplied physical state for tracing policy-dynamics interactions. Using 206 Push-T demonstrations and 15 training seeds, we compare data regimes and search configurations. Counterfactual branch training improves short-horizon cost ranking and enlarges the coverage advantage of policy-restarted over warm-started search by 4.8 percentage points; restart wins under both data regimes. Replacing learned trajectory scores with simulator costs improves coverage by 12.2 points while retaining learned proposals. Substituting simulator states in proposal generation alone shows no detected gain. Component diagnostics and a separate door-opening study show why better ranking need not yield better control or outperform imitation. These controlled interventions identify scoring as an effective improvement target in the tested setting and provide a reproducible protocol for diagnosing compact world models.
Citește articolul complet pe arXivSubiecte conexe
CounterFace: A Synthetic Face Dataset for Fine-Grained Counterfactual Evaluation of Face Recognition Systems
arXiv · 5 iun. 2026
Selective Amortization of Full-Budget Counterfactual Reasoning for Visual Token Communication
arXiv · 28 sept. 2026
Robust to Which Model Change? A Unified Evaluation of Robust Counterfactual Explanations
arXiv · 28 sept. 2026
RESCUE: Is This Alarm Worth Acting On? Counterfactual Evaluation of VLA Runtime Monitors
arXiv · 12 oct. 2026