analiza aiqbench
This study critically assesses the reliability of synthetic corruption methods in monocular SLAM, revealing that learned trackers often trade catastrophic failure for sustained drift under imperfect simulation proxies. The findings highlight a crucial gap between controlled stress tests and real-world deployment conditions, where physical fidelity significantly alters system performance rankings. For engineers developing robust visual navigation systems, this underscores the necessity of validating synthetic benchmarks against high-fidelity adverse weather data before relying on them for safety-critical decisions.
Failure or Drift? Evaluating Monocular SLAM under Synthetic and Real-World Corruptions
arXiv:2608.30690v1 Announce Type: cross Abstract: Visual SLAM is commonly evaluated on clean trajectories, although deployment failures are often caused by adverse weather, illumination, blur, and sensor artifacts. Controlled corruptions are attractive because they isolate such factors, but a synthetic stress test is useful only when it leads to the same engineering conclusion as the condition it is intended to approximate. This work examines that question for monocular SLAM. We evaluate a classical feature-based system and two learned trackers under image-space, geometry-aware, and compound corruptions, and compare their behavior with adverse conditions from 4Seasons. Rather than reducing robustness to a single trajectory error, the evaluation separates explicit tracking failure from drift accumulated by methods that remain active. The results show that learned trackers largely replace catastrophic loss with sustained, and sometimes severe, drift. More importantly, the apparent ordering of the learned systems changes with the physical fidelity of the corruption: structured rain and fog proxies preserve the real-world ordering, whereas a simple illumination proxy does not. Code is available at: https://github.com/abhaythomas/master_thesis_vslamlab_robustness.
Title:Failure or Drift? Evaluating Monocular SLAM under Synthetic and Real-World Corruptions
Abstract:Visual SLAM is commonly evaluated on clean trajectories, although deployment failures are often caused by adverse weather, illumination, blur, and sensor artifacts. Controlled corruptions are attractive because they isolate such factors, but a synthetic stress test is useful only when it leads to the same engineering conclusion as the condition it is intended to approximate. This work examines that question for monocular SLAM. We evaluate a classical feature-based system and two learned trackers under image-space, geometry-aware, and compound corruptions, and compare their behavior with adverse conditions from 4Seasons. Rather than reducing robustness to a single trajectory error, the evaluation separates explicit tracking failure from drift accumulated by methods that remain active. The results show that learned trackers largely replace catastrophic loss with sustained, and sometimes severe, drift. More importantly, the apparent ordering of the learned systems changes with the physical fidelity of the corruption: structured rain and fog proxies preserve the real-world ordering, whereas a simple illumination proxy does not. Code is available at: this https URL.
Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
arXiv:2608.30690 [cs.CV]
(or arXiv:2608.30690v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.30690 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 277 cuvinte
Subiecte conexe

Building trust in AI agents: A production-ready evaluation framework with Amazon Bedrock AgentCore
AWS · 16 oct. 2026

Echoverse: Deep, evolving environments for computer-use agents
Microsoft Research · 30 iul. 2026

Evaluating AI Agents: A production blueprint with Strands and AgentCore
AWS · 23 iul. 2026

Building a Golden Eval Dataset from Production Traffic
OpenRouter · 30 sept. 2026