aiqbench analysis
This paper addresses the reliability of visual place recognition systems under cross-condition shifts by replacing standard similarity metrics with frozen DINOv2 features and implementing empirical false-discovery rate control. The proposed SAFEVPR pipeline successfully maintains target FDR across diverse ground-vehicle datasets without requiring retraining, offering a robust solution for robot relocalization where traditional conformal calibration guarantees fail due to distribution changes.
SAFEVPR: Patch-Based Verification with Empirical FDR Control for Cross-Condition Sequence Visual Place Recognition
arXiv:2605.28048v2 Announce Type: replace Abstract: Sequence-based visual place recognition (VPR) for loop closure and robot relocalization must decide whether the retrieved top-1 candidate should be accepted. Conformal calibration can set this accept/reject threshold, but its finite-sample guarantees require exchangeability between calibration and deployment, a requirement that cross-condition deployment violates. We therefore claim no formal guarantee under condition shift: this paper instead asks which verification score and calibration design keep a target false-discovery rate (FDR) empirically satisfied across realistic appearance change. We present SAFEVPR, a non-trainable pipeline that replaces the backbone cosine similarity with a mutual-nearest-neighbour (MNN) patch score from frozen DINOv2 features, and flat Learn-Then-Test (LTT) calibration with per-bin Clopper-Pearson thresholds. Across 23 cross-condition ground-vehicle setups (Oxford RobotCar, NCLT, St Lucia; three frozen backbones), SAFEVPR meets the FDR target on 23/23 setups at alpha = 0.10 (mean accepted FDR 0.014, mean TPR 0.75) and on 22/23 at alpha = 0.05 with 22 retaining non-trivial coverage (best cosine variant, cosine+LTT: 22/23 valid but 17 non-trivial); under leave-one-dataset-out calibration, validity drops to 20/23 with 14 retaining useful coverage (strongest cosine baseline: 16/23 and 10), and on texture-poor scenery (Nordland) the verifier is uninformative and the system abstains entirely, as it does everywhere at alpha = 0.01; we report these as limitations. In a pose-graph relocalization study, gating loop-closure constraints reduces erroneous constraints by 29.6x and cuts the median trajectory error from 95.5 m to 9.7 m. Code is available at https://github.com/TIERS/SafeVPR.
Abstract:Sequence-based visual place recognition (VPR) for loop closure and robot relocalization must decide whether the retrieved top-1 candidate should be accepted. Conformal calibration can set this accept/reject threshold, but its finite-sample guarantees require exchangeability between calibration and deployment, a requirement that cross-condition deployment violates. We therefore claim no formal guarantee under condition shift: this paper instead asks which verification score and calibration design keep a target false-discovery rate (FDR) empirically satisfied across realistic appearance change. We present SAFEVPR, a non-trainable pipeline that replaces the backbone cosine similarity with a mutual-nearest-neighbour (MNN) patch score from frozen DINOv2 features, and flat Learn-Then-Test (LTT) calibration with per-bin Clopper-Pearson thresholds. Across 23 cross-condition ground-vehicle setups (Oxford RobotCar, NCLT, St Lucia; three frozen backbones), SAFEVPR meets the FDR target on 23/23 setups at alpha = 0.10 (mean accepted FDR 0.014, mean TPR 0.75) and on 22/23 at alpha = 0.05 with 22 retaining non-trivial coverage (best cosine variant, cosine+LTT: 22/23 valid but 17 non-trivial); under leave-one-dataset-out calibration, validity drops to 20/23 with 14 retaining useful coverage (strongest cosine baseline: 16/23 and 10), and on texture-poor scenery (Nordland) the verifier is uninformative and the system abstains entirely, as it does everywhere at alpha = 0.01; we report these as limitations. In a pose-graph relocalization study, gating loop-closure constraints reduces erroneous constraints by 29.6x and cuts the median trajectory error from 95.5 m to 9.7 m. Code is available at this https URL.
Robotics (cs.RO)
arXiv:2605.28048 [cs.RO]
(or arXiv:2605.28048v2 [cs.RO] for this version)
https://doi.org/10.48550/arXiv.2605.28048 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 327 words