Knowledge-Guided Vision-Language Inference for Image-Based Urban Flood Depth Estimation

Abstract:Timely floodwater depth estimates support road accessibility assessment and emergency response during urban flooding. Supervised vision methods often require extensive labeled datasets, while recent foundation vision-language models (VLMs) offer flexible visual reasoning but can inconsistently yield large errors in metric depth estimation. This paper proposes FloodVision, a knowledge-guided framework for estimating flood depth from a single RGB image. FloodVision integrates a general-purpose VLM with FloodKG, a domain knowledge base encoding canonical object dimensions and component landmarks (e.g., wheel arch, curb top) to encourage reasoning at the component level rather than treating objects as wholes. This injects explicit geometric grounding without task-specific training. Evaluated on 654 crowdsourced MyCoast New York flood images with resident-reported depths as proxy labels, FloodVision reduces the mean absolute error from 15.62 cm to 8.75 cm and the median error from 14.35 cm to 7.75 cm, with lower error than the VLM-only baseline in 69.3% of cases. The paper also discusses current limitations and future integration into urban digital twin systems.

8 pages, 2 figures. Accepted for oral presentation at the 2026 International Conference on Computing in Civil Engineering (i3CE 2026)

Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

arXiv:2509.04772 [cs.CV]

(or arXiv:2509.04772v2 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2509.04772 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.