Skip to content
aiqbench takeMachine Learning

aiqbench analysis

This research presents a specialized hybrid RAG system combining dense semantic retrieval with geospatial filtering to answer questions about Tatarstan toponyms, demonstrating high accuracy on multilingual datasets. The work highlights practical advancements in applying transformer models and vector search techniques specifically for localized geographic data rather than general-purpose AI capabilities. It serves as an important case study for the intersection of NLP research and domain-specific geospatial applications within computational linguistics.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Tatarstan Toponyms: A Bilingual Dataset and Hybrid RAG System for Geospatial Question Answering

arXiv2 min read

arXiv:2605.05962v2 Announce Type: replace Abstract: This paper addresses end-to-end geospatial question answering over multilingual toponymic data. We introduce a bilingual (Russian-Tatar) dataset of 9,688 toponyms with linguistic, etymological, and coordinate information (93.1 percent georeferenced). Based on this, we construct about 39,000 question-context-answer triples with guaranteed answer localization. Our architecture combines a hybrid retriever (dense semantic indexing with multilingual-e5-large plus geospatial filtering/ranking using KD-trees and haversine distance) and an extractive reader fine-tuned on transformer models. On 500 test queries, hybrid search achieves Recall@1 = 0.988, Recall@5 = 1.000, MRR = 0.994, significantly outperforming BM25 and spatial-only methods. Among readers (RuBERT, XLM-RoBERTa-large, T5-RUS), XLM-RoBERTa-large gives best results: EM = 0.992, F1 = 0.994. RuBERT models fail on coordinate questions due to tokenization artifacts, but simple post-processing recovers 100 percent accuracy. Resources (dataset, QA corpus, models, web demo) are openly released on Hugging Face. Results are directly applicable to geospatial QA services, geocoding, and digital humanities projects.

Abstract:This paper addresses end-to-end geospatial question answering over multilingual toponymic data. We introduce a bilingual (Russian-Tatar) dataset of 9,688 toponyms with linguistic, etymological, and coordinate information (93.1 percent georeferenced). Based on this, we construct about 39,000 question-context-answer triples with guaranteed answer localization. Our architecture combines a hybrid retriever (dense semantic indexing with multilingual-e5-large plus geospatial filtering/ranking using KD-trees and haversine distance) and an extractive reader fine-tuned on transformer models. On 500 test queries, hybrid search achieves Recall@1 = 0.988, Recall@5 = 1.000, MRR = 0.994, significantly outperforming BM25 and spatial-only methods. Among readers (RuBERT, XLM-RoBERTa-large, T5-RUS), XLM-RoBERTa-large gives best results: EM = 0.992, F1 = 0.994. RuBERT models fail on coordinate questions due to tokenization artifacts, but simple post-processing recovers 100 percent accuracy. Resources (dataset, QA corpus, models, web demo) are openly released on Hugging Face. Results are directly applicable to geospatial QA services, geocoding, and digital humanities projects.

Preprint. 23 pages, 6 figures, 7 tables. Published in Computational Linguistics in Bulgaria

Computation and Language (cs.CL)

arXiv:2605.05962 [cs.CL]

(or arXiv:2605.05962v2 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2605.05962 Focus to learn more arXiv-issued DOI via DataCite

0.47810/JCLIB.2.2026.03 Focus to learn more DOI(s) linking to related resources

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 265 words

Related coverage