Skip to content
aiqbench takeAI Research

aiqbench analysis

This research introduces GRISP, a method leveraging fine-tuned small language models (SLMs) to generate SPARQL query skeletons and resolve placeholders via backtracking search over knowledge graphs like Wikidata. The approach demonstrates improved performance on standard benchmarks compared to other fine-tuning-based techniques for question-answering tasks involving structured data retrieval.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

GRISP: Guided Recurrent IRI Selection over SPARQL Skeletons

arXiv2 min read

arXiv:2604.21133v2 Announce Type: replace Abstract: We present GRISP (Guided Recurrent IRI Selection over SPARQL Skeletons), a novel SPARQL-based question-answering method over knowledge graphs using a fine-tuned small language model (SLM). Given a natural-language question, the method uses the SLM to generate a natural-language SPARQL query skeleton, and then resolves the natural-language placeholders using a backtracking search that retrieves and re-ranks knowledge graph items under knowledge graph constraints. The SLM is jointly trained on skeleton generation and re-ranking data generated from question-query pairs. We evaluate the method on common Wikidata and Freebase benchmarks, and achieve better results than other state-of-the-art fine-tuning-based methods.

Abstract:We present GRISP (Guided Recurrent IRI Selection over SPARQL Skeletons), a novel SPARQL-based question-answering method over knowledge graphs using a fine-tuned small language model (SLM). Given a natural-language question, the method uses the SLM to generate a natural-language SPARQL query skeleton, and then resolves the natural-language placeholders using a backtracking search that retrieves and re-ranks knowledge graph items under knowledge graph constraints. The SLM is jointly trained on skeleton generation and re-ranking data generated from question-query pairs. We evaluate the method on common Wikidata and Freebase benchmarks, and achieve better results than other state-of-the-art fine-tuning-based methods.

Computation and Language (cs.CL)

arXiv:2604.21133 [cs.CL]

(or arXiv:2604.21133v2 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2604.21133 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 189 words

Related coverage