aiqbench analysis
This research addresses the reliability challenge of executing complex, multi-step queries across disparate applications by converting natural language inputs into structured execution graphs. By leveraging a deterministic planner with depth-first search, the system overcomes the inherent unreliability of standard LLM tool use for cross-tool workflows while maintaining high accuracy even on smaller, locally hosted models.
QueryGraph: Reliable Multi-Tool Query Execution Planning via LLM-Based Graph Generation
arXiv:2606.08300v2 Announce Type: replace Abstract: Many real-world queries over personal data span multiple applications and require structured planning, as individual tools expose only partial information. While LLMs show strong reasoning and tool use, reliably executing multi-step, cross-tool queries remains challenging. We introduce a system that converts natural language queries into structured graphs and executes them via a deterministic planner. Our approach uses depth-first search to resolve dependencies and combine results across tools, improving reliability and enabling queries beyond traditional keyword-based search. We demonstrate high accuracy even with smaller or locally hosted LLMs.
Abstract:Many real-world queries over personal data span multiple applications and require structured planning, as individual tools expose only partial information. While LLMs show strong reasoning and tool use, reliably executing multi-step, cross-tool queries remains challenging. We introduce a system that converts natural language queries into structured graphs and executes them via a deterministic planner. Our approach uses depth-first search to resolve dependencies and combine results across tools, improving reliability and enabling queries beyond traditional keyword-based search. We demonstrate high accuracy even with smaller or locally hosted LLMs.
Machine Learning (cs.LG)
arXiv:2606.08300 [cs.LG]
(or arXiv:2606.08300v2 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2606.08300 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 179 words
Related coverage

Presentation: Platform Teams Enabling AI - MCP/Multi-Agentic Tools across Linkedin
InfoQ · Jun 5, 2026
QueryWeaver: Reliable Multi-Tool Query Execution Planning via LLM-Based Graph Generation
arXiv · Jun 9, 2026

Vertical Advantage: Transforming Industries with Lakebase and Agentic AI
Databricks · Aug 27, 2026

A Candid Abacus AI Review: The All-in-One AI Platform for Professionals & Enterprises
KDnuggets · Sep 10, 2026