aiqbench analysis
SkillTrace advances the field of autonomous agents by introducing a graph-based framework that effectively composes reusable skills to solve complex tasks, outperforming previous methods on standard benchmarks like SkillsBench and ALFWorld. This research demonstrates that modeling compositional relations, query similarities, and skill dependencies within a semantic hierarchy significantly improves agent reliability across different backbone models.
SkillTrace: Traversing a Query-Skill Graph for Composable LLM Agents
arXiv:2608.02356v1 Announce Type: new Abstract: Large language model agents increasingly solve complex tasks by composing reusable skills from a library. To address this, the key challenge is not merely to retrieve individually relevant skills, but to identify a complete and executable skill composition. In this paper, we argue that this problem can be solved in a graph with three levels: compositional relations among skill queries, similarity between queries and candidates in the skill library, and the dependencies among the selected candidates. We introduce SkillTrace, which organizes the user query into a semantic hierarchy, matches skill queries and candidates, and propagates over the skill dependencies. Experiments on SkillsBench and ALFWorld demonstrate that SkillTrace achieves state-of-the-art performance, reaching a success rate of 53.17% on SkillsBench and 91.43% on ALFWorld. SkillTrace also delivers consistent improvements across different backbone language models, demonstrating the generality and robustness of graph-based skill retrieval.
Abstract:Large language model agents increasingly solve complex tasks by composing reusable skills from a library. To address this, the key challenge is not merely to retrieve individually relevant skills, but to identify a complete and executable skill composition. In this paper, we argue that this problem can be solved in a graph with three levels: compositional relations among skill queries, similarity between queries and candidates in the skill library, and the dependencies among the selected candidates. We introduce SkillTrace, which organizes the user query into a semantic hierarchy, matches skill queries and candidates, and propagates over the skill dependencies. Experiments on SkillsBench and ALFWorld demonstrate that SkillTrace achieves state-of-the-art performance, reaching a success rate of 53.17% on SkillsBench and 91.43% on ALFWorld. SkillTrace also delivers consistent improvements across different backbone language models, demonstrating the generality and robustness of graph-based skill retrieval.
Artificial Intelligence (cs.AI)
arXiv:2608.02356 [cs.AI]
(or arXiv:2608.02356v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2608.02356 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 235 words
Related coverage

Scaling Karpathy’s LLM wiki: Why your knowledge base needs a graph
Neo4j · Aug 31, 2026
CTIFoundry: An Agent-Native Corpus Scaffold for Cyber Threat Intelligence
arXiv · Aug 21, 2026

Presentation: From Retrieval to Reasoning: Building Production-Ready Agentic AI Systems with Knowledge Graphs
InfoQ · Sep 12, 2026
SEGRA: Structured Experience-Guided Graph Reasoning Agent for Gremlin Based Question Answering
arXiv · Jul 28, 2026