aiqbench analysis
Graphectory Viewer offers researchers a critical open-source utility for dissecting the internal reasoning processes of agentic systems, moving beyond simple success/failure metrics to visualize phase transitions and behavioral patterns across diverse frameworks. By enabling deep inspection of thoughts, actions, and observations at scale, this tool addresses an emerging bottleneck in AI development: understanding *how* agents solve problems rather than just whether they do so successfully. Its release alongside a large trajectory corpus significantly aids reproducibility efforts as the field shifts toward analyzing complex multi-step agent trajectories.
Graphectory Viewer: A Tool for Process-Centric Analysis of Agentic Software Trajectories
arXiv:2608.17195v1 Announce Type: cross Abstract: We present Graphectory Viewer, a web-based tool for interactive, process-centric analysis of software-agent trajectories. Building on the Graphectory representation introduced in our previous work, Graphectory Viewer transforms heterogeneous raw trajectories into phase-aware graphs that connect low-level execution details with higher-level behavioral structures. The tool supports trajectories from multiple agent frameworks and provides interactive graph construction; node-level inspection of thoughts, actions, and observations; search and filtering over large trajectory collections; and Sankey-style summaries of problem-solving phase transitions. These capabilities enable researchers and practitioners to inspect individual executions, identify recurring behavioral patterns, compare successful and failed runs, and analyze large trajectory corpora beyond final task outcomes. To support reproducibility and further research, we release Graphectory Viewer as an open-source artifact together with documentation, precomputed graphs, and the large-scale trajectory corpus.
Abstract:We present Graphectory Viewer, a web-based tool for interactive, process-centric analysis of software-agent trajectories. Building on the Graphectory representation introduced in our previous work, Graphectory Viewer transforms heterogeneous raw trajectories into phase-aware graphs that connect low-level execution details with higher-level behavioral structures. The tool supports trajectories from multiple agent frameworks and provides interactive graph construction; node-level inspection of thoughts, actions, and observations; search and filtering over large trajectory collections; and Sankey-style summaries of problem-solving phase transitions. These capabilities enable researchers and practitioners to inspect individual executions, identify recurring behavioral patterns, compare successful and failed runs, and analyze large trajectory corpora beyond final task outcomes. To support reproducibility and further research, we release Graphectory Viewer as an open-source artifact together with documentation, precomputed graphs, and the large-scale trajectory corpus.
Software Engineering (cs.SE); Artificial Intelligence (cs.AI)
arXiv:2608.17195 [cs.SE]
(or arXiv:2608.17195v1 [cs.SE] for this version)
https://doi.org/10.48550/arXiv.2608.17195 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 225 words
