Skip to content
aiqbench takeAI Research

aiqbench analysis

CODENS addresses the persistent challenge of scattered design knowledge in fast-moving codebases by automatically constructing typed software knowledge graphs from pull requests. This system enables agent-guided graph traversal for repository-level question answering, effectively turning incremental code changes into living documentation without requiring manual updates. While evaluation on a production Ruby on Rails project demonstrates high relevance and grounded answers, the approach highlights ongoing difficulties in synthesizing concise summaries directly from complex change histories.
Sources coveringarXiv, AI Alignment Forum, Databricks, AWS
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

CODENS: Transforming Code Changes into Living, Accessible, and Queryable Documentation

arXiv2 min read

arXiv:2607.18356v1 Announce Type: cross Abstract: Maintaining up-to-date code documentation is difficult in fast-moving repositories because design knowledge is scattered across source files and pull requests. We present CODENS , a system that turns pull requests into living, accessible, and queryable documentation for production codebases. CODENS incrementally builds a typed software knowledge graph from pull requests, enriches components through schema-driven semantic extraction, derives typed relations between them, and exposes the resulting knowledge through three retrieval modes, including agent-guided graph traversal for repository-level question answering. The system also preserves semantic change history across pull requests and integrates both answer-quality and operational evaluation metrics. We evaluate CODENS on a client Ruby on Rails project in production. Results show that CODENS produces highly relevant and well-grounded answers, while qualitative feedback highlights a remaining challenge in concise, documentation-oriented synthesis.

Abstract:Maintaining up-to-date code documentation is difficult in fast-moving repositories because design knowledge is scattered across source files and pull requests. We present CODENS , a system that turns pull requests into living, accessible, and queryable documentation for production codebases. CODENS incrementally builds a typed software knowledge graph from pull requests, enriches components through schema-driven semantic extraction, derives typed relations between them, and exposes the resulting knowledge through three retrieval modes, including agent-guided graph traversal for repository-level question answering. The system also preserves semantic change history across pull requests and integrates both answer-quality and operational evaluation metrics. We evaluate CODENS on a client Ruby on Rails project in production. Results show that CODENS produces highly relevant and well-grounded answers, while qualitative feedback highlights a remaining challenge in concise, documentation-oriented synthesis.

Accepted at the 26th ACM Symposium on Document Engineering (DocEng 2026). DOI: https://doi.org/10.1145/3820755.3832807

Software Engineering (cs.SE); Artificial Intelligence (cs.AI)

arXiv:2607.18356 [cs.SE]

(or arXiv:2607.18356v1 [cs.SE] for this version)

https://doi.org/10.48550/arXiv.2607.18356 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

https://doi.org/10.1145/3820755.3832807 Focus to learn more DOI(s) linking to related resources

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 249 words

Related coverage