How Does Research Evolve? Tracing Cross-Domain Trajectories in NLP, ML, and CV Through Claim-Grounded Typed Citations

Title:How Does Research Evolve? Tracing Cross-Domain Trajectories in NLP, ML, and CV Through Claim-Grounded Typed Citations

Abstract:How does research evolve, and can we trace it at the level of individual claims? Scientific progress is not simply a uniform accumulation of facts. Existing citation graphs usually collapse these roles into a single homogeneous edge type, limiting how we can analyze scientific progress. We introduce SciTraj, a typed citation corpus for tracing research evolution across natural language processing, machine learning, and computer vision. SciTraj includes 32,559 papers published between 2015 and 2024 and 573,126 directed edges spanning six research-relation types. Unlike traditional citation graphs, each edge is paired with the claim sentence that motivates its label. Claim-driven relations are verified by natural language inference against their local in-paper context. The corpus further organizes these relations into multi-step typed trajectories that trace how ideas develop across papers and over time. We evaluate the corpus along three dimensions. First, a three-annotator pilot achieves Fleiss' $\kappa=0.74$ and 79.9\% majority-vote precision for relation labels, indicating substantial agreement and reliable labeling. Second, corpus-level analyses reveal clear disciplinary siloing in the directional flow of research relations. Topic analysis further identifies rapidly growing clusters dominated by vision and LLM-related research and declining clusters associated with several classical machine-learning topics. We further evaluate SciTraj using a temporally split link-prediction benchmark and a year-shuffle falsifiability test that distinguishes genuine temporal signal from year-correlated content. Under this setting, \textsc{SciTraj-Pair} performs strongly, but its AUC drops by 0.288 when publication years are shuffled, showing that its predictions depend not only on content but also on the temporal order in which research develops.

Computation and Language (cs.CL)

arXiv:2606.22342 [cs.CL]

(or arXiv:2606.22342v2 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2606.22342 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.