aiqbench analysis
This study exposes a critical generalization gap in neural Graph Edit Distance (GED) models, revealing that high performance on training data often fails to transfer across structurally different graph collections. The research demonstrates that training on diverse source datasets significantly enhances zero-shot transfer capabilities and provides a more robust foundation for limited-supervision scenarios. These findings urge the community to move beyond standard within-dataset evaluations toward broader testing across heterogeneous collections to truly assess model utility.
Revisiting the Generalization of Neural Graph Edit Distance Models
arXiv:2610.04644v1 Announce Type: new Abstract: Neural approaches to Graph Edit Distance (GED) have achieved strong results under standard within-dataset evaluation, but much less is known about how well these models transfer across graph collections. We conduct a systematic study of this problem using exact GED supervision across diverse graph datasets and a broad set of representative learning-based methods. Our results reveal a pronounced gap between within-collection performance and cross-collection transfer. Models that perform well on their training collections often lose this advantage when evaluated on structurally different data. Training on multiple source collections substantially improves zero-shot transfer and provides a better starting point when limited supervision is available for a new target collection. Further analysis shows that transfer behavior varies with the source--target direction and the structural characteristics of the collections involved. These findings suggest that conventional within-collection evaluation provides only a partial view of the generalization behavior of neural GED models and motivate broader evaluation across heterogeneous graph collections.
Abstract:Neural approaches to Graph Edit Distance (GED) have achieved strong results under standard within-dataset evaluation, but much less is known about how well these models transfer across graph collections. We conduct a systematic study of this problem using exact GED supervision across diverse graph datasets and a broad set of representative learning-based methods. Our results reveal a pronounced gap between within-collection performance and cross-collection transfer. Models that perform well on their training collections often lose this advantage when evaluated on structurally different data. Training on multiple source collections substantially improves zero-shot transfer and provides a better starting point when limited supervision is available for a new target collection. Further analysis shows that transfer behavior varies with the source--target direction and the structural characteristics of the collections involved. These findings suggest that conventional within-collection evaluation provides only a partial view of the generalization behavior of neural GED models and motivate broader evaluation across heterogeneous graph collections.
Machine Learning (cs.LG)
arXiv:2610.04644 [cs.LG]
(or arXiv:2610.04644v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2610.04644 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 249 words
Related coverage
The J-Space Debate, Agent Swarms, and Pacing Frontier AI - Digital Minds Newsletter #4
LessWrong · Sep 18, 2026
Hyper-Dimensional Fingerprints as Molecular Representations
arXiv · Jun 9, 2026

Order Parameter Discovery for Quantum Many-Body Systems
Quantum Journal · Sep 29, 2026
[AINews] High Taste Testers Ep. 1
Latent Space · Oct 17, 2026