aiqbench analysis
This paper details an automated pipeline using LLMs to construct and maintain a knowledge graph specifically for Machine Learning Interatomic Potentials (MLIP) in materials science. By integrating SHACL constraints for validation, the method ensures consistent representation across evolving models, facilitating iterative updates from sources like the Matbench Discovery leaderboard. This work advances the infrastructure for managing semantic data within high-performance computing domains where AI is central to model discovery.
Automatically Building and Updating a Knowledge Graph of MLIP Models
arXiv:2610.09644v1 Announce Type: new Abstract: Complementing the many efforts in providing semantic representations of concepts, notions, and entities in materials science, we report and illustrate a process by which we can automatically build a knowledge graph of the fast evolving field of machine learning applied to the prediction of material properties, focusing on MLIP (Machine Learning Interatomic Potential). This LLM-based process relies on multiple steps, from information extraction in documents and articles to a validation loop using SHACL constraints to detect and correct errors. It is carried out on a model-by-model basis, focusing on the consistency of representation, therefore enabling an iterative construction where the addition of new models is facilitated. We illustrate the process by showing a few interesting aspects that can be queried from a knowledge graph built from the models listed in the Matbench Discovery leaderboard.
Abstract:Complementing the many efforts in providing semantic representations of concepts, notions, and entities in materials science, we report and illustrate a process by which we can automatically build a knowledge graph of the fast evolving field of machine learning applied to the prediction of material properties, focusing on MLIP (Machine Learning Interatomic Potential). This LLM-based process relies on multiple steps, from information extraction in documents and articles to a validation loop using SHACL constraints to detect and correct errors. It is carried out on a model-by-model basis, focusing on the consistency of representation, therefore enabling an iterative construction where the addition of new models is facilitated. We illustrate the process by showing a few interesting aspects that can be queried from a knowledge graph built from the models listed in the Matbench Discovery leaderboard.
Artificial Intelligence (cs.AI)
arXiv:2610.09644 [cs.AI]
(or arXiv:2610.09644v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2610.09644 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 228 words
Related coverage

An Organizational Second Brain: Building an AI That Learns From Experts
Meta Engineering · Sep 2, 2026

The SaaSpocalypse that wasn’t, with Atlassian CEO Mike Cannon-Brookes
The Verge · Sep 28, 2026
GitLab 19.2 release notes
GitLab · Jul 16, 2026

AWS vector solutions: Build agentic AI where your data lives
AWS · Aug 20, 2026