aiqbench analysis
This research introduces SciKGExtract, an agentic framework that significantly improves the extraction of experimental knowledge from heterogeneous materials science literature by combining LLMs with chemical normalization. The study demonstrates how agent-based refinement can boost extraction accuracy for complex processes like atomic-layer-deposition, addressing critical challenges in converting unstructured scientific text into machine-actionable data.
Agentic schema-guided extraction of materials process knowledge from scientific literature
arXiv:2610.06322v1 Announce Type: cross Abstract: Materials literature contains detailed experimental knowledge, but procedures, chemical entities and measurements remain difficult to aggregate because they are reported in heterogeneous forms and depend on process-specific context. We present SciKGExtract, a schema-guided framework that combines large-language-model extraction with chemical normalization and agent-based evaluation and refinement before knowledge-graph integration. We evaluate the framework on 176 atomic-layer-deposition papers describing zinc oxide (ZnO) and indium--gallium--zinc oxide (IGZO), together with an expert-annotated full-schema subset. PubChem normalization improves exact-match extraction F1 for every tested model. For ZnO, the best F1 increases from 0.591 for direct normalized extraction to 0.805 with agentic refinement, whereas the best IGZO result is 0.344, revealing the greater difficulty of multicomponent supercycle processes. Evaluation against a deeply nested schema containing 65 experimental properties and 155 quantitative measurement nodes further exposes errors in process segmentation and numerical assignment. These results show that chemical canonicalization and targeted agentic verification provide complementary controls for converting complex materials literature into reusable, machine-actionable experimental knowledge.
Abstract:Materials literature contains detailed experimental knowledge, but procedures, chemical entities and measurements remain difficult to aggregate because they are reported in heterogeneous forms and depend on process-specific context. We present SciKGExtract, a schema-guided framework that combines large-language-model extraction with chemical normalization and agent-based evaluation and refinement before knowledge-graph integration. We evaluate the framework on 176 atomic-layer-deposition papers describing zinc oxide (ZnO) and indium--gallium--zinc oxide (IGZO), together with an expert-annotated full-schema subset. PubChem normalization improves exact-match extraction F1 for every tested model. For ZnO, the best F1 increases from 0.591 for direct normalized extraction to 0.805 with agentic refinement, whereas the best IGZO result is 0.344, revealing the greater difficulty of multicomponent supercycle processes. Evaluation against a deeply nested schema containing 65 experimental properties and 155 quantitative measurement nodes further exposes errors in process segmentation and numerical assignment. These results show that chemical canonicalization and targeted agentic verification provide complementary controls for converting complex materials literature into reusable, machine-actionable experimental knowledge.
Computation and Language (cs.CL); Materials Science (cond-mat.mtrl-sci); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL); Emerging Technologies (cs.ET)
arXiv:2610.06322 [cs.CL]
(or arXiv:2610.06322v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2610.06322 arXiv-issued DOI via DataCite (pending registration)
Full text under the publisher's open licence · 191 words
Related coverage

Scaling UX testing with Amazon Nova Act: A new approach to user flow analysis
AWS · Jul 14, 2026

Operationalizing Genie Ontology in Your Data Stack
Databricks · Sep 1, 2026

Agentic AI in Cybersecurity
Neo4j · Sep 16, 2026

Building Reliable Data Analytics Agents: Lessons from the KDD Cup
NVIDIA · Oct 8, 2026