aiqbench analysis
This research addresses a critical reliability issue in deployed LLM agents where tool interfaces evolve after launch, causing function-calling failures even when underlying logic remains unchanged. The authors propose SchemaShield-Lite, a lightweight, training-free repair layer that significantly restores accuracy by validating schemas and retrying candidate tools without introducing new harms. This work offers a practical solution for maintaining robustness in real-world agent systems facing inevitable interface updates.
Robust Function Calling for LLM Agents Under Interface Drift
arXiv:2610.23342v1 Announce Type: cross Abstract: Tool-augmented language-model agents rely on interface text: tool descriptions, argument schemas, and the candidate tool list shown at inference time. These interfaces often change after deployment even when the underlying tool semantics remain fixed, creating a practical reliability problem for function-calling systems. We study this failure mode as interface drift and evaluate whether a lightweight, training-free repair layer can recover robustness without retraining the base model. Our method, SchemaShield-Lite, combines schema validation, candidate-set retry for missing tool names, and one-shot constrained repair. On Qwen3.5-9B, it raises DICE-300 accuracy from 0.717 to 0.813 and BFCL-200 accuracy from 0.580 to 0.805, recovering 19/22 and 33/45 drift-induced failures with no observed repair harms. Naive retry does not explain the gains. Ablations show that candidate-set drift, especially distractor tools, accounts for most observed damage, while description and schema edits alone are less harmful. The results position validation-and-repair as a practical robustness layer for deployed LLM-agent tool use.
Abstract:Tool-augmented language-model agents rely on interface text: tool descriptions, argument schemas, and the candidate tool list shown at inference time. These interfaces often change after deployment even when the underlying tool semantics remain fixed, creating a practical reliability problem for function-calling systems. We study this failure mode as interface drift and evaluate whether a lightweight, training-free repair layer can recover robustness without retraining the base model. Our method, SchemaShield-Lite, combines schema validation, candidate-set retry for missing tool names, and one-shot constrained repair. On Qwen3.5-9B, it raises DICE-300 accuracy from 0.717 to 0.813 and BFCL-200 accuracy from 0.580 to 0.805, recovering 19/22 and 33/45 drift-induced failures with no observed repair harms. Naive retry does not explain the gains. Ablations show that candidate-set drift, especially distractor tools, accounts for most observed damage, while description and schema edits alone are less harmful. The results position validation-and-repair as a practical robustness layer for deployed LLM-agent tool use.
16 pages, 1 figure, 6 tables. Peer-reviewed and accepted at NGEN-AI 2026 (International Conference on Next Generation AI Systems). This is the pre-review submitted version
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
arXiv:2610.23342 [cs.AI]
(or arXiv:2610.23342v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2610.23342 arXiv-issued DOI via DataCite (pending registration)
Full text under the publisher's open licence · 203 words
Related coverage

Article: The Platform Engineering Playbook for Production LLMs
InfoQ · Oct 5, 2026

Bridging intent and execution in agentic systems
Amazon Science · Jun 8, 2026

Article: Governing AI in the Cloud: A Practical Guide for Architects
InfoQ · Jun 15, 2026

News
Quantum Computing Report · Jul 25, 2026