aiqbench analysis
Los Alamos National Laboratory's Prelim Attention Score (PAS) establishes a new state-of-the-art benchmark for detecting hallucinations in vision-language models by monitoring attention patterns during token generation. This real-time, plug-and-play metric offers developers a low-overhead solution to verify output fidelity against input images, which is critical for deploying trustworthy multimodal AI in high-stakes domains like medical imaging. By pinpointing the origin of fabricated details within the generation process, PAS provides a practical mechanism to enhance the reliability of autoregressive systems without significant computational cost.
PAS Achieves State-of-the-Art Accuracy Catching AI Hallucinations

Los Alamos’ Prelim Attention Score (PAS) tool detects inaccuracies, known as hallucinations, in vision-language models—reaching state-of-the-art.
Los Alamos National Laboratory researchers have developed a tool achieving high accuracy in detecting instances where artificial intelligence describes objects absent from an input image. The Prelim Attention Score, or PAS, offers a unique solution by monitoring autoregressive vision-language models as they generate output, pinpointing the origin of information and potential errors during the process itself. “The PAS is a real-time, plug-and-play metric that acts as an internal monitor for the AI,” explains Manish Bhattarai,…
Excerpt shown under the publisher's RSS terms · 75 words · full text and figures are on the publisher's site
Related coverage

What We Learned Trying to Catch AI Liars: An Aletheia's Quest Retrospective
EleutherAI · Aug 25, 2026
The Most Forbidden Technique is not always forbidden
LessWrong · Jul 18, 2026

Always ask your agent to be honest
LessWrong · Sep 16, 2026

Evaluate your Amazon Nova Sonic voice agent at scale, no microphone required
AWS · Jun 8, 2026