analiza aiqbench
Composing insight from the full article — this may take a moment.
Recognizing Study Lineage Is Not Enough: Over-Crediting Same-Trial Evidence in LLM-Based Medical Verification
arXiv:2610.23721v1 Announce Type: new Abstract: Publication count is not study count. A model can identify shared trial lineage correctly in a direct task yet over-credit a second publication from the same trial when aggregating evidence. We evaluate this behavior in medical LLM verification using 14 source-audited clinical families and five model conditions. The families span provenance, clinical applicability, result direction, and composition; the provenance families provide the direct lineage tests. Recognition and aggregation are separate stateless calls, and repeated calls assess within-input stability. Across all three original provenance families, GPT-5.5 identifies the independent update in 10/10 recognition calls per family but over-credits the same-trial report in 5/5 separate aggregation calls per family. Selected Qwen3-4B and Ministral-3-8B conditions show the same cross-task contrast. A study-grouping instruction reduces GPT-5.5 over-credit from 4/5 to 0/5 in each later pure-provenance family. Other model conditions show mixed behavior, and rejected outputs limit several comparisons. The results identify a behavioral gap between elicited lineage recognition and evidence aggregation. The code and data artifacts are available at https://anonymous.4open.science/r/study-lineage-review-artifact.
Citește articolul complet pe arXivSubiecte conexe

[AINews] not much happened today
Latent Space · 3 oct. 2026
Bill Gates Will NOT And CANNOT Inject Us With A Microchip In A Vaccine - Fails Basic Fact Check
science20.com · 20 aug. 2026

Daniel Ritter
file770.com · 29 aug. 2026
Dialogue with Eliezer Yudkowsky on Neural Networks
LessWrong · 2 oct. 2026