aiqbench analysis
This study leverages 21 large language models to move beyond binary classification in detecting cancer misinformation within Reddit communities, establishing a multi-dimensional taxonomy for nuanced analysis. The research highlights significant challenges in risk assessment and demonstrates how LLMs can be scaled to identify heterogeneous misinformation patterns across diverse health topics.
Beyond Binary Detection: A Multi-Dimensional Taxonomy of Cancer Misinformation on Reddit
arXiv:2607.12383v3 Announce Type: replace Abstract: Cancer-related discussions on social media provide important spaces for information exchange and peer support, but can also expose users to misinformation with implications for prevention, screening, and treatment decisions. Existing work often treats cancer misinformation as a binary phenomenon, providing limited insight into how misinformation is expressed, engaged with, and associated with potential harm. We introduce a multi-dimensional taxonomy for characterizing cancer misinformation in Reddit discussions of breast, lung, colon, and prostate cancer. Developed through expert annotation, the taxonomy captures seven dimensions spanning misinformation presence, cancer stage, information-seeking and sharing behavior, misinformation type, risk, stance, and topical focus. We evaluate 21 large language models (LLMs) across zero- and few-shot settings and develop a cross-model agreement strategy for scaling misinformation identification to over 133K posts. Our analysis shows that misinformation is heterogeneous in both form and function: unproven and alternative treatments emerge as a prominent topic, misinformation frequently occurs within exchanges that combine information seeking and sharing, and users engage with questionable claims through both endorsement and uncertainty. We further find that classification difficulty varies substantially across dimensions, with risk assessment posing particular challenges for both human annotators and LLMs. Our taxonomy and empirical findings move beyond binary detection toward a more nuanced characterization of how cancer misinformation is produced, discussed, and encountered in online health communities.
Abstract:Cancer-related discussions on social media provide important spaces for information exchange and peer support, but can also expose users to misinformation with implications for prevention, screening, and treatment decisions. Existing work often treats cancer misinformation as a binary phenomenon, providing limited insight into how misinformation is expressed, engaged with, and associated with potential harm. We introduce a multi-dimensional taxonomy for characterizing cancer misinformation in Reddit discussions of breast, lung, colon, and prostate cancer. Developed through expert annotation, the taxonomy captures seven dimensions spanning misinformation presence, cancer stage, information-seeking and sharing behavior, misinformation type, risk, stance, and topical focus. We evaluate 21 large language models (LLMs) across zero- and few-shot settings and develop a cross-model agreement strategy for scaling misinformation identification to over 133K posts. Our analysis shows that misinformation is heterogeneous in both form and function: unproven and alternative treatments emerge as a prominent topic, misinformation frequently occurs within exchanges that combine information seeking and sharing, and users engage with questionable claims through both endorsement and uncertainty. We further find that classification difficulty varies substantially across dimensions, with risk assessment posing particular challenges for both human annotators and LLMs. Our taxonomy and empirical findings move beyond binary detection toward a more nuanced characterization of how cancer misinformation is produced, discussed, and encountered in online health communities.
Computation and Language (cs.CL)
arXiv:2607.12383 [cs.CL]
(or arXiv:2607.12383v3 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.12383 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 309 words
Related coverage
A Multi-Branch Feature Fusion Approach for Health Misinformation Detection and Propagation
arXiv · Sep 2, 2026

Presentation: Exploding GPUs
InfoQ · Oct 16, 2026

Presentation: From Models to Agents: Building Context-Aware Consumer AI at Scale at DoorDash
InfoQ · Aug 15, 2026

Symmetry-enriched topological order in tensor networks: Defects, gauging and anyon condensation
Quantum Journal · Sep 1, 2026