aiqbench analysis
This research introduces a novel LLM-driven pipeline that extracts hate narratives from Reddit discourse by modeling them as entity-evaluation pairs, moving beyond surface-level semantics. By combining Aspect-Based Sentiment Analysis with Leiden clustering and subsequent LLM-guided refinement, the method achieves higher interpretability for detecting specific online hostility patterns. The study demonstrates practical utility in building rigorous detection systems through a case analysis of Taylor Swift-related comments on arXiv.
Look What You Made Us Cluster: Hate Narrative Extraction from Reddit Discourse
arXiv:2609.37408v1 Announce Type: new Abstract: Narrative extraction allows us to identify online hate narratives, supporting the construction of rigorous detection systems. Existing computational approaches, however, are limited in precision as they rely on semantic representations, which tend to capture only surface-level meaning. To detect more precise and interpretable narratives, we present an extraction pipeline that represents narratives as entity-evaluation pairs. Narratives are extracted using a Large Language Model (LLM) reasoning process that extends Aspect-Based Sentiment Analysis, identifying the aspect, classifying its judgement type as the basis for evaluation, and deriving the evaluation accordingly. Extracted narratives are then clustered using Leiden, following which clusters are resolved to an intended level of granularity through an LLM-guided refinement process. We illustrate this narrative pipeline with English Reddit comments from 2024 that criticize Taylor Swift, analyzing a representative cluster that exhibits hate speech patterns to demonstrate its interpretive value.
Authors:Annabelle K. L. Chua, Forster J. Khoo, Joel C. R. Tan, Huey Ting Ang, Kheng Hwee Tan, Joel Y. A. Sim, Shirley W. H. Ow, Ria Mundhra, Elsie C. K. Toh, Youfeng Xu, Lynnette H. X. Ng
Abstract:Narrative extraction allows us to identify online hate narratives, supporting the construction of rigorous detection systems. Existing computational approaches, however, are limited in precision as they rely on semantic representations, which tend to capture only surface-level meaning. To detect more precise and interpretable narratives, we present an extraction pipeline that represents narratives as entity-evaluation pairs. Narratives are extracted using a Large Language Model (LLM) reasoning process that extends Aspect-Based Sentiment Analysis, identifying the aspect, classifying its judgement type as the basis for evaluation, and deriving the evaluation accordingly. Extracted narratives are then clustered using Leiden, following which clusters are resolved to an intended level of granularity through an LLM-guided refinement process. We illustrate this narrative pipeline with English Reddit comments from 2024 that criticize Taylor Swift, analyzing a representative cluster that exhibits hate speech patterns to demonstrate its interpretive value.
Computation and Language (cs.CL); Social and Information Networks (cs.SI)
arXiv:2609.37408 [cs.CL]
(or arXiv:2609.37408v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.37408 arXiv-issued DOI via DataCite (pending registration)
Full text under the publisher's open licence · 201 words
Related coverage

Building trust in AI agents: A production-ready evaluation framework with Amazon Bedrock AgentCore
AWS · Oct 16, 2026

Duane Arnold
LessWrong · Jul 23, 2026

Brief independent investigation of agents’ behavior, reasoning and collaboration in the OpenAI / Hugging Face hacking incident
METR · Aug 26, 2026

Can John Ternus find Apple’s next big thing?
The Verge · Sep 21, 2026