Skip to content
aiqbench takeAI Safety

aiqbench analysis

This research introduces a novel LLM-driven pipeline that extracts hate narratives from Reddit discourse by modeling them as entity-evaluation pairs, moving beyond surface-level semantics. By combining Aspect-Based Sentiment Analysis with Leiden clustering and subsequent LLM-guided refinement, the method achieves higher interpretability for detecting specific online hostility patterns. The study demonstrates practical utility in building rigorous detection systems through a case analysis of Taylor Swift-related comments on arXiv.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Look What You Made Us Cluster: Hate Narrative Extraction from Reddit Discourse

arXiv2 min read

arXiv:2609.37408v1 Announce Type: new Abstract: Narrative extraction allows us to identify online hate narratives, supporting the construction of rigorous detection systems. Existing computational approaches, however, are limited in precision as they rely on semantic representations, which tend to capture only surface-level meaning. To detect more precise and interpretable narratives, we present an extraction pipeline that represents narratives as entity-evaluation pairs. Narratives are extracted using a Large Language Model (LLM) reasoning process that extends Aspect-Based Sentiment Analysis, identifying the aspect, classifying its judgement type as the basis for evaluation, and deriving the evaluation accordingly. Extracted narratives are then clustered using Leiden, following which clusters are resolved to an intended level of granularity through an LLM-guided refinement process. We illustrate this narrative pipeline with English Reddit comments from 2024 that criticize Taylor Swift, analyzing a representative cluster that exhibits hate speech patterns to demonstrate its interpretive value.

Authors:Annabelle K. L. Chua, Forster J. Khoo, Joel C. R. Tan, Huey Ting Ang, Kheng Hwee Tan, Joel Y. A. Sim, Shirley W. H. Ow, Ria Mundhra, Elsie C. K. Toh, Youfeng Xu, Lynnette H. X. Ng

Abstract:Narrative extraction allows us to identify online hate narratives, supporting the construction of rigorous detection systems. Existing computational approaches, however, are limited in precision as they rely on semantic representations, which tend to capture only surface-level meaning. To detect more precise and interpretable narratives, we present an extraction pipeline that represents narratives as entity-evaluation pairs. Narratives are extracted using a Large Language Model (LLM) reasoning process that extends Aspect-Based Sentiment Analysis, identifying the aspect, classifying its judgement type as the basis for evaluation, and deriving the evaluation accordingly. Extracted narratives are then clustered using Leiden, following which clusters are resolved to an intended level of granularity through an LLM-guided refinement process. We illustrate this narrative pipeline with English Reddit comments from 2024 that criticize Taylor Swift, analyzing a representative cluster that exhibits hate speech patterns to demonstrate its interpretive value.

Computation and Language (cs.CL); Social and Information Networks (cs.SI)

arXiv:2609.37408 [cs.CL]

(or arXiv:2609.37408v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2609.37408 arXiv-issued DOI via DataCite (pending registration)

Full text under the publisher's open licence · 201 words

Related coverage