analiza aiqbench
This research evaluates the efficacy of Large Language Models versus traditional machine learning classifiers for detecting depression severity and differential diagnosis in social media text. The study finds that while zero-shot LLMs perform well on binary classification, supervised models utilizing embeddings from LLM-generated summaries offer superior accuracy for fine-grained ordinal tasks like predicting disease severity. These findings suggest a hybrid approach where LLMs serve as semantic interpreters to enhance the reliability of mental health assessment systems beyond simple end-to-end classification.
Interpretable Depression Detection from Social Media Text Using LLM-Derived Embeddings
arXiv:2506.06616v2 Announce Type: replace Abstract: Accurate and interpretable detection of depressive language in social media can support early identification of mental health conditions and inform timely interventions. In this paper, we investigate the use of large language models (LLMs) and traditional machine learning classifiers for three social media-based mental health prediction tasks: binary depression classification, depression severity classification, and differential diagnosis among depression, PTSD, and anxiety. We compare zero-shot LLMs with supervised classifiers trained on conventional text embeddings, psycholinguistic features, and embeddings derived from LLM-generated mental health summaries. Across multiple publicly available social media text datasets and five-fold cross-validation experiments, we find that zero-shot LLMs exhibit strong performance and generalization in binary depression classification, but struggle with fine-grained severity prediction. In contrast, supervised models trained on LLM summary embeddings often achieve more accurate and consistent performance, particularly for multi-class and ordinal classification tasks. These findings highlight both the strengths and limitations of current LLMs for mental health prediction and suggest that using LLMs as semantic interpreters, rather than solely as end-to-end classifiers, may provide a promising direction for building more effective and interpretable mental health assessment systems.
Abstract:Accurate and interpretable detection of depressive language in social media can support early identification of mental health conditions and inform timely interventions. In this paper, we investigate the use of large language models (LLMs) and traditional machine learning classifiers for three social media-based mental health prediction tasks: binary depression classification, depression severity classification, and differential diagnosis among depression, PTSD, and anxiety. We compare zero-shot LLMs with supervised classifiers trained on conventional text embeddings, psycholinguistic features, and embeddings derived from LLM-generated mental health summaries. Across multiple publicly available social media text datasets and five-fold cross-validation experiments, we find that zero-shot LLMs exhibit strong performance and generalization in binary depression classification, but struggle with fine-grained severity prediction. In contrast, supervised models trained on LLM summary embeddings often achieve more accurate and consistent performance, particularly for multi-class and ordinal classification tasks. These findings highlight both the strengths and limitations of current LLMs for mental health prediction and suggest that using LLMs as semantic interpreters, rather than solely as end-to-end classifiers, may provide a promising direction for building more effective and interpretable mental health assessment systems.
Computation and Language (cs.CL)
arXiv:2506.06616 [cs.CL]
(or arXiv:2506.06616v2 [cs.CL] for this version)
Text integral sub licența deschisă a publicației · 194 cuvinte
Subiecte conexe

Estimating suicide risk from text
MIT News · 24 sept. 2026

Article: Artificial Intelligence-Driven Phishing: How Phishing Technique Is Evolving and Implemented
InfoQ · 8 iun. 2026

[AINews] not much happened today
Latent Space · 18 sept. 2026
[AINews] AI Engineer NYC: Gemini 4 Argon, Vals AI Benchmarks
Latent Space · 14 oct. 2026