aiqbench analysis
This research demonstrates how CLAP audio representations can directly detect abusive speech in low-resource Indic languages, bypassing unreliable text transcription while preserving critical tonal cues. The study reveals that lightweight classifiers on pre-trained features nearly match fully supervised systems and show diminishing returns with further adaptation, offering a cost-effective foundation for multilingual safety tools.
Few-Shot Contrastive Adaptation for Audio Abuse Detection in Low-Resource Indic Languages
arXiv:2604.09094v2 Announce Type: replace-cross Abstract: Abusive and hateful speech is increasingly spoken rather than written, surfacing in voice notes, calls, and short-form videos. Most detection systems still transcribe speech to text before classifying it, but transcription is unreliable for languages lacking strong speech recognisers, and it discards the tone and emotion that often carry the abuse itself. This paper examines whether abusive speech can instead be detected directly from audio, using CLAP, a model that learns a shared representation of sound and language, evaluated across ten Indic languages in the ADIMA dataset. A lightweight classifier trained on CLAP's existing audio representations, without adapting the model itself, comes within one to three points of a fully supervised system, and far outperforms prompting with no labelled examples at all. Further adaptation with a handful of labelled examples per language yields little extra benefit, varying unpredictably across languages. CLAP-based audio representations thus already offer a strong, inexpensive foundation for detecting abusive speech across languages, lowering the labelled data needed in practice.
Abstract:Abusive and hateful speech is increasingly spoken rather than written, surfacing in voice notes, calls, and short-form videos. Most detection systems still transcribe speech to text before classifying it, but transcription is unreliable for languages lacking strong speech recognisers, and it discards the tone and emotion that often carry the abuse itself. This paper examines whether abusive speech can instead be detected directly from audio, using CLAP, a model that learns a shared representation of sound and language, evaluated across ten Indic languages in the ADIMA dataset. A lightweight classifier trained on CLAP's existing audio representations, without adapting the model itself, comes within one to three points of a fully supervised system, and far outperforms prompting with no labelled examples at all. Further adaptation with a handful of labelled examples per language yields little extra benefit, varying unpredictably across languages. CLAP-based audio representations thus already offer a strong, inexpensive foundation for detecting abusive speech across languages, lowering the labelled data needed in practice.
Sound (cs.SD); Computation and Language (cs.CL)
arXiv:2604.09094 [cs.SD]
(or arXiv:2604.09094v2 [cs.SD] for this version)
https://doi.org/10.48550/arXiv.2604.09094 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 258 words
Related coverage

[AINews] not much happened today
Latent Space · Oct 3, 2026

Digital States 2026: AI Moves From Experiment to Infrastructure
govtech.com · Sep 24, 2026

2026.9: There's room on this bus
Home Assistant · Sep 2, 2026
A Speech Corpus for Mizo Automatic Speech Recognition: Whisper and SraVaani 1.0 Fine-Tuning with Morphology-Aware Evaluation
arXiv · Aug 21, 2026