Skip to content
aiqbench takeAI Research

aiqbench analysis

This research demonstrates how CLAP audio representations can directly detect abusive speech in low-resource Indic languages, bypassing unreliable text transcription while preserving critical tonal cues. The study reveals that lightweight classifiers on pre-trained features nearly match fully supervised systems and show diminishing returns with further adaptation, offering a cost-effective foundation for multilingual safety tools.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Few-Shot Contrastive Adaptation for Audio Abuse Detection in Low-Resource Indic Languages

arXiv2 min read

arXiv:2604.09094v2 Announce Type: replace-cross Abstract: Abusive and hateful speech is increasingly spoken rather than written, surfacing in voice notes, calls, and short-form videos. Most detection systems still transcribe speech to text before classifying it, but transcription is unreliable for languages lacking strong speech recognisers, and it discards the tone and emotion that often carry the abuse itself. This paper examines whether abusive speech can instead be detected directly from audio, using CLAP, a model that learns a shared representation of sound and language, evaluated across ten Indic languages in the ADIMA dataset. A lightweight classifier trained on CLAP's existing audio representations, without adapting the model itself, comes within one to three points of a fully supervised system, and far outperforms prompting with no labelled examples at all. Further adaptation with a handful of labelled examples per language yields little extra benefit, varying unpredictably across languages. CLAP-based audio representations thus already offer a strong, inexpensive foundation for detecting abusive speech across languages, lowering the labelled data needed in practice.

Abstract:Abusive and hateful speech is increasingly spoken rather than written, surfacing in voice notes, calls, and short-form videos. Most detection systems still transcribe speech to text before classifying it, but transcription is unreliable for languages lacking strong speech recognisers, and it discards the tone and emotion that often carry the abuse itself. This paper examines whether abusive speech can instead be detected directly from audio, using CLAP, a model that learns a shared representation of sound and language, evaluated across ten Indic languages in the ADIMA dataset. A lightweight classifier trained on CLAP's existing audio representations, without adapting the model itself, comes within one to three points of a fully supervised system, and far outperforms prompting with no labelled examples at all. Further adaptation with a handful of labelled examples per language yields little extra benefit, varying unpredictably across languages. CLAP-based audio representations thus already offer a strong, inexpensive foundation for detecting abusive speech across languages, lowering the labelled data needed in practice.

Sound (cs.SD); Computation and Language (cs.CL)

arXiv:2604.09094 [cs.SD]

(or arXiv:2604.09094v2 [cs.SD] for this version)

https://doi.org/10.48550/arXiv.2604.09094 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 258 words

Related coverage