analiza aiqbench
This research tackles the critical challenge of zero-shot cross-lingual audio deepfake detection by removing language-dependent biases inherent in self-supervised speech models. By applying a target-free orthogonalization technique, the method successfully reduces error rates across unseen languages without requiring additional training data for those specific tongues. This advancement is vital for deploying robust anti-spoofing systems in multilingual environments where labeled resources are scarce.
Language Orthogonalization for Zero-Shot Cross-Lingual Audio Deepfake Detection
arXiv:2609.16458v1 Announce Type: cross Abstract: Audio deepfake detectors need to transfer to languages absent from training, as multilingual speech synthesis outpaces labeled anti-spoofing resources. While detectors increasingly rely on self-supervised speech models (S3Ms), these backbones encode language-dependent structure that confounds spoof cues. We address this confound through language orthogonalization, a target-free ridge map that removes S3M variation projected onto continuous language-identification (LID) embeddings. Across six languages, six S3M backbones, and all Leave-N-Out settings, it consistently reduces EER across unseen languages. Cross-lingual EER correlates with LID-space distance, where orthogonalization yields larger gains for more distant transfers.
Abstract:Audio deepfake detectors need to transfer to languages absent from training, as multilingual speech synthesis outpaces labeled anti-spoofing resources. While detectors increasingly rely on self-supervised speech models (S3Ms), these backbones encode language-dependent structure that confounds spoof cues. We address this confound through language orthogonalization, a target-free ridge map that removes S3M variation projected onto continuous language-identification (LID) embeddings. Across six languages, six S3M backbones, and all Leave-N-Out settings, it consistently reduces EER across unseen languages. Cross-lingual EER correlates with LID-space distance, where orthogonalization yields larger gains for more distant transfers.
Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
arXiv:2609.16458 [eess.AS]
(or arXiv:2609.16458v1 [eess.AS] for this version)
https://doi.org/10.48550/arXiv.2609.16458 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 190 cuvinte
Subiecte conexe
Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer: Case of Encoders
arXiv · 28 sept. 2026
X-VC: Zero-shot Streaming Voice Conversion in Codec Space
arXiv · 7 sept. 2026
Pixel-TTS: Image based Text Rendering for Robust Text-to-Speech
arXiv · 16 iun. 2026
Cross-Lingual Parkinson's Disease Severity Assessment Using Pre-trained Speech Embeddings: A Multi-Class Evaluation
arXiv · 21 sept. 2026