Skip to content
aiqbench takeAI Research

aiqbench analysis

This research introduces SPARC, a new benchmark evaluating how much speaker identity and demographic attributes can be inferred solely from transcribed text using large language models. The study reveals that LLMs can successfully distinguish same-speaker pairs based on writing style alone, though verifying specific attributes like sex or accent remains more challenging than pure identification. Releasing only short probe texts (50 words) was found to significantly degrade adversarial performance, offering a potential mitigation strategy for text-based speaker linking.
Source coveringarXiv

SPARC: Spoken Profile Authorship Recognition Corpus

arXiv2 min read

arXiv:2610.25265v1 Announce Type: new Abstract: Speech anonymization has focused on the acoustic signal, leaving open how much speaker information the transcribed words themselves retain. In this work, we study pairwise speaker and demographic-attribute verification from transcribed speech. We introduce SPARC (Spoken Profile Authorship Recognition Corpus), a benchmark built from two podcast corpora comprising over 12,500 speakers, 1.5M quality-filtered utterances, and speaker-level inferred or source-provided labels for sex, age, and accent, and evaluate five attribution models and three LLMs on identity- and attribute-verification trials with episode- and metadata-based topic proxies. LLM adversaries distinguish same-speaker pairs from text alone. Attribute-label agreement is harder to verify, but LLMs perform sex- and accent-label verification above chance. Finally, releasing only short probe texts (50 words) degrades the strongest adversaries the most, offering a partial reduction in observed linkage.

Abstract:Speech anonymization has focused on the acoustic signal, leaving open how much speaker information the transcribed words themselves retain. In this work, we study pairwise speaker and demographic-attribute verification from transcribed speech. We introduce SPARC (Spoken Profile Authorship Recognition Corpus), a benchmark built from two podcast corpora comprising over 12,500 speakers, 1.5M quality-filtered utterances, and speaker-level inferred or source-provided labels for sex, age, and accent, and evaluate five attribution models and three LLMs on identity- and attribute-verification trials with episode- and metadata-based topic proxies. LLM adversaries distinguish same-speaker pairs from text alone. Attribute-label agreement is harder to verify, but LLMs perform sex- and accent-label verification above chance. Finally, releasing only short probe texts (50 words) degrades the strongest adversaries the most, offering a partial reduction in observed linkage.

Computation and Language (cs.CL)

arXiv:2610.25265 [cs.CL]

(or arXiv:2610.25265v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2610.25265 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 221 words

Related coverage