Extending Music Annotation Schemas: Zero-Shot Prediction or Few-Shot Adaptation?

Title:Extending Music Annotation Schemas: Zero-Shot Prediction or Few-Shot Adaptation?

Abstract:Automatic music annotation is typically tackled under the assumption of a fixed annotation schema. In practice, commercial music catalogs often need to accommodate new musical attributes as needs evolve. Given that expert music annotation is expensive, it is not evident which methodological approach is most effective at accommodating new attributes and backfilling existing tracks; audio-language models promise zero-shot prediction, but at what annotation budget does supervised adaptation become more compelling? We propose a benchmark based on the MGPHot popular music annotation dataset for simulating music schema extension across different annotation budgets. We investigate zero-shot prediction with audio-language models, learning new attributes from pretrained representations, and adapting models trained on existing annotations. Our results suggest that supervised adaptation is more effective than zero-shot prediction even with small annotation budgets, while frozen representation reuse remains the most effective approach for modest budgets without the tuning required by deeper adaptation.

5 pages, 3 figures. Submitted to IEEE ICASSP 2027; under review

Sound (cs.SD); Machine Learning (cs.LG)

arXiv:2610.06920 [cs.SD]

(or arXiv:2610.06920v1 [cs.SD] for this version)

https://doi.org/10.48550/arXiv.2610.06920 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.