Balancing Privacy and Efficiency: Music Information Retrieval via Additive Homomorphic Encryption

Abstract:Modern music retrieval runs on vector embeddings, and once these embeddings are shared for search or matching they can be copied, probed, or used to train generative models. Fully homomorphic encryption can compute on them but is impractical at scale because of ciphertext--ciphertext multiplication and bootstrapping. We observe that when only one operand is encrypted, the query or the database, similarity search reduces to ciphertext addition and ciphertext--plaintext multiplication, which additive homomorphic encryption supports cheaply (through Paillier, or CKKS restricted to additive operations). Building on this observation, we (i) implement two music-specific inference attacks and quantify the privacy--utility tradeoff of provable mitigations, (ii) introduce structure-aware additive primitives with learned per-block weighting at no extra cryptographic cost, and (iii) show across four audio datasets that additive search preserves nearest-neighbor rankings exactly while avoiding the ciphertext--ciphertext multiplication and bootstrapping of full-depth FHE and scaling far better in embedding dimension than a true-additive Paillier baseline.

Databases (cs.DB); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)

arXiv:2508.07044 [cs.DB]

(or arXiv:2508.07044v2 [cs.DB] for this version)

https://doi.org/10.48550/arXiv.2508.07044 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.