Skip to content
aiqbench takeMachine Learning

aiqbench analysis

This paper introduces a benchmark for how neural audio memory handles updates: retrieving the latest value of an attribute, keeping unchanged attributes intact, and rejecting sources that never appeared. The reported result is that training on other recordings of the test instruments widens a delta-rule memory's update advantage over attention by 13.4 points, so the gains depend on training data and history conflicts, not just overall accuracy. Readers building long-context or streaming audio systems should note that the benchmark separates update, preservation, and rejection behavior, which aggregate scores tend to hide.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

AMemOps: Evaluating Memory Updates in Long Audio Streams

arXiv2 min read

arXiv:2610.18652v1 Announce Type: cross Abstract: Audio memory must recognise recurring sources across acoustic changes while keeping their attributes up to date. Overall accuracy does not reveal how these demands interact. We introduce Audio Memory Operations (AMemOps), a benchmark for latest-attribute retrieval, preservation of unchanged attributes and absent-source rejection in long audio streams. Paired controls vary recordings, training identities and earlier events to examine their effects on updating. Training on other recordings of the test instruments increases a reference delta-rule memory's update advantage over matched attention by 13.4 percentage points. At retrieval delays of 120\,s, matched histories separate benefits of consistent repetition from costs of conflicting earlier values, while additive-memory controls identify benefits of erasure.

Abstract:Audio memory must recognise recurring sources across acoustic changes while keeping their attributes up to date. Overall accuracy does not reveal how these demands interact. We introduce Audio Memory Operations (AMemOps), a benchmark for latest-attribute retrieval, preservation of unchanged attributes and absent-source rejection in long audio streams. Paired controls vary recordings, training identities and earlier events to examine their effects on updating. Training on other recordings of the test instruments increases a reference delta-rule memory's update advantage over matched attention by 13.4 percentage points. At retrieval delays of 120\,s, matched histories separate benefits of consistent repetition from costs of conflicting earlier values, while additive-memory controls identify benefits of erasure.

Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

arXiv:2610.18652 [cs.SD]

(or arXiv:2610.18652v1 [cs.SD] for this version)

https://doi.org/10.48550/arXiv.2610.18652 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 208 words

Related coverage