Skip to content
aiqbench takeAI Safety

aiqbench analysis

This research introduces a novel class of adversarial examples that are significantly different from original inputs yet yield identical model predictions, challenging the conventional understanding of input proximity in security attacks. The proposed algorithms demonstrate that such deceptive perturbations can be distributed extensively across the sample space rather than just near the training data, expanding the attack surface for machine learning systems. This work is critical for advancing robustness testing and defense mechanisms against sophisticated threats to AI model integrity.
Sources coveringarXiv, AI Alignment Forum, AWS, LessWrong
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

A New Type of Adversarial Examples

arXiv2 min read

arXiv:2510.19347v2 Announce Type: replace-cross Abstract: Most machine learning models are vulnerable to adversarial examples, which poses security concerns on these models. Adversarial examples are crafted by applying subtle but intentionally worst-case modifications to examples from the dataset, leading the model to output a different answer from the original example. In this paper, adversarial examples are formed in an exactly opposite manner, which are significantly different from the original examples but result in the same answer. We propose a novel set of algorithms to produce such adversarial examples, including the negative iterative fast gradient sign method (NI-FGSM) and the negative iterative fast gradient method (NI-FGM), along with their momentum variants: the negative momentum iterative fast gradient sign method (NMI-FGSM) and the negative momentum iterative fast gradient method (NMI-FGM). Adversarial examples constructed by these methods could be used to perform an attack on machine learning systems in certain occasions. Moreover, our results show that the adversarial examples are not merely distributed in the neighbourhood of the examples from the dataset; instead, they are distributed extensively in the sample space.

Abstract:Most machine learning models are vulnerable to adversarial examples, which poses security concerns on these models. Adversarial examples are crafted by applying subtle but intentionally worst-case modifications to examples from the dataset, leading the model to output a different answer from the original example. In this paper, adversarial examples are formed in an exactly opposite manner, which are significantly different from the original examples but result in the same answer. We propose a novel set of algorithms to produce such adversarial examples, including the negative iterative fast gradient sign method (NI-FGSM) and the negative iterative fast gradient method (NI-FGM), along with their momentum variants: the negative momentum iterative fast gradient sign method (NMI-FGSM) and the negative momentum iterative fast gradient method (NMI-FGM). Adversarial examples constructed by these methods could be used to perform an attack on machine learning systems in certain occasions. Moreover, our results show that the adversarial examples are not merely distributed in the neighbourhood of the examples from the dataset; instead, they are distributed extensively in the sample space.

Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Graphics (cs.GR)

arXiv:2510.19347 [cs.LG]

(or arXiv:2510.19347v2 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2510.19347 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 269 words

Related coverage