analiza aiqbench
This research applies self-supervised learning via transformer encoders to improve mass reconstruction in high-energy physics, addressing generalization issues caused by systematic uncertainties in collider experiments. By pre-training on invariant embeddings before fine-tuning for specific decay chains, the method achieves sharper resonance peaks and greater stability against data corruptions compared to standard supervised approaches. The work highlights a practical application of foundation model paradigms to solve critical problems in new physics searches.
Self-Supervised Learning for Robust Resonance Mass Regression in Cascade Decays
arXiv:2609.17726v1 Announce Type: cross Abstract: Reconstructing the mass of a heavy resonance from its decay products with missing energy is one of the central tasks that directly determine the sensitivity in new physics searches at collider experiments. Supervised learning approaches to this problem often struggle to generalize well due to the presence of various systematic uncertainties and distribution shifts. Exhausting all possible variations in the labeled data can be very compute-intensive, while a failure of the model to generalize can corrupt the reconstructed resonance widths that are critical in peak-hunting analyses. In this work, following the foundation model paradigm, we use a self-supervised approach to pre-train a transformer encoder with VICReg to learn an embedding invariant to various corruptions, then fine-tune it for mass regression on a heavy resonance with masses ranging from 2.5 to 6.5 TeV and a SUSY-like cascade decay into an eleven-body final state. We show that the pre-trained model reconstructs sharper resonance peaks and has a more stable performance under various realistic corruptions, compared to a supervised model of the same architecture trained on the same augmented data from scratch.
Abstract:Reconstructing the mass of a heavy resonance from its decay products with missing energy is one of the central tasks that directly determine the sensitivity in new physics searches at collider experiments. Supervised learning approaches to this problem often struggle to generalize well due to the presence of various systematic uncertainties and distribution shifts. Exhausting all possible variations in the labeled data can be very compute-intensive, while a failure of the model to generalize can corrupt the reconstructed resonance widths that are critical in peak-hunting analyses. In this work, following the foundation model paradigm, we use a self-supervised approach to pre-train a transformer encoder with VICReg to learn an embedding invariant to various corruptions, then fine-tune it for mass regression on a heavy resonance with masses ranging from 2.5 to 6.5 TeV and a SUSY-like cascade decay into an eleven-body final state. We show that the pre-trained model reconstructs sharper resonance peaks and has a more stable performance under various realistic corruptions, compared to a supervised model of the same architecture trained on the same augmented data from scratch.
High Energy Physics - Experiment (hep-ex); Machine Learning (cs.LG)
arXiv:2609.17726 [hep-ex]
(or arXiv:2609.17726v1 [hep-ex] for this version)
https://doi.org/10.48550/arXiv.2609.17726 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 279 cuvinte
Subiecte conexe

Exploring self-distilled reasoning for supervised fine-tuning with Amazon Nova
AWS · 21 iul. 2026
MR-JEPA: A General Purpose Video Foundation Model for Cardiac MRI
arXiv · 1 sept. 2026

Dharma vs Adharma - The Perplexity of Being Alive
hillpost.in · 25 aug. 2026
Introducing North Mini Code: Cohere’s First Model For Developers
Hugging Face · 9 iun. 2026