Sari la conținut
aiqbenchInformații despre AI & calcul cuantic
ȘtiriAnalizeBenchmark-uriSkill-uriÎntreabă AIÎnvațăDespre
...Se încarcă sesiunea
ȘtiriAnalizeBenchmark-uriSkill-uriÎntreabă AIÎnvațăDespre

Română · beta. Traducerea a fost făcută automat și este încă în curs de revizuire. Citește pagina în engleză

Înapoi la listă
perspectiva aiqbenchSiguranță AI

analiza aiqbench

This research identifies critical vulnerabilities in deep learning-based weather forecasting models, specifically demonstrating how subtle perturbations can manipulate tropical cyclone trajectory predictions. By introducing a differentiable surrogate model and specialized loss functions, the authors successfully craft adversarial inputs that bypass traditional detection limits caused by non-differentiable black boxes and severe class imbalance. The findings highlight significant safety risks for downstream applications relying on AI-driven climate models and suggest necessary robustness improvements against targeted manipulation.
1
Sursă care acoperăarXiv

Adversarial Attacks on Downstream Weather Forecasting Models: Application to Tropical Cyclone Trajectory Prediction

arXiv·16 noiembrie 2026·3 min de citit·Articolul și perspectiva sunt în engleză.

De la arXiv

Text integral

arXiv:2510.10140v3 Announce Type: replace Abstract: Deep learning-based weather forecasting (DLWF) models leverage past weather observations to generate future forecasts, supporting a wide range of downstream applications, including tropical cyclone (TC) prediction. In this paper, we investigate the vulnerability of these models to adversarial attacks, where subtle perturbations to upstream forecasts can alter downstream TC trajectory predictions. Crafting perturbed inputs to steer downstream outputs toward attacker-specified trajectories is a challenging problem for several reasons.

First, conventional TC detection systems are opaque, non-differentiable black boxes, making standard gradient-based attacks infeasible. Second, the extreme rarity of TC events leads to a severe class imbalance problem, making it difficult to develop attack methods that produce realistic-looking cyclone paths aligned with target trajectories. To overcome these limitations, we propose Cyc-Attack, a novel method for perturbing the forecasts of DLWF models to generate adversarial trajectories. The proposed method uses a differentiable surrogate model to approximate the TC detector's output, enabling the application of gradient-based attacks.

Cyc-Attack also employs a skewness-aware loss function with a kernel dilation strategy to address the severe class imbalance problem. Distance-based gradient weighting and regularization strategies are also introduced to constrain perturbations to eliminate unrealistic-looking TC paths. Our experiments show that Cyc-Attack achieves a higher true positive rate in matching the target trajectories, along with lower false alarm rates and stealthier perturbations than conventional attack methods. We further demonstrate that the adversarial upstream forecasts generated by Cyc-Attack can be leveraged as initial guidance to train an end-to-end model for learning adversarial input samples that would induce target trajectories.

Abstract:Deep learning-based weather forecasting (DLWF) models leverage past weather observations to generate future forecasts, supporting a wide range of downstream applications, including tropical cyclone (TC) prediction. In this paper, we investigate the vulnerability of these models to adversarial attacks, where subtle perturbations to upstream forecasts can alter downstream TC trajectory predictions. Crafting perturbed inputs to steer downstream outputs toward attacker-specified trajectories is a challenging problem for several reasons. First, conventional TC detection systems are opaque, non-differentiable black boxes, making standard gradient-based attacks infeasible.

Second, the extreme rarity of TC events leads to a severe class imbalance problem, making it difficult to develop attack methods that produce realistic-looking cyclone paths aligned with target trajectories. To overcome these limitations, we propose Cyc-Attack, a novel method for perturbing the forecasts of DLWF models to generate adversarial trajectories. The proposed method uses a differentiable surrogate model to approximate the TC detector's output, enabling the application of gradient-based attacks.

Cyc-Attack also employs a skewness-aware loss function with a kernel dilation strategy to address the severe class imbalance problem. Distance-based gradient weighting and regularization strategies are also introduced to constrain perturbations to eliminate unrealistic-looking TC paths. Our experiments show that Cyc-Attack achieves a higher true positive rate in matching the target trajectories, along with lower false alarm rates and stealthier perturbations than conventional attack methods. We further demonstrate that the adversarial upstream forecasts generated by Cyc-Attack can be leveraged as initial guidance to train an end-to-end model for learning adversarial input samples that would induce target trajectories.

Machine Learning (cs.LG); Cryptography and Security (cs.CR); Machine Learning (stat.ML)

arXiv:2510.10140 [cs.LG]

(or arXiv:2510.10140v3 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2510.10140 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Text integral sub licența deschisă a publicației · 350 cuvinte

Citește pe arXiv ↗Întreabă despre acest articol

Subiecte conexe

Machine learning

Conformal Adversarial Generative Ensemble

arXiv · 1 oct. 2026

Machine learning

A Matching Lower Bound for Online Smooth Calibration

arXiv · 13 nov. 2026

Siguranță AI

Aligned Alone, Misaligned Together: Forecasting Adversarial Capture in LLM Agent Populations

arXiv · 25 aug. 2026

Siguranță AI

Enabling Regulatory Multi-Agent Collaboration: Architecture, Challenges, and Solutions

arXiv · 29 sept. 2026

Article info

Source

arXiv

Published

16 noiembrie 2026

Read time

3 min

Category

Siguranță AI
aiqbench
Informații despre AI & calcul cuantic© aiqbench. Toate drepturile rezervate.

Fluxuri:RSS·JSON Feed

LimbăEnglish·Românăbeta
ȘtiriAI & tehnologieCuanticAnalize
ExploreazăBenchmark-uriÎnvață
CompanieDespreÎncredereInformații legaleTermeni și condițiiPolitica de confidențialitateNotificări privind drepturile de autorȘtergerea datelorRaportează conținut

Perspectiva aiqbench, analizele, rezumatul zilnic și răspunsurile din Întreabă sunt scrise de modele AI din sursele afișate, fără revizuire editorială înainte de publicare. Pot conține erori — verifică sursa. Cum este folosit modelul →

  • Știri
  • Analize
  • Întreabă
  • Topuri
  • Cont