analiza aiqbench
This research introduces ASAP, a framework that leverages the "satisficing generalization edge" to improve the robustness of deep reinforcement learning solvers against distribution shifts in combinatorial optimization problems. By decoupling action generation into a robust proposal phase and an adaptable selection phase, the method achieves superior online adaptation using Model-Agnostic Meta-Learning without sacrificing solution quality. The approach offers a practical pathway to mitigate brittleness in neural solvers for tasks like the Traveling Salesman Problem and 3D Bin Packing, making them more viable for dynamic real-world environments.
ASAP: Exploiting the Satisficing Generalization Edge in Neural Combinatorial Optimization
arXiv:2501.17377v4 Announce Type: replace-cross Abstract: Deep Reinforcement Learning (DRL) has emerged as a promising approach for solving Combinatorial Optimization (CO) problems, such as the 3D Bin Packing Problem (3D-BPP), Traveling Salesman Problem (TSP), or Vehicle Routing Problem (VRP), but these neural solvers often exhibit brittleness when facing distribution shifts. To address this issue, we uncover the Satisficing Generalization Edge, which we validate both theoretically and experimentally: identifying a set of promising actions is inherently more generalizable than selecting the single optimal action. To exploit this property, we propose Adaptive Selection After Proposal (ASAP), a generic framework that decomposes the decision-making process into two distinct phases: a proposal policy that acts as a robust filter, and a selection policy as an adaptable decision maker. This architecture enables a highly effective online adaptation strategy where the selection policy can be rapidly fine-tuned on a new distribution. Concretely, we introduce a two-phase training framework enhanced by Model-Agnostic Meta-Learning (MAML) to prime the model for fast adaptation. Extensive experiments on 3D-BPP, TSP, and CVRP demonstrate that ASAP improves the generalization capability of state-of-the-art baselines and achieves superior online adaptation on out-of-distribution instances.
Abstract:Deep Reinforcement Learning (DRL) has emerged as a promising approach for solving Combinatorial Optimization (CO) problems, such as the 3D Bin Packing Problem (3D-BPP), Traveling Salesman Problem (TSP), or Vehicle Routing Problem (VRP), but these neural solvers often exhibit brittleness when facing distribution shifts. To address this issue, we uncover the Satisficing Generalization Edge, which we validate both theoretically and experimentally: identifying a set of promising actions is inherently more generalizable than selecting the single optimal action. To exploit this property, we propose Adaptive Selection After Proposal (ASAP), a generic framework that decomposes the decision-making process into two distinct phases: a proposal policy that acts as a robust filter, and a selection policy as an adaptable decision maker. This architecture enables a highly effective online adaptation strategy where the selection policy can be rapidly fine-tuned on a new distribution. Concretely, we introduce a two-phase training framework enhanced by Model-Agnostic Meta-Learning (MAML) to prime the model for fast adaptation. Extensive experiments on 3D-BPP, TSP, and CVRP demonstrate that ASAP improves the generalization capability of state-of-the-art baselines and achieves superior online adaptation on out-of-distribution instances.
Machine Learning (cs.LG); Artificial Intelligence (cs.AI)
arXiv:2501.17377 [cs.LG]
(or arXiv:2501.17377v4 [cs.LG] for this version)
Text integral sub licența deschisă a publicației · 197 cuvinte
Subiecte conexe
[AINews] High Taste Testers Ep. 1
Latent Space · 17 oct. 2026
RELAGRAM: Recursive Latent Graph Model for the Capacitated Vehicle Routing Problem
arXiv · 14 oct. 2026
GeoPAR: Large-Scale Multi-Agent Combinatorial Optimization with Geometry-Guided Parallel Autoregressive Learning
arXiv · 2 sept. 2026
Dual-GNN Multilevel Coarsening for Maximum Independent Set
arXiv · 23 sept. 2026