Scalable Dynamic Distributed Constraint Optimization with Metareasoning and Application to Continual Satellite Operations

Abstract:Dynamic distributed constraint optimization problems (DDCOPs) provide a general framework for coordinating autonomous agents in changing environments. However, existing DDCOP formulations do not adequately address settings where optimization and execution overlap, resources persist across time, and agents operate under limited computational and communication constraints. We extend the DDCOP model to address these challenges by introducing an execution-aware formulation, together with new algorithms and frameworks for efficiently computing solutions. We develop a general framework for metareasoning in DDCOPs, enabling agents to determine when the estimated benefit of recomputing solutions outweighs its computational cost. We further extend the neighborhood stochastic search algorithm to the dynamic setting, introducing dynamic incremental neighborhood stochastic search (D-NSS), a scalable decomposition-based DDCOP algorithm that efficiently repairs previous solutions in response to problem dynamics. We apply our methods to the real-world application of large-scale satellite scheduling. Deploying autonomy to satellites requires efficient computation and communication in the face of highly dynamic environments. We demonstrate that D-NSS stabilizes to high-quality solutions, outperforming standard DDCOP baselines in solution quality, computation time, and message volume, while our metareasoning framework successfully balances resource conservation with utility. These methods will support the NASA FAME mission, the largest in-space demonstration of distributed multi-agent AI to date.

Artificial Intelligence (cs.AI)

arXiv:2601.06188 [cs.AI]

(or arXiv:2601.06188v4 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2601.06188 Focus to learn more arXiv-issued DOI via DataCite

https://doi.org/10.65109/JCYH5778 Focus to learn more DOI(s) linking to related resources

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.