aiqbench analysis
This research introduces "generative curation," a framework designed for decision-support systems where humans retain final authority over complex criteria difficult to quantify. By leveraging Gaussian process models and neural optimization, the study demonstrates how algorithms can balance quantitative performance with qualitative diversity to reduce regret in action selection. The approach offers significant improvements over standard benchmarks, validated through synthetic experiments and applied to real-world problems like police redistricting.
Balancing Optimality and Diversity: Human-Centered Decision Making through Generative Curation
arXiv:2409.11535v3 Announce Type: replace Abstract: Many decision-support systems recommend actions by optimizing measurable objectives, even when a human decision-maker retains final authority and considers additional criteria that are difficult to specify in advance. We study how an algorithm should curate a small portfolio of quantitatively strong alternatives in such settings. We introduce generative curation, a framework that learns a recommendation policy to maximize the expected desirability of the action ultimately selected by the decision-maker. For policies that generate quantitatively competitive actions, we decompose expected portfolio desirability into quantitative performance and a qualitative curation gain. Under a Gaussian process model of residual desirability, this gain is characterized by the Gaussian width induced by the covariance kernel, yielding a decision-theoretic notion of diversity based on qualitative nonredundancy rather than generic geometric separation. We establish diminishing returns to portfolio size and characterize regimes in which optimal policies are balanced, endpoint-concentrated, or space-filling. We develop neural generative and sequential optimization approaches applicable to continuous and combinatorial action spaces. Controlled synthetic experiments demonstrate substantial regret reductions relative to optimization- and distance-based benchmarks, while an Atlanta police redistricting case study illustrates the framework's applicability to a complex operational planning problem.
Abstract:Many decision-support systems recommend actions by optimizing measurable objectives, even when a human decision-maker retains final authority and considers additional criteria that are difficult to specify in advance. We study how an algorithm should curate a small portfolio of quantitatively strong alternatives in such settings. We introduce generative curation, a framework that learns a recommendation policy to maximize the expected desirability of the action ultimately selected by the decision-maker. For policies that generate quantitatively competitive actions, we decompose expected portfolio desirability into quantitative performance and a qualitative curation gain. Under a Gaussian process model of residual desirability, this gain is characterized by the Gaussian width induced by the covariance kernel, yielding a decision-theoretic notion of diversity based on qualitative nonredundancy rather than generic geometric separation. We establish diminishing returns to portfolio size and characterize regimes in which optimal policies are balanced, endpoint-concentrated, or space-filling. We develop neural generative and sequential optimization approaches applicable to continuous and combinatorial action spaces. Controlled synthetic experiments demonstrate substantial regret reductions relative to optimization- and distance-based benchmarks, while an Atlanta police redistricting case study illustrates the framework's applicability to a complex operational planning problem.
Machine Learning (cs.LG); Human-Computer Interaction (cs.HC); Optimization and Control (math.OC)
arXiv:2409.11535 [cs.LG]
(or arXiv:2409.11535v3 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2409.11535 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 288 words
Related coverage

[AINews] The Future of Latent Space
Latent Space · Sep 25, 2026

[AINews] Opus 5.5 is good at explainer videos
Latent Space · Sep 29, 2026

Presentation: Building Evals for AI Adoption: from Principles to Practice
InfoQ · May 29, 2026
Dyna-2: General Purpose Physical Agents with Hour-Long Autonomy — Jason Ma, Dyna Robotics
Latent Space · Oct 13, 2026