aiqbench analysis
JaxAHT introduces a JAX-based library that significantly accelerates ad hoc teamwork research by addressing high computational costs and the lack of standardized benchmarks. By leveraging JAX's parallelization capabilities, the framework achieves a massive speedup over PyTorch while providing diverse evaluation teammates for multi-agent coordination tasks. This tool is essential for researchers aiming to scale agent training and benchmarking in dynamic environments where partners are unknown.
JaxAHT: A JAX-Based Library for Ad Hoc Teamwork
arXiv:2609.13716v1 Announce Type: new Abstract: Ad Hoc Teamwork (AHT) addresses the challenge of designing agents capable of coordinating with novel partners without prior coordination. However, progress in the field is hindered by the prohibitive computational cost of the AHT research lifecycle, the lack of standardized benchmark implementations, and the absence of a diverse, validated evaluation teammate suite. In this work, we introduce JaxAHT, the first open-source, JAX-based library designed to accelerate and standardize the AHT research lifecycle. Leveraging JAX's hardware acceleration and massive parallelization capabilities, JaxAHT provides a unified framework for teammate generation, ego agent training, and evaluation against unseen teammates, achieving approximately 95x wall-clock speedup over PyTorch counterparts. Alongside the library, we contribute a diverse suite of evaluation teammates across the domains of Level-Based Foraging, Overcooked, and Hanabi. To illustrate the value of the framework, we use it to conduct a large-scale, compute-controlled benchmark study comparing teammate generation and AHT agent learning methods, finding that no algorithm consistently performs best, and that agent modeling primarily offers benefits in role-based scenarios with diverse teammates.
Abstract:Ad Hoc Teamwork (AHT) addresses the challenge of designing agents capable of coordinating with novel partners without prior coordination. However, progress in the field is hindered by the prohibitive computational cost of the AHT research lifecycle, the lack of standardized benchmark implementations, and the absence of a diverse, validated evaluation teammate suite. In this work, we introduce JaxAHT, the first open-source, JAX-based library designed to accelerate and standardize the AHT research lifecycle. Leveraging JAX's hardware acceleration and massive parallelization capabilities, JaxAHT provides a unified framework for teammate generation, ego agent training, and evaluation against unseen teammates, achieving approximately 95x wall-clock speedup over PyTorch counterparts. Alongside the library, we contribute a diverse suite of evaluation teammates across the domains of Level-Based Foraging, Overcooked, and Hanabi. To illustrate the value of the framework, we use it to conduct a large-scale, compute-controlled benchmark study comparing teammate generation and AHT agent learning methods, finding that no algorithm consistently performs best, and that agent modeling primarily offers benefits in role-based scenarios with diverse teammates.
Artificial Intelligence (cs.AI)
I.2; I.2.11; I.2.1; H.5.3; D.2.13
arXiv:2609.13716 [cs.AI]
(or arXiv:2609.13716v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.13716 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 268 words
Related coverage

GeForce NOW Gives Gamers More Ways to Play at Gamescom 2026
NVIDIA · Aug 27, 2026

Integrate NVIDIA Omniverse RTX Sensor Simulation Into Existing Apps
NVIDIA · Jul 20, 2026
Understanding Attention Algorithms and Their Backends for Image and Video Generation
AMD · Jul 20, 2026

End-to-end encrypted ML inference with Amazon SageMaker AI and FHE
AWS · Jun 8, 2026