Skip to content
aiqbench takeAI Products

aiqbench analysis

Echoverse addresses a critical bottleneck in AI agent development by shifting from simple task repetition to high-fidelity simulation training. This approach significantly improves an agent's ability to handle complex, multi-step workflows and adapt to unseen UI elements like date pickers. By co-evolving the model with realistic, state-coherent environments, researchers can achieve performance levels approaching current top-tier models without relying solely on raw parameter scaling.
Source coveringMicrosoft Research
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Echoverse: Deep, evolving environments for computer-use agents

Microsoft Research24 min read

Computer-use AI agents struggle with multi-step workflows like email and customer support. Echoverse trains agents in realistic environments rather than simply providing more training tasks, helping them improve as the tasks, tests, and environments evolve. The post Echoverse: Deep, evolving environments for computer-use agents appeared first on Microsoft Research.

Scaling fidelity over sheer count, targeting the capabilities agents actually lack, and evolving with the models they train. We built twelve training worlds for computer-use agents: ten deep domain worlds and two capability worlds, each drilling a single control rendered in many forms (date pickers and nested filters). Depth is what makes them worth training on: these worlds reproduce an application’s real behavior, come seeded with realistic data, and keep state coherent across screens and users. Trained on all twelve, a 9B model nearly doubles its base score (36.5% to 67.1%), coming within fourteen points of GPT-5.4. The experiment taught us several lessons: High simulation fidelity is a must-have; shallow worlds hurt the agent. Trained on shallow and deep builds of the same sites, the model regressed on the shallow ones but improved on the deep ones. Agents often struggle with the same challenging UI elements, like date pickers and nested filters. Drilling those controls in varied forms taught the model to operate them in domains it never saw in training. Co-evolving the model, the world, and the verifier improves all of them. As the world grows more correct and its tasks grow harder, the model climbs with it. Reinforcement…

Excerpt shown under the publisher's RSS terms · 200 words · full text and figures are on the publisher's site

Related coverage