perspectiva aiqbenchCercetare AI

Unitree and NVIDIA have released WorldOracle to benchmark world models against 335 real-world trajectories containing intentional failures and suboptimal actions. The evaluation highlights a critical gap where models struggle to predict object states accurately over extended time horizons, despite success in replicating robotic arm movements. This dataset provides an essential stress test for advancing the reliability of AI agents in dynamic physical environments.

Sursă care acoperă36Kr

Ce este aceastaLectura unui model asupra articolului și a acoperirii conexe, scrisă pentru aiqbench. Nu sunt cuvintele publicației.

Unitree, NVIDIA and Multiple Universities Launch WorldOracle, a World Model Evaluation Platform

36Kr19 octombrie 20261 min de cititArticolul și perspectiva sunt în engleză.

36Kr reports that Unitree, NVIDIA, and researchers from multiple universities have officially launched WorldOracle, a world model evaluation platform now open for submissions. The platform uses 335 real-world operation trajectories, with approximately one-third of interactive segments containing failures or suboptimal actions, to validate model prediction capabilities based on actual execution results. Testing seven world models revealed that while some can accurately replicate robotic arm movements, they still show significant deviations in predicting object states, and performance drops noticeably over longer time horizons.

Citește articolul complet pe 36Kr

Citește pe 36Kr ↗Întreabă despre acest articol