NVIDIA Omniverse NuRec adapts perception to new vehicle designs

Changing vehicle designs fundamentally alter how an autonomous vehicle perceives the world; moving perception software from an SUV to a sedan shifts the view of critical elements like traffic light placement and curb visibility. NVIDIA Omniverse NuRec addresses the challenge of adapting this software across new carlines without the prohibitive cost of collecting and labeling entirely new real-world datasets, particularly during early development stages. The system reconstructs real-world driving scenes and renders new camera views specifically for an allowing developers to identify “weak spots” before needing to gather additional data. NuRec uses 3D Gaussian splatting to achieve this, enabling teams to ask questions such as “What would this scenario look like from the target rig?” NuRec utilizes 3D Gaussian splatting, a technique that reconstructs real-world environments from sensor data and renders them for simulation, to address the challenges of adapting autonomous vehicle perception software to new vehicle platforms. This capability allows for the rendering of scenes with…