Drivers predict self-driving car actions better with AI insights

Researchers at the Massachusetts Institute of Technology and Motional AD Inc. have developed a method to improve how humans understand the decisions made by self-driving cars. The team introduced the Concept-Wrapper Network, or CW-Net, which explains a vehicle’s actions using concepts readily understood by people without reducing driving performance. Deploying CW-Net in a real self-driving car, the researchers demonstrated that the resulting explanations improve a driver’s ability to predict the vehicle’s behavior, especially in unexpected scenarios; this addresses a critical safety gap. The work establishes a pathway to interpretability for autonomous agents and could extend to other safety-critical systems. The challenge of predicting when self-driving car artificial intelligence will fail hinders real-world testing of interpretability solutions, creating a critical safety gap beyond simply achieving autonomous driving. While numerous studies attempt to understand these, most remain limited to simulated environments, leaving practical application largely unproven. This distinction is key; many existing explainability techniques sacrifice accuracy in the pursuit of transparency, a trade-off CW-Net seeks to avoid. CW-Net functions by replacing the final layer of a self-driving car’s existing deep neural network with a classifier, followed by a new reward layer. This classifier and new reward layer are then jointly trained to…