Tesla’s VP of AI/Autopilot software, Ashok Elluswamy, has offered a rare inside look at how the company’s AI system learns to drive. After speaking at the International Conference on Computer Vision, Elluswamy shared details of Tesla’s “end-to-end” neural network in a post on social media platform X.

How Tesla’s end-to-end system differs from competitors

As per Elluswamy’s post, most other autonomous driving companies rely on modular, sensor-heavy systems that separate perception, planning, and control. In contrast, Tesla’s approach, the VP stated, links all of these together into one continuously trained neural network. “The gradients flow all the way from controls to sensor inputs, thus optimizing the entire network holistically,” he explained.

He noted that the benefit of this archit

See Full Page