Secure Da Bag
Veteran
Tesla Built a Supercomputer to Develop Camera-Only Self-Driving Tech - ExtremeTech
Tesla Is Developing a Self-Driving System That Only Uses Cameras
Tesla Is Developing a Self-Driving System That Only Uses Cameras
The Dojo supercomputer has a lot more processing power than even a fleet of Teslas. According to Tesla’s Andrej Karpathy, the system has 5,760 GPUs with 1.8 exaflops of processing power and 10 petabytes of NVMe storage with a maximum throughput of 1.6 terabytes per second. The team will train Dojo with mountains of camera footage to teach it how to understand and map the world around a car.
If Tesla’s plan works, Dojo should be able to run on a car’s computer and interpret camera data locally. Tesla will need to do a lot of testing to ensure the system is safe before it can drop the lidar tech, but this could give it yet another big advantage over traditional automakers, many of which are lagging far behind on autonomous technology.
During a workshop talk on Autonomous Driving at CVPR 2021, Karpathy explained how the LiDAR approach relies on a HD map being created beforehand and then localizing to that map when driving around. Tesla's approach does everything locally, relying on the video feed from eight cameras mounted on the vehicle. Karpathy says it's the much more difficult approach, but it's also much more scalable than the LiDAR + HD map alternative because you simply can't update the map data quickly enough.