Autonomous vehicles must analyze pedestrian gait and body language to predict intent
Saswat Panigrahi · Are Autonomous Vehicles Finally Here? Buckle up! · Jun 26, 2023 · at 12:12
Saswat Panigrahi, Chief Product Officer at Waymo, explains machine learning requirements for pedestrian behavior prediction to host Catherine during a driverless ride in San Francisco.
0:00 / 0:12exact quote · 12.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“So for example, for that pedestrian, ah, in addition to seeing that they're there, acknowledging, which was this problem one, you got to look at even their gait, their hand movement, their leg movement to anticipate, are they about to take motion?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Saswat Panigrahi
Debating LiDAR versus cameras is just choosing between wavelengths, says Waymo CPO
“Saying you love lidars and hate cameras or vice versa is saying you love one wavelength versus the other wavelength, right? It's not a fundamental thing.”
Panigrahi: Multi-sensor suites outperform camera-only autonomous driving systems
“Does the combination of these sensors position you better than individual. The answer is yes. We can show you that there are situations in which camera will be insufficient.”
Level 3 versus Level 4 autonomy is like driving versus flying
“No, no, I would say a vast difference even between level three and level four. Huge. It's almost a difference between driving and flying, I would say.”
Autonomous vehicles require full-stack hardware and software to maintain iteration speed
“And the technology, and it really required the full stack, right? We build the hardware, we build the software, because if you built just the software and waited for somebody else to deliver the hardware, the speed of learning, the speed of iteration that was …”
Panigrahi: Waymo dramatically reduced LiDAR hardware costs over two years
“The amount we have been able to cost down these LiDARs in the last two years is incredible.”
Google's early machine learning infrastructure investments created Waymo's competitive moat
“Really the breakthrough engineering that you sometimes need in AI is just having the raw infrastructure to intake all this data. The amount of data you have to learn to handle to build a really, you know, well-learned algorithm is pretty hard, and that's where…”