Shapiro: NVIDIA can train regional LLMs on localized traffic laws
Danny Shapiro · NVIDIA's Auto Play and the Future of Autonomous Driving — With Danny Shapiro · Jul 31, 2024 · at 22:35
Danny Shapiro, VP of Automotive at NVIDIA, discusses how NVIDIA's AI architecture can build localized foundation models tailored to specific regional driving laws and signage.
0:00 / 0:21exact quote · 21.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The technology is there so that we can train it on what are the laws of a particular region? I mean, the signs, the light signals, the lane markings in different regions of the country or around the world. Differ quite a bit, and so basically creating these large language models for each region that understands what you're allowed, what the car is allowed to do and not to”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Danny Shapiro
Shapiro: Highway autonomous driving is a solved problem
“So the basics are easy when you can drive down the freeway. Cars are all going in the same direction. There's no pedestrians. There's good lane markings. That's really a solved problem.”
Shapiro: Every Mercedes will be built on NVIDIA DRIVE platform
“So every Mercedes will be built on NVIDIA drive with the software that we've developed and rolled out by NVIDIA. So it starts with that C-class vehicle, and then we'll go through their entire line over time.”
Shapiro: Autonomous vehicle safety requires combining cameras, radar, and lidar
“This diversity and redundancy is really how you get higher levels of safety. So cameras are great, but they don't work in all conditions, and so when you combine radar, when you combine lidar, you have the strengths of many different types of sensors, and they…”
Shapiro: Tesla's camera-only system can probably reach full autonomy eventually
“Whereas I do have a Tesla and it's quite remarkable being camera based, but every once in a while, I still need to jump in and grab the wheel. So it's not there yet. Can it get there? I think it probably can eventually, but it's not there today.”
Shapiro: NVIDIA is the only company offering a three-computer AV stack
“So NVIDIA is the only company that has these three computers, and it's really this whole life cycle of developing, testing, and deploying the software, and really it's a continuous flywheel.”
Shapiro: NVIDIA operates with dynamic virtual teams rather than rigid org charts
“Kind of come second, and in fact, the notion of the group is kind of dynamic, and we really don't have much of an org chart in the company. Jensen says the mission is the boss, and so we have these virtual teams. There's a lot of cross-functional work that goe…”