Catanzaro: The greatest risk with AI is failing to adopt it
Bryan Catanzaro · NVIDIA's Artifical Intelligence Moat & Origins — With Bryan Catanzaro · Feb 28, 2024 · at 56:04
Bryan Catanzaro, VP of applied deep learning research at NVIDIA, assesses existential risks surrounding AI technology.
0:00 / 0:13exact quote · 13.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think the scariest thing for me is you know, are we gonna you know, not figure out how to use this technology? Because I think we desperately need it. I think our world desperately needs more intelligence.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Bryan Catanzaro
Catanzaro: Humans will primarily interact with AI inside virtual worlds
“And I think that the primary way that people are going to interact with AI is going to be in virtual worlds. Because I think that's going to be the most natural way of interaction in the most useful way.”
Catanzaro: Training data and compute matter more than AI model architecture
“The model is less important than the data. And the compute that goes into training the model. If you have a model that has really excellent compute properties that allows you to scale really well, efficiently to, you know, many thousand of GPUs, the kinds of r…”
Catanzaro: ChatGPT signaled an era where applied AI research dominates academics
“To me, that was a statement that we were entering a new era of AI where applied research starts to dominate, you know, so Chachapiti didn't come out with a fully fledged academic paper that described exactly what they did to make it so awesome. But because the…”
Catanzaro: About 40% of NVIDIA data center GPUs go to inference
“Jensen said in the earnings call this week that somewhere around 40% of our data center GPUs were going for inference, which I think is you know, pretty amazing and definitely a shift from where things have been a few years ago.”
Catanzaro: NVIDIA Hopper GPUs feature superior circuits designed by internal AI
“Our hopper GPUs, for example, have a lot of circuits in them that were designed by AI that we built ourselves that have better speed and power and cost characteristics than we knew how to build with any other tool.”
Catanzaro: AI community would have found a Transformer alternative without Google
“If Google had not open source that or had not published that paper but if we started seeing like incredible language modeling results we would have figured out some sort of a model that had good scalable properties that that could help with this space.”