Core AI Intelligence Will Primarily Emerge From Text Models
Noam Shazeer · No Priors Ep. 12 | With Noam Shazeer · Apr 25, 2023 · at 8:29
Character.AI co-founder Noam Shazeer discusses the long-term role of text models versus multimodal AI architectures.
0:00 / 0:05exact quote · 5.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“But I think that a lot of the core intelligence is going to come from these text models.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Noam Shazeer
Shazeer: Most Core AI Intelligence Will Come From Text Models
“But I think that a lot of the core intelligence is going to come from a From these text models.”
Shazeer Calls Next-Token Prediction an AI-Complete Problem
“And like, the problem is super simple to define. It's just like predict the next word, the fat cat sat on the, you know, like, okay, well, you know, what comes next? Like it's extremely easy to define. And if you can do a great job of it, like, you know, then …”
AI Scaling Has Not Hit a Wall and Will Keep Improving
“So, and at the same time, like, I don't think anyone's seen a wall in terms of how good this stuff is. So I think it will just, it's just gonna keep getting better. I don't know what stops it.”
AI Models Can Generate Synthetic Data to Avoid Looming Shortages
“I think I'm not that worried about Coming up with data and I feel like we could probably like just generate some more with the AI.”
AI Assistants With a Single Neutral Corporate Persona End Up Boring
“Like if you're like such a public, you know, trying to present like one public persona that everyone likes, you're going to end up just being boring essentially. And people just don't want boring. You know, people want like the, you know want to interact with …”
Deep Learning Succeeded Because It Matches Modern Chip Hardware
“Really the key insight is that what makes deep learning work is that it is really well suited to modern hardware where, you know, you have the current generation of chips that are great at Matrix multiplies and, you know, other, other forms of things that requ…”