Sutskever: The most surprising AI emergent behavior is feeling understood when speaking to it
Ilya Sutskever · No Priors Ep. 39 | With OpenAI Co-Founder & Chief Scientist Ilya Sutskever · Nov 2, 2023 · at 14:41
OpenAI co-founder and Chief Scientist Ilya Sutskever reflects with Elad Gil on the transition of neural networks from non-functional to producing emergent conversational capabilities.
0:00 / 0:07exact quote · 7.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think maybe the most surprising, if I had to pick one, it would be the fact that when I speak to it, I feel understood.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Ilya Sutskever
Sutskever: AGI causing universal unemployment is 'not impossible'
“If you believe that the technology that we are building, AGI, could potentially be so capable as to do every single task that people do, does it mean that it might unemploy everyone? Well, I don't know, but it's not impossible.”
Sutskever: Transformers can reach AGI; alternatives only offer compute efficiency
“So it's better to think about it in terms of compute efficiency rather than in terms of, can it get there at all? I think at this point, the answer is obviously yes.”
Sutskever: A nonprofit cannot build large compute clusters for frontier AI
“The appetite for compute is truly endless as now clearly seen, but we realized that we will need a lot. And a nonprofit was, wouldn't be the way to get there. Wouldn't be able to build a large cluster with a nonprofit.”
Sutskever: AGI requires massive compute engineering projects, not small research efforts
“Because if you imagine how an AGI should look like, it has to be some kind of a big engineering project that's using a lot of compute, right? Even if you don't know how to build it, what that should look like, you know that this is the ideal you want to strive…”
Sutskever: Training will deepen AI insight into the human world
“As we train them, they gain more and more insight into the true nature of the human world. And their insight will continue to deepen.”
Sutskever: Reliability is the biggest bottleneck to truly useful AI models
“I would actually point out that the main thing that's lost when you switch to the smaller models is reliability. I would argue that at this point it is reliability that's the biggest bottleneck to these models being truly useful.”