Murati: Reaching AGI will likely require breakthroughs beyond pure model scaling
Mira Murati · Where We Go From Here with OpenAI's Mira Murati · Sep 25, 2023 · at 18:07
OpenAI CTO Mira Murati discusses whether scaling compute and data alone will lead directly to Artificial General Intelligence.
0:00 / 0:19exact quote · 19.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Whether that takes you all the way to AGI or not, that's a different question. There are probably some other breakthroughs and advancements needed along the way, but I think there's still a long way to go in In the scaling laws and to really gather a lot of benefits from these larger models.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Mira Murati
Murati: Scaling RLHF alone might be sufficient to solve AI hallucinations
“And we also wanted to figure out the issue of hallucinations, which is always an extremely hard problem. But I do think that with this method of tree enforcement learning with human feedback, maybe that is all we need if we push this hard enough.”
Murati: AGI will be the most important technology humanity builds
“There's not going to be a more important technology that we all build than AGI.”
Murati: OpenAI had already trained GPT-4 before releasing ChatGPT
“One thing that people forget is that actually at this time we had already trained GPT-IV. And so internally at OpenAI, we were very excited about GPT-IV and sort of Put Chagipiti in the rearview mirror.”
Murati: Developing AGI in a lab vacuum without user feedback is impossible
“It would not be possible to just, you know, sit in a lab and develop this thing in a vacuum without feedback from users from the real world.”