LeCun: All of OpenAI and the AI world runs on PyTorch
Yann LeCun · Yann LeCun: Meta’s New AI Model LLaMA; Why Elon is Wrong about AI; Open-source AI Models | E1014 · 20VC with Harry Stebbings · May 15, 2023 · at 25:39
Yann LeCun, Chief AI Scientist at Meta, explains how Meta's open-source strategy benefits the AI ecosystem, noting that competitor OpenAI built ChatGPT using PyTorch, an AI framework developed by Meta.
0:00 / 0:10exact quote · 10.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“ChatGPT was developed on PyTorch. Okay. All OpenAI runs on PyTorch. The entire world, in fact, runs on PyTorch, except Google, because they have their own thing, right?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Yann LeCun
LeCun: AI hard takeoff fears are false; no real-world exponential lasts
“So this is predicated on an assumption that is just false, which is the existence of a hard takeoff. Right? So the fact that the minute you turn on a super intelligent AI system is going to take over the world. And it's going to escape your control and it's go…”
Expert: Superintelligence does not imply a desire to dominate humans
“There is this idea, somehow, the desire to, and the ability to dominate, is linked with intelligence. A statement that a lot of people are making, including Jeff Hinton recently, That somehow, as soon as a machine becomes intelligent, it becomes uncontrollable…”
LeCun: Human-level AI will not be achieved using autoregressive LLMs
“Well, so first of all, there is no question that eventually AI systems will understand the world in similar ways that, that humans do perhaps better ways but there will not be autoregressive large language models as a type that we're now talking about.”
LeCun: Autoregressive LLMs will be obsolete within a few years
“So my prediction is that within a few years, nobody in their right mind would use auto-reversive LLMs. They'll go away in favor of something more sophisticated and controllable. They can plan its answer as opposed to just produce one word after the other react…”