Chintala: Meta built FAIR because AI capabilities rate-limited Meta's product development
Soumith Chintala · Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI · Mar 6, 2024 · at 1:02:44
Soumith Chintala, creator of PyTorch and Meta AI Fellow, explains the original corporate thesis behind Meta establishing the FAIR open research lab.
0:00 / 0:44exact quote · 44.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And for, then, like, the thesis was very simple. It was, like, AI is currently rate-limiting Meta's ability to do things. Our ability to build various product integrations, moderation, various other factors. Like, AI was the limiting factor, and we just wanted AI to advance more, and we didn't care if the IP of the AI was uniquely in our possession or not. For us, like, however the field advances, that accelerates, like, Meta's ability to build a better product. So we just built, like, an open AI lab, and we said, if this helps accelerate the progress of AI, that's strictly great for us.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Soumith Chintala
Chintala: George Hotz's TinyGrad requires major breakthroughs to match PyTorch
“There's no, like, I don't think, like, unless we have, like, great breakthroughs, like, George's vision is achievable, like, or, like, he should be thinking about a narrower problem, such as, I'm only gonna make this for, like, work for self-driving car con ne…”
Chintala: Apple's MLX will fail server-side due to lack of differentiation
“If they end up expanding onto the server side, and they'll probably build something like PyTorch as well, right? Like, eventually, that'll where it will land. And I think there, they will kind of fail on the, like, lack of differentiation. Like, it wouldn't be…”
Chintala: Inference Moats from Fast CUDA Kernels Last Only Months
“I think, like, Together and Fireworks and all these people are trying to build some faster CUDA kernels and faster, like, you know, hardware kernels in general. But those modes only last for a month or two. Like, these ideas quickly propagate.”
Chintala: Simple AI frameworks must accept long compile times
“You can write a very simple framework but then you also should be willing to eat the long compile times of, like, searching for that optimal performance at runtime.”
Chintala: Nvidia's primary competitive moat is NVLink interconnect, not GPU silicon
“The mode that Nvidia has right now, I feel like, is that they're, they have the interconnect that no one else has. Like, AMD GPUs are pretty good. I'm sure there's very silicon that is not bad at all, but, like, the interconnect like, NVLink is uniquely awesom…”
Chintala: LLM inference market will become a low-margin laundromat business
“My view of the LLM inference market in general is that it's like the laundromat model. Like you, the margins are going to drive down towards the bare minimum, like It's gonna be all kinds of arbitrage between how much you can get the hardware for, and then how…”