Chintala: Smell and touch digitization is where images were in 1920
Soumith Chintala · Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI · Mar 6, 2024 · at 1:30:23
Soumith Chintala, creator of PyTorch and Meta AI Fellow, compares the maturity of audio and vision computing to digital olfaction and touch.
0:00 / 0:43exact quote · 43.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“When we think about audio, or images, or video, they're, like, so advanced that we have the concept of color spaces, we have the concept of, like, frequency spectrums, like, you know, we figured out how ears process, like frequencies in mouse spectrum, or whatever, like, logarithmically scaled. Images were like RGB, YUV, like we have so many different kinds of parameterizations. We have formalized these two senses ridiculously well. Touch and smell. Nada. We're like where we were with images in, say, in 1920, or maybe even the 1800, right?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Soumith Chintala
Chintala: George Hotz's TinyGrad requires major breakthroughs to match PyTorch
“There's no, like, I don't think, like, unless we have, like, great breakthroughs, like, George's vision is achievable, like, or, like, he should be thinking about a narrower problem, such as, I'm only gonna make this for, like, work for self-driving car con ne…”
Chintala: Apple's MLX will fail server-side due to lack of differentiation
“If they end up expanding onto the server side, and they'll probably build something like PyTorch as well, right? Like, eventually, that'll where it will land. And I think there, they will kind of fail on the, like, lack of differentiation. Like, it wouldn't be…”
Chintala: Inference Moats from Fast CUDA Kernels Last Only Months
“I think, like, Together and Fireworks and all these people are trying to build some faster CUDA kernels and faster, like, you know, hardware kernels in general. But those modes only last for a month or two. Like, these ideas quickly propagate.”
Chintala: Simple AI frameworks must accept long compile times
“You can write a very simple framework but then you also should be willing to eat the long compile times of, like, searching for that optimal performance at runtime.”
Chintala: Nvidia's primary competitive moat is NVLink interconnect, not GPU silicon
“The mode that Nvidia has right now, I feel like, is that they're, they have the interconnect that no one else has. Like, AMD GPUs are pretty good. I'm sure there's very silicon that is not bad at all, but, like, the interconnect like, NVLink is uniquely awesom…”
Chintala: LLM inference market will become a low-margin laundromat business
“My view of the LLM inference market in general is that it's like the laundromat model. Like you, the margins are going to drive down towards the bare minimum, like It's gonna be all kinds of arbitrage between how much you can get the hardware for, and then how…”