CUDA kernels
3 statements across 3 episodes · 1 bullish · 1 bearish · 3 people on the record · first statement Mar 6, 2024 by Soumith Chintala · across every show →
Everything said about CUDA kernels, oldest first
Mar 6, 2024 bearish
Chintala: Inference Moats from Fast CUDA Kernels Last Only Months
“I think, like, Together and Fireworks and all these people are trying to build some faster CUDA kernels and faster, like, you know, hardware kernels in general. But those modes only last for a month or two. Like, these ideas quickly propagate.”
Jul 5, 2024
Aug 15, 2025 bullish
Brockman: AI models will soon get very good at CUDA kernels
“Things like Cuda kernels are a good example of a very self-contained problem that actually our models should get very good at very soon, but it's just difficult because it requires a lot of domain expertise, a lot of like real abstract thinking. But again, it'…”