voice inference
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Mar 6, 2026 by Sudarshan Kamath · across every show →
Everything said about voice inference, oldest first
Mar 6, 2026 negative
Kamath: Nvidia GPUs suffer severe memory bottlenecks during voice inference
“And media chips are generally very bad for voice inference. Like if you have 40 gigabytes of RAM in a NVIDIA GPU, you can generally, if you want to do real time, like a hundred milliseconds, you can use maybe two or four gigabytes of it for our models. And bey…”