Bandwidth
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Sep 14, 2023 by Illia Polosukhin · across every show →
Everything said about Bandwidth, oldest first
Sep 14, 2023 bearish
Polosukhin: Decentralized AI training is unrealistic due to GPU bandwidth requirements
“And the reality right now that the requirements on bandwidth, right? Like people who are training these models right now, they have like a, you know, 800 gigabit connect right between the GPUs, right? So Maybe you have a hundred megabits on between this, usual…”