on-chip RAM
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Sep 6, 2023 by Ben Gilbert · across every show →
Everything said about on-chip RAM, oldest first
Sep 6, 2023 neutral
On-chip memory capacity is the primary hardware bottleneck in AI training
“The constraint today is actually in how much high-performance memory is available on the chip. These models need to be in memory all at the same time, and they take up hundreds of gigabytes. So while memory has scaled up, I mean, we're gonna get flashing all t…”