Cerebras's chip provides 10,000x the memory bandwidth of standard GPUs
Michael James · Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC) · Feb 20, 2020 · at 13:10
Michael James, Chief Architect at Cerebras, outlines key performance metrics of the Cerebras Wafer Scale Engine compared to traditional GPU architectures during a Data Driven NYC presentation.
0:00 / 0:14exact quote · 14.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“So, having solved this, we were left with a machine that was pretty impressive on most of the metrics, being larger, more cores, 10,000 times the memory bandwidth and 33,000 times the fabric bandwidth.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Michael James
Quantum and optical computing remain 10 to 15 years away from production
“We think that because that's primary research, that, that's a good, ah, 10 to 15 years out, whereas what we looked to do was to take, ah, pre, ah, technology we could manufacture, maybe difficult, but all achievable, so we weren't trying to invent any new law …”
Cerebras built the first supercomputer designed end-to-end for AI
“And it's also the first supercomputer that has been designed from beginning to end for artificial intelligence and deep learning.”
New computing workloads always demand purpose-built hardware
“When we look throughout the history of computing, it has never happened that a new important workload has come along, and the correct answer to that workload was to use some pre-existing equipment that had been designed to do something else”
Von Neumann architecture might not be the right path for AI
“So, so maybe there's a sign that, that we're not on the right track with the architecture we have in, in von Neumann computers.”