Wafer Scale Engine

4 statements across 1 episodes · 2 bullish · 0 bearish · 1 people on the record · first statement Feb 20, 2020 by Michael James · across every show →

Everything said about Wafer Scale Engine, oldest first

Feb 20, 2020 bullish
Assertion Supported
Cerebras's chip provides 10,000x the memory bandwidth of standard GPUs
“So, having solved this, we were left with a machine that was pretty impressive on most of the metrics, being larger, more cores, 10,000 times the memory bandwidth and 33,000 times the fabric bandwidth.”
Michael James Feb 20, 2020 ▶ 13:10 Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC)
Feb 20, 2020 positive
Assertion Supported
Cerebras routes around manufacturing defects across its 400,000 cores
“By having 400,000 independent cores, it's perfectly fine if we have a few hundred defects on there, and it's only our job to route the information flows around those defects.”
Michael James Feb 20, 2020 ▶ 8:53 Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC)
Feb 20, 2020
Assertion Not checkable as stated
Wafer-scale chips were previously presumed impossible to build
“And when we showed this the world got pretty excited, so there was a large press splash, and in part that's because this had been presumed to be impossible to achieve.”
Michael James Feb 20, 2020 ▶ 8:19 Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC)
Feb 20, 2020
What-if
Traditional power delivery would carry 40,000 amps and melt Cerebras's processor
“We would have 40,000 amps, and that would actually melt the part if we chose to do it that way, so we had to bring some of the geometric thinking beyond how we think geometry in the models into this three D structure.”
Michael James Feb 20, 2020 ▶ 10:02 Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 400 conversations transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.