Michael James, co-founder and Chief Architect at Cerebras, demonstrates how the Cerebras compiler maps deep learning workloads onto their Wafer Scale Engine hardware.
“We have, ah, an optimization solver that places these over the 400,000 cores.”
quote is from the automated transcript, cleaned for reading:
filler sounds and stutters are removed, nothing is rephrased. names can be misheard
(the analysis reads context, assessments check outside sources). how →
More from Michael James
PredictionOpen · timeframe Feb 2035
Quantum and optical computing remain 10 to 15 years away from production
“We think that because that's primary research, that, that's a good, ah, 10 to 15 years out, whereas what we looked to do was to take, ah, pre, ah, technology we could manufacture, maybe difficult, but all achievable, so we weren't trying to invent any new law …”
Michael JamesFeb 20, 2020▶ 19:33Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC)
AssertionContradicted
Cerebras built the first supercomputer designed end-to-end for AI
“And it's also the first supercomputer that has been designed from beginning to end for artificial intelligence and deep learning.”
Michael JamesFeb 20, 2020▶ 0:33Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC)
Insight
New computing workloads always demand purpose-built hardware
“When we look throughout the history of computing, it has never happened that a new important workload has come along, and the correct answer to that workload was to use some pre-existing equipment that had been designed to do something else”
Michael JamesFeb 20, 2020▶ 4:03Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC)
Opinion
Von Neumann architecture might not be the right path for AI
“So, so maybe there's a sign that, that we're not on the right track with the architecture we have in, in von Neumann computers.”
Michael JamesFeb 20, 2020▶ 5:38Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC)
Disclosure
Cerebras designed a chip as large as possible with interleaved memory
“We decided to build a machine that was as large as we could, that had memory interleaved directly with the computational substrate.”
Michael JamesFeb 20, 2020▶ 6:44Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC)
AssertionSupported
The Cerebras Wafer Scale Engine is the world's largest processor
“This is the world's largest processor.”
Michael JamesFeb 20, 2020▶ 7:13Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC)
Made with StarZero
Turn any episode into a week of clips.
This entire site, over 400 conversations transcribed, diarized, checked and made playable,
runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the
moments worth sharing, cuts them, captions them, and reframes them for every feed.
We use essential cookies to make the site work. With your permission we
also use analytics cookies (Google Analytics and Mixpanel) to understand
usage and improve StarZero. See our Cookie Policy.