Cerebras built the first supercomputer designed end-to-end for AI
Michael James · Designing an AI Supercomputer // Michael James, Cerebras (FirstMark's Data Driven NYC) · Feb 20, 2020 · at 0:33
Michael James, Co-Founder and Chief Software Architect at Cerebras, speaks at Data Driven NYC in February 2020 about their purpose-built AI supercomputer architecture.
0:00 / 0:06exact quote · 6.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“And it's also the first supercomputer that has been designed from beginning to end for artificial intelligence and deep learning.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Michael James
Quantum and optical computing remain 10 to 15 years away from production
“We think that because that's primary research, that, that's a good, ah, 10 to 15 years out, whereas what we looked to do was to take, ah, pre, ah, technology we could manufacture, maybe difficult, but all achievable, so we weren't trying to invent any new law …”
New computing workloads always demand purpose-built hardware
“When we look throughout the history of computing, it has never happened that a new important workload has come along, and the correct answer to that workload was to use some pre-existing equipment that had been designed to do something else”
Von Neumann architecture might not be the right path for AI
“So, so maybe there's a sign that, that we're not on the right track with the architecture we have in, in von Neumann computers.”
Cerebras designed a chip as large as possible with interleaved memory
“We decided to build a machine that was as large as we could, that had memory interleaved directly with the computational substrate.”