Dense Matrix Multiplications

topic on 1 show · 1 statements across 1 episodes

20VC

1 statements about Dense Matrix Multiplications, every show

20VC Insight
Shazeer: Deep Learning Succeeds Because Hardware Is Optimized for Dense Matrix Multiplication
“The reason this whole field is working so well is because Now we have this magic hardware that's great at these dense matrix multiplications. And so you can do them like orders of magnitude faster than you can do anything that involves poking around in memory.”
Noam Shazeer Aug 31, 2023 ▶ 34:24 Noam Shazeer: How We Spent $2M to Train a Single AI Model and Grew Character.ai to 20M Users | E1055 · 20VC with Harry Stebbings

← every entity, every show

Made with StarZero

Turn any episode into a week of clips.

This entire site, thousands of episodes across every show transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.