Houston: Groq and Cerebras outperform Nvidia on latency
Drew Houston · Building the Silicon Brain - Drew Houston of Dropbox · Oct 18, 2024 · at 52:59
Dropbox CEO Drew Houston discusses alternative AI silicon architectures compared to Nvidia.
0:00 / 0:10exact quote · 10.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“There's also, like, non-NVIDIA stacks, like the Grok, or Cerebris, or some of these custom silicon companies that are super interesting, and all, and outperformed the NVIDIA stack in terms of latency and things like that.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Drew Houston
Drew Houston: Large language models are a rapidly self-commoditizing, bad business
“Large language models are a pretty bad
Business from a, you know, you sort of take off your tech lens and just sort of business lens. Like there's sort of this weirdly self-commoditizing thing where, you know, models only have value if they're kind of on this…”
Houston: Fully autonomous AI knowledge workers will take a long time
“People sort of skip to like level five full autonomy, or we're going to have like an autonomous knowledge worker that's just going to take, that's going to, and then we won't need humans anymore kind of Projection that that's going to take a long time, but the…”
Drew Houston: Massive AI price-performance gains wouldn't happen without open source
“You've seen like the price performance of these models improve 10 or a hundred X year over year, which is, it's sort of like many Moore's laws compounded together. For a bunch of reasons. Like, that wouldn't have happened without open source, right?”
Drew Houston: AI hardware is currently in a 'rent, not buy' phase
“The simplest way I think about it is like, this is sort of a rent, not buy phase. Cause you know, I wouldn't want to be, we were still so early in the maturity. I, you know, I wouldn't want to be buying like pallets of over, like of Two eighty-sixes at a five …”