Mensch: Mistral operates on 1.5k GPUs, a fraction of competitors' compute
Arthur Mensch · Arthur Mensch: Open vs Closed - Who Wins and Mistral's Position | E1146 · 20VC with Harry Stebbings · Apr 29, 2024 · at 0:07
Arthur Mensch is the co-founder and CEO of Mistral AI. He explains the compute constraints facing Mistral compared to well-funded US competitors in early 2024.
0:00 / 0:07exact quote · 7.1s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“We are still bottlenecked by compute for sure, but that's because we don't have many of it. We have 1.5 k 800, which is a few percent of our competitors.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Arthur Mensch
Mensch: Cloud investments in AI startups resemble round-tripping
“It looks like around flipping. Yes. I don't know about that deal particularly, but it makes sense from both perspectives.”
Mensch: A team of five is faster than fifty unless uncoupled
“A team of five is faster than a team of 50. Except if you organize the team of 50 to be 10 teams of five that are sufficiently uncoupled.”
Mensch: DeepMind's initial Gemini development was too slow before recovering
“Gemini was a bit too slow, and I think they recovered sufficiently well since.”
Mensch: AI models will become merely starting points for developers
“And so I think that's the end state is models are effectively going to be A starting point for any AI application developer. They need to be surrounded by tools, by lifecycle management platform basically, and that's the one thing that we started to build.”
Mensch: AI application differentiation comes from data and user feedback
“Like general purpose models are a bit undifferentiated, but the differentiation that you need to create for your application comes from the data you put into it, the user feedback that you gather and the intelligence that you have to figure out what the applic…”