Modular

14 statements across 3 episodes · 5 bullish · 2 bearish · 3 people on the record · first statement Feb 19, 2024 by Erik Bernhardsson · said 44 times in 14 episodes since 2023 · across every show →

Mentions by year

brought up most by Shawn Wang (15), Chris Lattner (11), Alessio Fanelli (7), Tri Dao (1)

tap a year for its mentions
001533062023202420252026episodesmentions
0362023202420252026episodes it came up in
002.53562023202420252026episodesmentions per episode
2026 3 mentions in 2 episodes 2 per episode
2025 30 mentions in 6 episodes 5 per episode
2024 7 mentions in 4 episodes 2 per episode
2023 4 mentions in 2 episodes 2 per episode

every mention, scene by scene, with the transcript →

Everything said about Modular, oldest first

Feb 19, 2024 neutral
Prediction Not checkable as stated
VCs Will Eventually Force Modular to Offer a Hosted Cloud Service
“I'm sure their VCs at some point are gonna force them to reconsider.”
Erik Bernhardsson Feb 19, 2024 ▶ 33:58 Truly Serverless Infra for AI Engineers - with Erik Bernhardsson of Modal
Mar 6, 2024 negative
Opinion
Chintala: Deep PyTorch-Mojo integration lacks synergy because Mojo replaces PyTorch frontend
“Mojo as a fundamental frontend would be replacing PyTorch, not, like, augmenting PyTorch. So, in that sense, I don't see a synergy in more deeply, like, integrating Mojo.”
Soumith Chintala Mar 6, 2024 ▶ 15:57 Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI
Jun 13, 2025 bullish
Disclosure
Modular will soon launch support for AMD MI300 and MI325 GPUs
“We're about to launch our AMD and my 303 25 support. That'll be a big deal for the industry.”
Chris Lattner Jun 13, 2025 ▶ 5:21 The Shape of Compute (Chris Lattner of Modular)
Jun 13, 2025 positive
Assertion Supported
Modular beat Intel MKL matrix multiplication speed in its first year
“First year was prove compilation philosophy. And so this was writing very abstract compiler stuff. And then prove that we can make a matrix multiplication go faster than Intel MKL's matrix multiplication on Intel Silicon and make it configurable and multiple D…”
Chris Lattner Jun 13, 2025 ▶ 7:06 The Shape of Compute (Chris Lattner of Modular)
Jun 13, 2025
Assertion Partly supported
Modular has open-sourced 650,000 lines of Mojo code
“Modular is Mojo's first customer. Like we have more Mojo code in our repository than any other language. And it's open source. Like, and we open source like 650,000 lines of Mojo code.”
Chris Lattner Jun 13, 2025 ▶ 47:44 The Shape of Compute (Chris Lattner of Modular)
Jun 13, 2025 neutral
Insight
AI training scales with research teams; inference scales with customer base
“Training scales the size of your research team. Inference scales the size of your customer base.”
Chris Lattner Jun 13, 2025 ▶ 59:12 The Shape of Compute (Chris Lattner of Modular)
Jun 13, 2025 negative
Opinion
Lattner calls vLLM a 'hot mess' due to too many stakeholders
“VLM seems much more like a massive community with a lot of stakeholders, a lot of stuff going on, and it's kind of a hot mess.”
Chris Lattner Jun 13, 2025 ▶ 23:52 The Shape of Compute (Chris Lattner of Modular)
Jun 13, 2025 positive
Assertion Partly supported
First-time Mojo developers built a GPU training system in one day
“The winning team for the hackathon took that four person team. And one day they had not used Mojo before they hadn't programmed GPUs before. And they had built a training system. They wrote an atom optimizer, a bunch of training kernels. They built a simple ba…”
Chris Lattner Jun 13, 2025 ▶ 6:06 The Shape of Compute (Chris Lattner of Modular)
Jun 13, 2025 positive
Assertion Not publicly verifiable
Modular's Mojo FlashAttention beats Tri Dao's reference implementation
“We're beating the tree DAO reference implementation that everybody uses, for example, right? Written fully in Mojo. Again, all of our, GPU kernels are written in Mojo. You can go see the history of the team building this, and it was done in just a few weeks, r…”
Chris Lattner Jun 13, 2025 ▶ 30:59 The Shape of Compute (Chris Lattner of Modular)
Jun 13, 2025
Disclosure
Modular monetizes cluster management and support on a per-GPU basis
“If you want cluster management, and you want enterprise support, and you want things like this, then you can pay on a per GPU basis, and you can contact our sales team, and then we can work out a deal, and we can work with you directly.”
Chris Lattner Jun 13, 2025 ▶ 42:19 The Shape of Compute (Chris Lattner of Modular)
Jun 13, 2025
Disclosure
Modular's Mojo and MAX are free on NVIDIA and CPUs
“The max framework and the mojo language, free to use on NVIDIA and CPUs, any scale, go nuts, do whatever you want.”
Chris Lattner Jun 13, 2025 ▶ 41:47 The Shape of Compute (Chris Lattner of Modular)
Jun 13, 2025
Disclosure
Modular completely eliminates and replaces NVIDIA's CUDA stack
“In the case of Modular, we go literally, like, we only work at that level, because we get rid of all of CUDA, right? And so we've replaced the entire stack, and so we only do that.”
Chris Lattner Jun 13, 2025 ▶ 55:03 The Shape of Compute (Chris Lattner of Modular)
Jun 13, 2025 neutral
Disclosure
Modular's team has grown to over 100 employees
“So we're a small team. I mean, we're over a hundred people, but we're compared to the size of the problem we're taking on.”
Chris Lattner Jun 13, 2025 ▶ 32:26 The Shape of Compute (Chris Lattner of Modular)
Jun 13, 2025 bullish
Prediction Not checkable as stated
An industry-leading state-of-the-art AI model may launch on MAX soon
“We may have an industry leading state of the art model launching first on Mac soon.”
Chris Lattner Jun 13, 2025 ▶ 43:16 The Shape of Compute (Chris Lattner of Modular)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.