Mamba
also referred to as: mamba ssm
4 statements across 3 episodes · 3 bullish · 1 bearish · 3 people on the record · first statement Dec 24, 2024 by Eugene Cheah · said 30 times in 10 episodes since 2024 · across every show →
Mentions by year
brought up most by Barak Lenz (8), Shawn Wang (6), Quentin Anthony (3), Eugene Cheah (2), Vipul Ved Prakash (1), Mikhail Parakhin (1), Jack Morris (1), Dan Fu (1)
tap a year for its mentions
2026 1 mention in 1 episode
2025 14 mentions in 4 episodes 4 per episode
- Building Jamba 3B: the tiny Hybrid Transformer State Space Reasoning Model - Barak Lenz, CTO of AI21
- How Zyphra went all-in on AMD + Why Devs feel faster with AI but are slower — with Quentin Anthony
- The AI Agenda: GPT5 leaks and the business of AI News — Steph Palazzolo, The Information
- Information Theory for Language Models: Jack Morris
- every mention in 2025, scene by scene →
2024 15 mentions in 5 episodes 3 per episode
- Building an open AI company - with Ce and Vipul of Together AI
- The Four Wars of the AI Stack - Dec 2023 Recap
- 2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]
- The Winds of AI Winter (Q2 Four Wars of the AI Stack Recap)
- A Comprehensive Overview of Large Language Models - Latent Space Paper Club
- every mention in 2024, scene by scene →
Everything said about Mamba, oldest first
Dec 24, 2024 positive
Cheah: Hybrid SSM-transformer models outperform pure baselines of both
“None of us understand why a hybrid with a state-based model, the RWA state space, and transformer performs better than the baseline of both. It's like when you train one, you expect, and then you replace, you expect the same results. That's our pitch. That's o…”
Oct 11, 2025 positive
Oct 11, 2025 bullish
Lenz: Hybrid Transformer models are here to stay for long context
“If I had to guess hybrid models are here to stay just because the efficiency without sacrificing the performance is, is too much to give up. You know, the attention is so expensive. The quadratic cost and the linear memory cost is so much that I think for long…”
Nov 3, 2025 negative
Groq hardware is too inflexible to run alternative architectures like Mamba SSMs
“Grok is very inflexible hardware so that you kind of, if you want to do like a Mamba SSM on it, you're going to have a really hard time because instead of having like a low level CUDA compiler, like everything is like Designed it at the hardware level, right?”