StarZero All shows Try the podcast clipper →

Jamba

includes Jamba 3B

0 statements across 0 episodes · 4 bullish · 0 bearish · 3 people on the record · first statement Dec 24, 2024 by Dan Fu · said 19 times in 5 episodes since 2024 · across every show →

Mentions by year, the whole family

brought up most by Barak Lenz (7), Shawn Wang (2), Quentin Anthony (1), Eugene Cheah (1), Dan Fu (1)

tap a year for its mentions
0081152202420252026episodesmentions
012202420252026episodes it came up in
004182202420252026episodesmentions per episode
2026 2 mentions in 1 episode
2025 14 mentions in 2 episodes 7 per episode
2024 3 mentions in 2 episodes 2 per episode

every mention, scene by scene, with the transcript →

Everything said about Jamba, oldest first

Dec 24, 2024 positive
Assertion Not checkable as stated
Fu: AI21's Jamba Is the State of the Art Non-Transformer Model
“AI-II trained this hybrid MOE called Jamba that, that, that seems, that is currently the state of the art for these non-transformer architectures.”
Dan Fu Dec 24, 2024 ▶ 16:50 2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]
Dec 24, 2024 positive
Insight
Cheah: Hybrid SSM-transformer models outperform pure baselines of both
“None of us understand why a hybrid with a state-based model, the RWA state space, and transformer performs better than the baseline of both. It's like when you train one, you expect, and then you replace, you expect the same results. That's our pitch. That's o…”
Eugene Cheah Dec 24, 2024 ▶ 28:15 2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]
Oct 11, 2025 positive
Assertion Contradicted
Lenz: AI21's Jamba is the first hybrid model architecture
“Since then, we've released several models, recent model lines in called Jamba, which I think the fascinating part about it is, is the first hybrid model. It's not just attention.”
Barak Lenz Oct 11, 2025 ▶ 2:20 Building Jamba 3B: the tiny Hybrid Transformer State Space Reasoning Model - Barak Lenz, CTO of AI21
Oct 11, 2025 positive
Insight
Lenz: Middle attention placement at 1:8 ratio optimizes hybrid models
“Putting it the first or the last performed worse than in the middle. And one to eight was good enough. You know, you might get very slight improvements with one to six, but it was marginal, maybe within the standard deviation.”
Barak Lenz Oct 11, 2025 ▶ 10:16 Building Jamba 3B: the tiny Hybrid Transformer State Space Reasoning Model - Barak Lenz, CTO of AI21
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more