state space models

also referred to as: state space model

4 statements across 3 episodes · 3 bullish · 0 bearish · 3 people on the record · first statement Jan 22, 2026 by Dan Fu · across every show →

Everything said about state space models, oldest first

Jan 22, 2026 positive

Assertion Not checkable as stated

Dan Fu: Some top audio models use state space architectures

“So some of the best audio models in the world are at least partially based on state space models.”

Dan Fu Jan 22, 2026 ▶ 1:02:29 The End of GPU Scaling? Compute & The Agent Era — Tim Dettmers (Ai2) & Dan Fu (Together AI)

May 7, 2026 neutral

What-if

AI capabilities would have been achieved even without inventing transformers

“I think if we hadn't invented the transformer, we would have gotten there with whatever LSTM you know, state space model, whatever, anything else people were developing, we would have gotten there.”

Zico Kolter May 7, 2026 ▶ 1:08:19 OpenAI Board Member Zico Kolter: Modern AI Is Just 200 Lines of Code

Jul 2, 2026 positive

Assertion Partly supported

Catanzaro: Hybrid state-space transformer architectures are widely adopted in frontier AI

“It's become, I think, Quite widely adopted to use some sort of state space model in conjunction with full attention for the base architecture.”

Bryan Catanzaro Jul 2, 2026 ▶ 41:45 Inside Nemotron & NVIDIA’s AI Lab | Bryan Catanzaro

Jul 2, 2026 positive

Assertion Supported

Catanzaro: Combining SSMs and transformers produces smarter AI models than either alone

“Using both of these together was actually better than using either one on their own. And that is independent of the speed benefit. That is just the model is smarter.”

Bryan Catanzaro Jul 2, 2026 ▶ 41:10 Inside Nemotron & NVIDIA’s AI Lab | Bryan Catanzaro

state space models

Everything said about state space models, oldest first

Turn any episode into a week of clips.