Mamba, every mention

mentionsepisodesper episode tap a year for its mentions

Verbatim, from the transcripts: the passages where Mamba comes up

loading…

▶ 1:05:46 Mikhail Parakhin Transformer, like in Mamba fashion, they probably the best architecture I'm aware of, like, period.

▶ 1:12 unnamed speaker I think some people might be familiar with some of the like Mamba adjacent models that you released in the past, but how should people think about what you work on and the current research direction you're in?
▶ 22:42 Quentin Anthony So like it's very, Grok is very inflexible hardware so that you kind of, if you want to do like a Mamba SSM on it, you're going to have a really hard time because instead of having like a low level CUDA compiler, like everything is like
▶ 58:55 Quentin Anthony That's why we jumped on Mamba. 2 times in the scene

▶ 5:42 Barak Lenz But then as we were doing the, the ablations, I, I came across the Mamba paper and it actually was pointed out to me by, by several people. 8 times in the scene

▶ 1:10:54 Shawn Wang There are some notable exceptions, primarily together with the Mombard architecture, um, recursal with RWKV.

▶ 1:09:01 Jack Morris That's like, for whatever reason, like the kind of most glamorous thing people think you can do as a researcher, like Mamba, it's like,

▶ 11:34 Dan Fu Um, if you've heard of the Mamba model, this, this also takes this selection to, to the next level by actually making some changes in that, uh, fundamental recurrent state space.
▶ 24:50 Eugene Cheah And, and I believe together AI worked on the law cats for, for the Mamba side of things, and, and we took some ideas from there as well, and we essentially did that for RWKV. 2 times in the scene

▶ 19:37 unnamed speaker I will call out, um, you know, they, they have some interesting experimentations with Mamba, and Mistral Nemo is actually on the efficiency frontier chart that I drew that is still relevant.

▶ 26:50 unnamed speaker Cuma sedikit ekstra, ini adalah salah satu topik yang sangat biasa yang mereka ingin memulai semasa mereka masuk keadaan seperti model Mamba anda.

▶ 42:54 Vipul Ved Prakash We know that this, you know, system B is better for, uh, Mixtrol, and system C is going to be better for Stripe Tine or Mamba.
▶ 55:37 Shawn Wang Um, and, uh, I mean, first of all, I'll throw that open to you, but second of all, I think what Mamba did for me was change that perception of that it's only about a long context. 5 times in the scene

▶ 35:25 unnamed speaker And then, obviously, uh, RWKV and Mamba and Stripe, Stripe Tyena from, um, together. 4 times in the scene

Turn any episode into a week of clips.