Jamba, every mention
11 scenes, the whole family · ← back to Jamba
tap a year for its mentions
every year anyone Barak Lenz 7Shawn Wang 2Quentin Anthony 1Eugene Cheah 1Dan Fu 1
Verbatim, from the transcripts: the passages where Jamba comes up
Next 100x in AI: Inference, Networking, & Self-Optimizing Models — Philip Kiely & Ali Taha, Baseten
- ▶ 55:39 Shawn Wang To see that more people didn't do, uh, Jamba. 2 times in the scene
How Zyphra went all-in on AMD + Why Devs feel faster with AI but are slower — with Quentin Anthony
- ▶ 1:57 Quentin Anthony We wanted the first to that sort of like a Jamba style.
Building Jamba 3B: the tiny Hybrid Transformer State Space Reasoning Model - Barak Lenz, CTO of AI21
- ▶ 2:20 Barak Lenz Since then, we've released several models, recent model lines in called Jamba, which I think the fascinating part about it is, is the first hybrid model. 2 times in the scene
- ▶ 2:33 Barak Lenz And we're actually releasing new versions of our Jamba models soon, including a three B dense model.
- ▶ 4:28 unnamed speaker I think the, uh, we should definitely start with Jamba. 6 times in the scene
- ▶ 13:35 Barak Lenz Jamba is that it starts with, with a large size, you know, Jamba mini is mini for enterprises, but it's not mini for the, for a developer that, you know, has a T four, has his own GPU and he wants to try stuff. 2 times in the scene
- ▶ 22:06 Barak Lenz I want people that know how to work on their own, that are not afraid of very, very tough problems and have a can-do mentality that's like, I don't care if no one did Jumbo before, why couldn't we be the first ones to do it?
- ▶ 42:56 Barak Lenz You know, AI-twenty-month models or not, I, I do think that you need models with different attributes and Jumper is one of them.
2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]
- ▶ 16:50 Dan Fu Um, but as of yesterday, some of the really cool results out of, um, the, these efficient alternative models were, uh, so AI-II trained this hybrid MOE called Jamba, um, that, that, that seems, that is currently the state of the art for…
- ▶ 27:46 Eugene Cheah So yeah, that's, that's what we are working on, and essentially we are excited about this to, to just push it further, and this conversion process, to be clear, I don't think it's going to be exclusive to RWKB, but, um, it probably will…
The Winds of AI Winter (Q2 Four Wars of the AI Stack Recap)
- ▶ 24:20 unnamed speaker Jamba also had something like between like six to like 30 to one, and basically every form of hybrid architecture seems to be working at the research stage.