Jamba 3B
product on 1 show · 2 statements across 1 episodes · said 1 times in 1 episodes since 2025
Mentions by year, every show
tap a year for its mentions
Latent Space 1
every mention on every show, scene by scene, with the transcript →
2 statements about Jamba 3B, every show
AI21 CTO: Jamba 3B uses 1:12 attention ratio to cut memory footprint
“So this is a three B dense with only two attentional layers. It's one to 12 and not one to eight, because we wanted to maximize the efficiency. It has very few attention heads, so everything is geared To have, you know, long context with very little memory.”