multimodal training
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement Jun 6, 2024 by Tengyu Ma · across every show →
Everything said about multimodal training, oldest first
Jun 6, 2024 bullish
Ma: Meta Achieved 1.6x Training Efficiency Gain Using Sophia Optimizer
“And recently I think one of the Facebook friends actually used this in their large scale multimodal training. And they found that in on that scale, I don't know exactly how many parameters there are, but I think, I assume it's kind of more than a hundred billi…”