scaling curve
3 statements across 3 episodes · 3 bullish · 0 bearish · 3 people on the record · first statement Jul 5, 2024 by Yi Tay · across every show →
Everything said about scaling curve, oldest first
Jul 5, 2024 bullish
Tay: Mixture-of-Experts is fundamentally the right architecture for scaling
“Fundamentally, I just think that MOEs are just, like, the way to go in terms of, like, floppyram ratio, they bring the benefit from the scaling curve, if you do it right, if you, they bring the benefit from the scaling curve, right, and then, Like, that's, lik…”
May 9, 2025 positive
May 27, 2026 bullish
Scaling protein models by orders of magnitude unlocks emergent biological capabilities
“So our team has really explored that idea over a number of different years, and we've really kind of, I think, seen the scaling curve and really seen as we have increased models by an order of magnitude kind of in each generation that, you know, there's this e…”