Mixture of Experts
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Jan 31, 2025 by David Friedberg · across every show →
Everything said about Mixture of Experts, oldest first
Jan 31, 2025 negative
David Friedberg argues specialized AI model networks will beat monolithic models
“It doesn't make sense to have one large do everything model. This mixture of experts architecture, ultimately you can kind of think about taking a large model, making two copies of it, and then trying to shrink each model down to whatever the necessary, so tha…”