Model Architecture
topic on 5 shows · 6 statements across 6 episodes
Latent Space 
the Neon Show 
the MAD Podcast 
the a16z Podcast 
Big Technology
6 statements about Model Architecture, every show
Goel: Best Interactive AI Models Require New Architectures
“And we believe that to build them, you need to build them on new architectures.”
Simon Mo: vLLM supports over 1,000 model architectures
“For VRM, we support more than a thousand model architecture up to today, and a lot of those are proprietary, but also a lot of those are open-weight, right?”
Sanyal: Most enterprise data scientists are essentially data curators
“The main thing they actually work on, though, is curating data, because at the end of the day, you're not really a scientist sitting building new model architectures. Most data scientists are essentially data curators.”
Lacroix: Data quality improvements yield 10x the gains of model architecture tweaks
“Getting the data perfect, because we knew this was potentially not the most exciting part of the work, but it was absolutely critical, and any improvement on the data quality would, Tenex, the improvements that we would get by really improving on the model arc…”
Yao: Improving AI agents requires better data, not architectural changes
“I think it's data. I think it's data because like changing architecture now is too hard and we don't have a good, better alternative solution now. I think it's mostly about data and agent data is obviously hard because People just write down the final result o…”
AWS AI VP: New model architectures will reshape AI scaling laws
“And if you see there are starting to see new kinds of architectures that are going to change how these models scale in the future. And I suspect, ah, that is going to change, ah, how These scaling laws are going to be reshaped as well when it comes to that is …”