General Purpose Model
topic on 3 shows · 4 statements across 4 episodes
Latent Space 
Invest Like the Best 
20VC
4 statements about General Purpose Model, every show
Lin Qiao: Fine-tuned open models outperform general models on specialized enterprise tasks
“And the model intelligence has password threshold is much easier to steer, especially with small amount of data. A small amount of unique data a particular company has, and then we can hill climb towards your eval, and often time, the end result of hill climbi…”
Levine: General purpose robot models require far less data per task
“Being able to train general purpose models that can handle many tasks is essential to this because now you need a lot less data for each new task.”
Morcos: AI inference costs will skyrocket, penalizing oversized models
“The inference costs are going to skyrocket with these models. And if you use a general purpose model, then you constrain to say, hey, this model knows about everything, but now only do this one thing. That model is going to have a ton of parameters that do not…”
Mensch: AI application differentiation comes from data and user feedback
“Like general purpose models are a bit undifferentiated, but the differentiation that you need to create for your application comes from the data you put into it, the user feedback that you gather and the intelligence that you have to figure out what the applic…”