Model Makers

“I believe that the wealth and the great riches are going to go both to the model makers, some of the big tech companies, and probably the folks who already have had success because they will be at the top of these food chains, and instead of hiring more people…”

“The big model makers want to create a world in which all of the data for all of the enterprises is easily available to them. I, and you know, everything else, the world is just a dumb data pipe that feeds into that big brain.”

“Right now, if you're using a model, you're taking in their own policy. Even if I want to use GPT-OSS, I've taken in a lot of different policies about what to abstain from, what's considered dangerous and not dangerous, how I should behave, etc. And I don't thi…”

“And the problem, the dirty little secret of these model makers is that these guys are so trained on the evals that they're overfitting. And all this overfitting basically makes it pretty unreliable.”