model

“One framework to consider is that models are just a new primitive to build applications on top of the same way storages or geolocation or payment rails are today.”

“And I think hallucinations are gonna, the rate is gonna go down as the models get better, but it's never gonna get to the point where it's a hundred percent perfect.”

“The thing is, is all the other models catch up very quickly, because they distill so well, so like, that's not defensible, in a way. And so the companies that are defensible, that I've seen, is they'll put out a model that's very compelling, And then once the …”

“Now, the reality is like you can get to really good models purely with like SFT data.”

“Because I think the models are going to get smaller and more bespoke.”

“When the models are able to take step by step, they actually can like pause before blurting out an answer is kind of what I, it feels like with a lot of the previous models or hallucinations.”

“It will change because there'll be millions of models as opposed to just singular foundational models.”

“If you look at things like Well, I guess the IMO problem six, or maybe some very hardest programming competitions problems. Like, I think there's still a little bit of headway to go for the models, but I wouldn't expect that to last very long.”

“I think a lot of what's holding back the models these days is not Actually, intelligence. It's getting the right context into the model so that it can Be able to use its intelligence.”

“What I see happening empirically is the models are being commoditized and we're always under pressure.”

“The models are trained on so much data and they're so large and yet they actually don't really know how to do any of this work. Like they don't have the workflows encoded in any way.”

“Agent is just a model in a loop with sort of tools and memory and a few other things.”

“Along, I mean, of course models are going to help us produce exponentially more mathematics, but they also make it much easier to absorb it and right now, okay, it's still a bit of a challenge back and forth, but I think it's, for me at least much, much faster…”