AI scaling

“The thing with AI is if you buy scaling in this picture, that is, you make the models bigger, they get much smarter. Then I don't think it makes sense to hedge your bets in this way. I think you should just double down, give, give one of them a hundred billion…”

“It would just be bizarre to me that, like, you're halfway through the human range of intelligence, and now it stops getting better, so I do sympathize with Sam's statement in the sense of, like, why would it stop here, right? If it was gonna stop, why, it woul…”

“Without being too specific you know, I think, and we already have maybe some, you know, some evidence to suggest that this is another of those problems that is, is not as difficult as it seems. That will fall to scale Plus a slightly different way of thinking …”

“So we see the progress as being very fast, and the exponential is continuing, and we don't see any diminishing returns.”

“Actually it turns out you can wring more more juice out of the existing Architectures and data. So there's plenty of room, I think, and we're still seeing that in both the pre-training, the post-training, and the thinking paradigms, and also the way that they …”