open source AI

“The open source thing will be very much in line with getting to AGI, because open source has that, like natural selection effect. Like, if a better open source model comes, Really no one says, huh, I don't want to use it because there are ecosystem effects, I'…”

“Scaling to, like, million token contexts is, like, really, really hard. There, I don't think there are real, like, open source replications, open token context scaling, Beyond, like, tiny, like, academic model sizes.”

“Maybe it sounds wrong, but I feel like banding together is not necessarily good by default. There's a lot of different incentives. There's so much noise that no one knows where to focus. I prefer, if anything, I would prefer siloed focused teams who have fundi…”

“I think the gap is definitely increasing.”