The Wisdom Wall

“we are generally able to, after we do that, take those learnings and basically put that capability into a general model. So there's not that much benefit. Um, you know, you could, you can get away with a somewhat smaller specialized model, a little bit faster, a little bit cheaper, but the trends have not gone that…”

“The algorithmic improvements that have come over the course of the last few years, ah, maybe are actually even outpacing the increased compute that's put into these models.”

“I just don't think this is the technology you want to just kind of keep close to the chest and hidden until it's like perfect.”

“Uh, and more recently, the post-training, especially as the thinking models have come around. Um, and that's been, you know, another huge step up in general in AI. So, uh, you know, we don't really know what the ceiling is.”

“It, yeah, it just feels kind of silly having done all of that work, uh, and seeing now how capable these general language models are that include, for example, vision and image, and they're multimodal, and they can understand The scene and everything, and not having had that at the time, ah, yeah, it just feels like…”

“it does it correctly, like, 90% of the time, but am I really, like, is that then worth it if 10% of the time it's gonna make a mistake or taking too long or whatever? And then you have to work, work, work, work, work, work, work to get to perfect all those things, make it responsive, make it available, whatever.”

“these AI systems actually change quite a lot, quite a lot, you know, the, like, if you went away somewhere for a month and you came back, you'd be like, whoa, what happened?”

“it's, like, just really hard To, you know, just forecast, like, you know, to think five years out, because, you know, based on the base technical capability of the AI is what enables the applications, um, and then sometimes, you know, somebody will just whip up a little demo that you just didn't think about, um, and…”