The Ledger, every show

“2030. Boy, you really kind of, ah, put it on that fine line. I'm gonna say before.”

“I'm probably the one weirdo who doesn't, who's not a big fan of humanoids, but maybe I'm jaded because we've, you know, we at least acquired at least two humanoid robotic startups and later sold them. But the reason is, I mean, the reason people want to do hum…”

“Management is like the easiest thing to do with AI.”

“For us, we're kind of building out compute as quickly as we can, and we just have a huge amount of demand. I mean, for example, our cloud customers just want a huge amount of TPUs, GPUs, you name it. You know, we just can't, we have to turn down customers beca…”

“You know, we definitely messed up on the image generation and I think it was mostly due to just like not thorough testing.”

“If I had to guess, I would say the algorithmic advances are probably going to be Even more significant than the computational advances, but both of them are coming up now, so we're kind of getting the benefits of both.”

“I guess I would suppose that one company or country or entity will reach AGI first. Now it is a little bit of a, you know, kind of a spectrum. It's not like a completely precise thing, so it's conceivable that there will be more than one roughly in that range …”

“Anybody who's a computer scientist should not be retired right now, should be working on AI.”

“We fully intend that Gemini will be the very first AGI, clarify that.”

“Okay, I, like recently, I just had a big tiff inside the company, because we have this list of what you're allowed to use to code, and what you're not allowed to use to code, and Gemini was on the null list.”

“We are generally able to, after we do that, take those learnings and basically put that capability into a general model. So there's not that much benefit. You know, you could, you can get away with a somewhat smaller specialized model, a little bit faster, a l…”

“Deep Seek released a really surprisingly powerful model when it was January or so. So that, that definitely closed the gap to proprietary models.”

“With my skill of math and coding, I feel like I'm better off just turning to the AI now.”

“They don't honestly use the AI tools for their own coding as much as I think they ought to.”

“But I do think the trend is to have a more unified model. I don't know if I'd call it a god model. But to have certainly sort of shared architectures and ultimately even shared models.”

“The algorithmic improvements that have come over the course of the last few years, ah, maybe are actually even outpacing the increased compute that's put into these models.”

“We were too timid to deploy them”

“I just don't think this is the technology you want to just kind of keep close to the chest and hidden until it's like perfect.”

“What they did with AlphaGo and AlphaZero, as you mentioned it showed, as I recall, something you would take 5000 times as much training to match what you were able to do with still a lot of training and the inference time compute that you were doing with Go.”

“Being a computer scientist, it is, you know, the most exciting thing, you know, of my life, just technologically.”

“And more recently, the post-training, especially as the thinking models have come around. And that's been, you know, another huge step up in general in AI. So you know, we don't really know what the ceiling is.”

“No, we're trying to, you know, roll out every possible kind of AI and trying external ones, you know, be whatever the cursors of the world, all, all of those to just see what really makes people more productive.”

“There are a bunch of things I wish I had done differently, but honestly, it was just like the technology wasn't ready for Google Glass.”

“Well, we mostly, for Gemini, we mostly use our own TPUs.”

“I don't think we're gonna like necessarily our latest and greatest models, which are, you know, take a lot of computation. I don't think we're gonna just be free to everybody right off the bat.”

“Honestly, like, pretty much every day.”

“Robotics, For the most part, I see in this sort of wow stage, like wow, you could make a robot do that with just, you know, this general purpose language model, or just a little bit of fine tuning this way or that, and it's like amazing but maybe not for the m…”

“It, yeah, it just feels kind of silly having done all of that work and seeing now how capable these general language models are that include, for example, vision and image, and they're multimodal, and they can understand The scene and everything, and not havin…”

“It does it correctly, like, 90% of the time, but am I really, like, is that then worth it if 10% of the time it's gonna make a mistake or taking too long or whatever? And then you have to work, work, work, work, work, work, work to get to perfect all those thi…”

“We've come a long way since you know, a couple whatever years ago when ChatGPT launched and we were quite a ways behind.”

“As you plot it, the algorithmic advances have actually beaten out the computational advances, even with Moore's law.”

“I'm across the street you know, pretty much every day and they're just people who are working on the key Gemini text models, on the pre-training, on the post-training, mostly those I periodically delve into some of the multimodal work”

“There's also just I just didn't know anything about consumer electronics supply chains really, and how hard it would be to build that, and have it be at a reasonable price point managing all the manufacturing and so forth.”

“I think that we're taking a very anthropocentric view, like when we say simulation in the sense that some kind of conscious being is running a simulation that we are then in, and that, that they have some kind of semblance of desire and consciousness that's si…”

“These AI systems actually change quite a lot, you know, the, like, if you went away somewhere for a month and you came back, you'd be like, whoa, what happened?”

“Like, they, you know, can win, like, math contests and coding contests, things like that against, you know, some top humans.”

“I mean, I think we've you know, acquired and later sold like five or so robotics companies and you know, Boston being one of them. I guess if I look back on it, we built the hardware. We also had this more recently. We built out everyday robotics internally, a…”

“During work, I can't really use voice mode too much. I usually use it on the drive.”

“Every time we've gone forward a generation, then the sort of the new free tier is usually as good as the previous pro tier and sometimes better.”

“It's, like, just really hard To, you know, just forecast, like, you know, to think five years out, because, you know, based on the base technical capability of the AI is what enables the applications and then sometimes, you know, somebody will just whip up a l…”

“The code I submitted wasn't very exciting. I think I needed to, like, add myself to get access to some things and, you know, a minor CL here or there.”

“Feels privileged to be able to. Kind of go back to the company, not have. Any real executive responsibilities, but be able to actually go deep into every little pocket.”

“Like the International Math Olympiad that we participate in, we got silver medal as an AI, actually one point away from gold.”