The Ledger, every show

“I can very clearly see what we're doing now and like what we're doing next. And I don't see the limit to the scaling laws. Like if you're just sort of thinking about the raw capability of the models and like how well you can condition them to reason over incre…”

“95% is going to be AI generated. I think very little is going to be line by line is going to be human written code.”

“It is already the case that I think the frontier models are probably better like health diagnosticians than Your average GP is”

“You know, one of the things that Sam Altman and I have talked about a lot is like, I suspect that this year, like the next trillion dollar company gets founded.”

“Most of those assertions that people make are like most of the assertions that people make are just unfounded in any kind of science. Like no, no one's gotta, and like the measurements we do have show that there's a pretty big disconnect around what some peopl…”

“It basically means, and like, I don't think this is next year, but it's probably not going to be 10 years. This whole notion that the, That, that you have teams of people who are, who, whose job is to go anticipate a bunch of very granular user needs in some n…”

“The user interface that surfaces, those capabilities will probably be agents. And, you know, product managers, like I don't all don't believe in this, like one agent. For everything sort of theory. I think you'll have a lot of agents.”

“Your product managers are probably going to have to be domain experts, like people who sort of deeply understand something like medicine or, you know, drug discovery or early round venture investing, or, you know, like, you know, just sort of pick your thing.”

“I just had super, super high confidence that we were never going to get to the point where we're like, all right, we got enough compute.”

“So like I think all of the, like the world is just sort of full of these jobs where you know, really, you know, affecting change on a physical system, like doing something in the physical world, like all of those things like we will need probably many, many mo…”

“Especially because we're going to have to rebuild our entire power generation and distribution system, like in our children's lifetimes.”

“A little bit of that is because you get, you know, maybe like a two X benefit price performance from hardware every generation. Like if you're lucky but you get a much bigger improvement price performance wise from. All of the things that you're doing in the s…”

“All of the economics in search go to like somebody who's stood up a gigantic infrastructure and who's sort of running like a whole. Search business like with its own feedback loop.”

“I think one of the things is going to happen because I know lots of people are working on it right now is memory is going to get a lot better over the next year or so, which means that as you're using an agent, like, and it remembers more and more about your p…”

“I think there's going to be more over the next year of you sort of dispatching your agent to go do something and it like goes and works while you are not paying attention to it.”

“If you look at things like Bing chat or Microsoft three 65 copilot or GitHub copilot, you end up using a portfolio of models to do the work and like you use it for performance and cost optimization reasons, and you use it for you know, just sort of precision a…”

“ChatGPT was a 10 month old model with a little bit of RLHF on top of it. And, you know, like by, you know, admission, like You know, not a beautiful user interface. It was just sort of a way to get something out there because you know, you needed some practice…”

“We do not have a, Yeah. Sort of robotics exponentials right now. Like we've got a cognitive exponential.”

“OpenAI doesn't have GPTV and wide distribution, but, like, it'll get to wide distribution at some point in the not too distant future, and so, like, you'll have these, like, very powerful multimodal models”

“The agents, they will definitely be less transactional, less session-oriented going forward.”

“I think Lama too is just like Lama going to be an important building block that people are going to want to use to build AI software.”

“The thing that it really does in our observation with developers more than anything else is it helps keep them in flow state. Longer than they otherwise would.”

“We have proof points of, you know, a sort of a 20 watt organ that you know, sits between our ears that, that is artificial general intelligence that is many, many, many orders of magnitude more efficient than the Digital artificial neural networks that we're b…”

“We were hiring these brilliant, brilliant people at the time, and the way that we did hiring was kind of crazy. It's like, all right, well, if you're smart, just come work here. And like, we have no idea like what exactly it is you're going to do. And you like…”

“The first project that I did, which was you know, like a machine learning classifier thing in 2003 2003, 2004. Like that was, you know, stacks of like super technical, you know, research papers and, you know this elements of statistical machine learning, you k…”

“It's you know, hours in the day that go by where someone's not asking for GPUs is almost non-existent.”

“So we built our, the first thing that we called an AI supercomputer. I think we started working on it in 2019 and we deployed it at the end of that year. And it was the computing environment that GPT three was trained on”