The Ledger, every show

“And unfortunately, it seems like OpenAI's release of last week, GPT, 5.3 codex, one of the big breakthrough models we've been talking about. As I look over the evidence, It seems like open AI did not abide by the testing that they had committed to in various w…”

“The job of an engineer at one of these companies now is much more supervising these agents as opposed to writing the code yourself.”

“That's one step, but then you need to take that engineering and use it to actually automate the AI research. You need to go from being able to implement the ideas more quickly to using that to fuel faster and faster growth in the breakthrough ideas themselves …”

“And the fundamental problem that we're seeing is we don't know how to take our values or our goals and encode them into these AI systems and get them to pursue it reliably.”

“My concern with the relationships is less so the relationships themselves and more that open AI had a bunch of important safety tooling to make this less harmful that they left on the shelf. So for example, they had classifiers to tell when users were really s…”

“The AI systems are helpful above and beyond Google in part because they can go back and forth with you and they can help you troubleshoot and dynamically answer your questions. And so even presented with the information on Google, people often can't get all th…”

“And the more that the companies become valuable and when they become public and public equities become tied to them, I just worry about worlds where we are reluctant to enforce the law on companies, even if they are breaking it because so much of financial pro…”

“Apollo research, which is one of the leaders in this space wrote in their review of the new open AI model that the model would sandbag and take actions like this without having been given a direct goal like that. It wasn't told directly to go after it.”

“Until Daniel Cocotelo who people might know from leading AI, 2027, I think very, very courageously forwent this agreement and forfeited something like 80% of his family's net worth and said, Sorry, I'm just not waiving my right to criticize open AI.”

“At a high level, the big AI companies have made these safety pledges of how they will treat their systems as they get more and more capable, but they are largely self-enforced. And so there's a lot of temptation to water down your commitments and go ahead with…”

“And so at Davos a few weeks ago, I think both Demis and Dario said some variation of, yeah, like if we were the only two groups building this technology, We would find a way to get together and figure out how to slow down this frantic pace. Like it's going too…”