The Ledger, every show

“We look at what the metrics of the actual agents and they're so unreliable that ironically we feel a little bit better. The AI is actually not where we need it to be. To automate enough of the work.”

“There are studies that show that people will, even below their threshold of awareness, start with one argument and then be switched to a completely different, maybe opposing argument because of accepting all of these AI suggestions.”

“Individual scientists who are using AI tools are benefiting because they are producing more papers. They are getting more grants accepted. But science as a whole is narrowing.”

“The only way to counter that, and again, this is throughout human history, throughout human evolution, is to increase the diversity of ideas, the size of the ideas, the size of the population, and the interconnectivity of the ideas. So rather than having indiv…”

“The problem is that if we get the Trapped in this automation mindset, we are leaving on the table so much more value for what AI could be doing for not only human work, but human wellbeing, human interactions, human relationships.”

“We're kind of trapped in this local attractor state of chatbots and coding agents and like turn taking in batches. And this is absolutely not how humans interact with each other.”

“I think some of the other labs are, in a sense, victims of their own success because they have to Once they have a product out there that a lot of users are interacting with, they have to shut down different, you know, research projects and say, okay, all hand…”

“We should be thinking about spending as much on the environments as on the compute and the data, because the environments literally shape the, what intelligence can emerge.”

“Unless I'm misunderstanding something, I don't think that they could entirely converge in principle because if an AI is generating exactly the same world that it exists in, The signal to noise ratio is, is non-existent. Like part of what makes us so flexible i…”

“I imagine that. In a matter of months, we will look back at today and we won't even be able to empathize with the mental models that we have right now because they are so over-indexed on chatbots and coding agents.”

“Right now we're Building AI again for the people who are building AI. We're building AI for engineers, and we're all in our little echo chamber in the bay, and we're proud of ourselves for, you know, building AI.”

“The big idea is that human intelligence is collective. Anthropologists say that we've got the collective brain. No one individual is capable of even surviving on their own. We depend upon the collective. The intelligence emerges from our interactions. It's fun…”

“Amazon AGI Lab is building human-aligned intelligence, and starting with AI that can do anything that a human can do on a computer, that was Adepth's original mission, and we kind of imported it and seeded the lab.”

“Yeah, so I came with the original adept folks, and when we came, we convinced leadership that in order to do frontier level research, we really needed to keep an operating model that was more like a startup. We needed to insulate our research and be able to fo…”

“So ultimately reliability has less to do with clicking in the same place and scrolling and more to do with modeling the user's mind. And that shift is everything that reframes how we think about what it is that we're building.”

“You can use things like reinforcement learning to get them really good at specific tasks that we might care about, but you do that for one task and you, it is not good at another task or it doesn't generalize.”