Everything Joelle Pineau said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Pineau dismisses catastrophic AI existential risk predictions as unscientific
“I don't have a lot of patience as a scientist for people who are predicting the extremist scenarios, the catastrophic risks of AI, you know, AI becomes our overlord kind of scenario.”
Pineau: Out-of-the-box reinforcement learning will not deliver AGI
“Now, you know, where we're maybe getting a little bit ahead is thinking that just RL out of the box is gonna give us AGI. That part, a lot less so. You know, if you look at the curve of progress, RL is terribly inefficient, and so the amount of signal you need…”
Pineau: Halting open-source AI now prevents developing vital model safety practices
“My worry about closing the doors down now is that the models are only getting better. And so if we don't release them now, we really miss an opportunity to develop the muscle we need to make these models safer. And I don't think today's model are the ones that…”
Pineau: AI is far away from a breakthrough transformer moment for reasoning
“The transformer moment for reasoning and choosing action and being able to plan at different levels of granularity. We're still far away from doing that.”
Pineau: Reasoning models fail at multi-tier hierarchical planning
“That's the part that the reasoning models don't do. They do really well at like one level of granularity... But the going back and forth between different levels of sort of resolution of action, it's really hard. So on the technical terms, we call it hierarchi…”
Pineau: Future of AI will be many specialized agents, not one superintelligence
“I tend to actually place my bet not on the fact that we're going to reach like a single super intelligent agent, but on the fact that we are much more likely to live in a future where there's going to be many agents for many things. And so some agents will abs…”
Pineau: Reinforcement learning is fundamental to AI and will not disappear
“Oh, I'm still super bullish on RL in that, like, the concept itself is so fundamental. You know, this idea of training through a system of rewards, of indicating what's valuable and what's not valuable through numerical values, like, that is so fundamental. It…”
Pineau: Using reinforcement learning to teach AI social behavior remains unsolved
“RL, to shape the behavior of models, to get them to be social creatures, that we have no idea how to do. I mean, I don't know if you have children, but like shaping their behaviors, you know, the number of times you can repeat the same thing, and still they do…”
Pineau: Compute and Data Scale AI Linearly, While Algorithms Cause Step-Functions
“Compute and data have a more linear effect on progress. You build more compute. You run bigger models. You can typically get better performance. You feed in more data. It's not just quantity. You need to worry about quality and diversity as well, but roughly i…”
Pineau warns against betting that AI compute scaling will hit a wall
“They've been, the scaling laws have been remarkably robust. They don't play exactly as we expect, but still, they've been remarkably robust. Lots of people have bet against scaling laws in the past. And I would say overall, you know, we've seen a pretty, prett…”
Pineau predicts AI will enable 10x employee productivity within two years
“Oh, I don't think that's unrealistic at all.”
Pineau: Multi-billion-dollar price tags for top AI talent are unnecessary
“Time will tell. I don't think it's necessarily needed to go at that scale, but time will tell.”
Pineau: Human-guided AI training is a permanent necessity, not a phase
“I don't think it's a phase in the sense that I do think this partnership, we'll call it, between humans and machines, where humans provide guidance to machine, like, we are in this for a long time. What will change is the nature of the information that the AI …”
Pineau: Meta's next AI step change requires general and world models
“We've done a ton of work on AI on the platform over the last few years. That was what I would call more narrow specialized models. We can continue to do that, but the bigger step change are gonna come through the more general model, building foundation models,…”
Pineau: LLMs are currently the fastest progressing path toward general intelligence
“It gives us a path. It may not be the path, but it gives us at least a path to move towards general intelligence. And it's an exciting one. It's one that, that we're exploring. It doesn't mean that we've stopped exploring other paths towards general intelligen…”
Pineau: Neural networks generalize narrowly and produce noise far from training
“I do believe they can generalize. I think they generalize relatively narrowly, or at least, you know, as long as you stay close, you get a good manifold of information. When you start to go really far afield from your data, because the dimensions are so large,…”
Pineau: AGI will be a network of agents, not a monolithic entity
“Often this notion of general intelligence is, is articulated in, in the context of like a single agent, a single uber intelligent agent. And I don't think that's really where we will move towards either.”
Pineau: AI reasoning techniques rely on 40 years of known research methods
“A lot of the ingredients of how to do reasoning have been explored in AI for 40 years. And are published and well known to anyone who's taken even an undergrad level course in AI. So I'm not saying they, that there's not any innovation in the work that, that o…”
Pineau: World models are essential for building autonomous AI agents
“World models are absolutely essential when you want to build agents, because these agents are going to take actions, which is going to change the world. You want to be able to predict these effects.”
Pineau: AI research community lacks agreed definition of continual learning
“I confess I have a little bit of trouble with continual learning as a concept because I feel the community has never been able to nail, like, how do we articulate the problem in a way that we all agree on it? And so everyone who does work on continual learning…”
Pineau: AI ideas cannot stay proprietary while researchers move between labs
“And that's why, honestly, for many years I've been so much an advocate for open science. I just don't believe that you can keep these ideas boxed in unless you're willing to keep people boxed in, which we are not willing to do. And so I don't think we have a w…”
Pineau: AI tools allow entry-level employees to become 10x functioning analysts
“If these entry level employees are able to use AI properly, they're skipping ahead to the level where they can actually be fully functioning analysts and they can essentially do 10 X the job with the tools.”
Pineau: AI is starting to be useful, but trails public perception
“We're at a stage where AI is really starting to be useful, maybe not as useful as people think it is, but we are there.”
Pineau: Replacing portions of enterprise workforces with AI is unrealistic
“So to just like flat out replace a portion of your workforce is actually Pretty unrealistic.”