The Ledger
Every statement that passed quotation and attribution checks. Mix any filter with any other: certainty 1/5, debate potential 5/5, or both at once.
why aren't all 44 resolved? a statement only gets an assessment when the public record can support or contradict it. opinions and what-ifs never can, and 0 checkable ones are still open, waiting for their date. predictions held up or didn't; assertions are supported or contradicted. on every card: ▮▮▮▮▮ certainty · ▮▮▮▮▮ debate potential. speakers are clickable
Pineau dismisses catastrophic AI existential risk predictions as unscientific
“I don't have a lot of patience as a scientist for people who are predicting the extremist scenarios, the catastrophic risks of AI, you know, AI becomes our overlord kind of scenario.”
Pineau: Out-of-the-box reinforcement learning will not deliver AGI
“Now, you know, where we're maybe getting a little bit ahead is thinking that just RL out of the box is gonna give us AGI. That part, a lot less so. You know, if you look at the curve of progress, RL is terribly inefficient, and so the amount of signal you need…”
Pineau: Reinforcement learning is fundamental to AI and will not disappear
“Oh, I'm still super bullish on RL in that, like, the concept itself is so fundamental. You know, this idea of training through a system of rewards, of indicating what's valuable and what's not valuable through numerical values, like, that is so fundamental. It…”
Pineau: Using reinforcement learning to teach AI social behavior remains unsolved
“RL, to shape the behavior of models, to get them to be social creatures, that we have no idea how to do. I mean, I don't know if you have children, but like shaping their behaviors, you know, the number of times you can repeat the same thing, and still they do…”
Pineau: Compute and Data Scale AI Linearly, While Algorithms Cause Step-Functions
“Compute and data have a more linear effect on progress. You build more compute. You run bigger models. You can typically get better performance. You feed in more data. It's not just quantity. You need to worry about quality and diversity as well, but roughly i…”
Pineau warns against betting that AI compute scaling will hit a wall
“They've been, the scaling laws have been remarkably robust. They don't play exactly as we expect, but still, they've been remarkably robust. Lots of people have bet against scaling laws in the past. And I would say overall, you know, we've seen a pretty, prett…”
Pineau predicts AI will enable 10x employee productivity within two years
“Oh, I don't think that's unrealistic at all.”
Pineau: Multi-billion-dollar price tags for top AI talent are unnecessary
“Time will tell. I don't think it's necessarily needed to go at that scale, but time will tell.”
Pineau: Human-guided AI training is a permanent necessity, not a phase
“I don't think it's a phase in the sense that I do think this partnership, we'll call it, between humans and machines, where humans provide guidance to machine, like, we are in this for a long time. What will change is the nature of the information that the AI …”
Pineau: AI is starting to be useful, but trails public perception
“We're at a stage where AI is really starting to be useful, maybe not as useful as people think it is, but we are there.”
Pineau: Replacing portions of enterprise workforces with AI is unrealistic
“So to just like flat out replace a portion of your workforce is actually Pretty unrealistic.”
Pineau: AI agents are opening an unmapped new frontier in security
“With respect to AI security, I think there's a new front that's opening up with the development of agents, and frankly, there's a lot we don't know yet in terms of the vulnerability of these systems.”
Pineau: Assembling AI superstars without execution and glue fails
“I don't think it becomes that productive to put a bunch of AI superstars all together in a room without the execution machine, without the social glue.”
Pineau: AI teams need a few elite talents, not a full roster of superstars
“You do need a few of these, like, uber talents in the team. There's a relatively, you know, short number of people who just Understand this technology very deeply. You do need some of this talent, and if you can afford it, you should get some of that talent. B…”
Joelle Pineau: AI Code Generation Quality Will Be Excellent in 10 Years
“So you think of code generation, like right now we're in the phase we were for image 10 years ago. Yes, there's a lot of bad code that's getting generated. There's a lot of code that will get thrown away, but wait another 10 years and I think the quality of th…”
Pineau: Software engineering will shift from writing code to curation
“What matters now is sort of, you know, picking the quality out of the volume, and so if I fast forward 10 years on code generation, when we have the ability, To generate a ton of code to do a ton of different things. We're going to need some selection mechanis…”
Pineau: The AI capital bubble will see massive upswings and downswings
“I think about it as a bubble with bigger variants. It's like, you know, the upswing is going to be bigger, and you know, there's going to be big downswings as well, and so there's a lot of variants into the system right now.”
Joelle Pineau: AI benchmarks should be treated as narrow unit tests
“Think of evaluations as, like, unit test for the performance of your system. I mean, software engineers will know what that is, right? Like, you run through that evaluation, and that gives you, like, a signal of how the system is doing in a particular dimensio…”
Joelle Pineau: Blaming AI and platforms for mental illness is an oversimplification
“I think the, we have to be careful about taking shortcuts and saying, you know, because suddenly, you know, we have certain platforms, we have AI, and so on, that is causing that mental illness.”
Pineau: Planning around a closed-source AI world is a deep mistake
“That's a deep mistake. I mean, I will continue to believe that, especially for research, the ideas need to circulate, and this thought that you can just, like, close us down is, is absolutely false. I mean, people are circulated.”
Pineau admits she was wrong to be skeptical of neural networks
“I used to be quite skeptical that neural networks were necessarily the ultimate
A solution to machine learning.
I seem to be quite wrong on this one.”
Pineau: RL costs are falling where clear reward functions exist
“It's coming down, especially in domains where we have good reward functions.”
Pineau: Cohere develops on-premise AI models to offload inference costs
“One of the things that Cohere is doing is actually to develop AI models that run on premise. So that means enterprise bring it in, they run it locally, so the company has to worry about the training Of the models. Obviously we want world-class models for the n…”
Pineau: Unpredictable GPU needs and returns are AI's biggest economic challenge
“I think one of the biggest challenges, the fact that it's very hard to have predictability, right? Everyone wants to know when are we going to hit the breakthrough? Everyone wants to know how many GPUs do I actually need? Everyone wants to know, like, what's t…”
Pineau: Algorithmic innovation is the hardest AI area for investors to evaluate
“So, in that sense, I think it's the most interesting one, it's the most frustrating one, and it's the most difficult one, certainly from investors' point of view, to know where to put your chips.”
Pineau: Selling enterprise AI offers better feedback than academic benchmarks
“When you need to sell AI to a business, you get a real signal of what works, what doesn't work. And you know, we've been using these academic benchmarks for many years. You get some signal, but it's not the same as getting this to do productive work.”
Joelle Pineau: AI automation succeeds when task results are precisely specified
“So in any case where we can be very precise about what a great result looks like, we'll be able to make that task automatic much more easily than tasks that are much more nuanced and have a lot of complexity.”
Pineau: Users treat AI as a work tool rather than a companion
“I see a lot of people using it as a tool, more than as a companion. You know, people have this, you know, Swiss knife in their work life all of a sudden that can be super helpful, but that's really most of what I see.”
Pineau: Practical AI applications will be discovered by field practitioners
“We don't have all the answers of how it should be used. That's gonna come from people on the field.”
Pineau: Impersonation is the AI agent parallel to LLM hallucinations
“In terms of agents, you know, we worry a lot about hallucinations in LLMs. The parallel in agents is impersonation.”
Pineau: Building AI models outside the US and China creates a healthier industry
“I do think it's healthy that there are models that are getting built in different places around the world, not just in the US and China right now. I think this is healthy in terms of diversity of thoughts. I think it's healthy in terms of having a greater amou…”
Pineau: Having AI talent without compute is a waste of time
“If you have too much talent and not enough compute, you're wasting your time, so usually like an equilibrium between those two pieces.”
Pineau: Simple data labeling is obsolete as AI requires complex tasks
“The days of like having data labelers who can say this is a cat and this is a dog or somewhat over like the easy test the AI can do. So we're getting in a space where we need more specialized tasks.”
Pineau: AI data market is shifting from labeling to crafting environments
“I think for me, the even bigger trend we're seeing is the moving from just labeling data to crafting environments to produce new, new tasks.”
Pineau: Synthetic image and language data causes model degradation
“So in some domains, if you think like images, languages, like LLMs talking to each other at some point, you definitely get the degradation and that degradation is due to essentially like a loss of diversity of your data.”
Pineau: Synthetic data for code avoids model collapse through injected diversity
“If I think of coding, we can generate synthetic code. You take normal code and we know how to inject diversity into the code. Like I can take a couple of repositories, mix and match, apply an LLM to transform it. And so there's a way to generate synthetic data…”
Pineau: Language will remain the primary paradigm for human-AI interaction
“But language is incredibly powerful. So if you think of prompt as being more language as a way to express ideas and communicate with a machine, that's a powerful paradigm. I mean, as humans, we, so much of our communication is based on language. I don't think …”
Pineau: Enterprise clients don't care if AI models win math Olympiads
“We build AI systems that go into enterprise. None of our clients ask about, like, are you able to win the math Olympiad with this model? That's not what they care about. They care about bringing value to their business.”
Pineau: Academic researchers often win best paper awards at NeurIPS and ICML
“You go to the major international conferences, Nureps, ICML, and others, and often the best paper awards are actually won by researchers out of universities.”
Pineau: Universities allow riskier small-scale AI research than corporate labs
“There's a lot of good ideas that you need to test out at small scale. And in a university, you have a lot more freedom to pick pretty risky ideas at a small scale, but still, you know, no one's asking you to justify your research in, in ways that, that often h…”
Pineau: Mark Zuckerberg dives incredibly deep into AI technical details
“He is incredibly deep into understanding the work. Like, he does not coast, you know. When he started getting into AI, just the depth of the question that he'd ask, he just gets really interested in the topic and goes super deep, and that then just informs eve…”
Pineau: Meta's 2019 RoBERTa model hit 20M monthly downloads during LLM hype
“We were in, in the frenzy of large language models, and I pulled the stats on, you know, most downloaded models of last month. We had a model like Roberta from 2019, small language model, was getting twenty million downloads a month.”
Pineau: Human-AI interaction will expand to voice, gesture, and eye gaze
“It's awfully limited, and, you know, prompts can mean a few different things, but the idea of, like, typing in a box, that to me is very limited, and we're gonna break out of that box already. We're seeing a lot of cases where voice is a lot more natural as an…”
Pineau: AI in Healthcare and Science Will Make Transformative Progress Within Five Years
“There's a lot of verticals, whether healthcare or scientific discovery that I think have increased Incredible promise where we're going to see real tangible progress within five years that are going to change completely the face of what we can do. So that's pr…”