Everything Bob McGrew said on any show that made the record, most notable first. Each card names its show and opens the statement there.
McGrew: LLMs have entered a pure scaling regime toward AGI
“And now that that has been cracked at this point, I think we actually have a very clear path to just focus on scaling. You know, we were, you know, talking about that you know, the zero to one part, that's not about scaling. I think there's a really strong cas…”
McGrew: FDE-led product discovery beats traditional sales-led discovery
“Sales-led product discovery, you're talking to people from the outside. And again, this is important very early on, but it's not as effective as the FDE-led product discovery, where you're solving these problems from the inside.”
McGrew: Building what customers ask for turns startups into consulting firms
“I think one of the other failures, by the way, that's even prior to that, and more, the easier failure to become a consulting firm, it's where you build the product in the field that the customers are asking for, rather than the one that's actually valuable to…”
McGrew: Startups should avoid FDE strategy unless no alternative works
“My first, second, and third pieces of advice to people who are thinking about trying an FDU strategy is like, don't,
Don't do this at home.
If you can avoid it, like it's probably bad for you.
Probably you're going to end up doing services.
And then only if yo…”
McGrew: In five years, AI agents won't be a single category
“Probably in five years, we'll look back, we'll be like, well, AI agents, there wasn't even a thing at all, right?
We were actually doing all these different things.”
McGrew: FDE strategy succeeds by growing contract sizes rather than cutting customization
“In the product market fit strategy, you want to be doing less work for every customer, you want to be driving down costs, you want to keep the contract size the same. In the FTE strategy, you want to drive the contract size up. So you're doing more and more va…”
McGrew: AI capabilities will outpace adoption over the next five years
“What the world is gonna look like over the next five years is that the capabilities just race ahead and race ahead and race ahead.”
McGrew: Nobody believed next-token prediction would work before GPT-1
“And the core idea behind GPT-ONE is that if you have a transformer and you apply this super simple objective of guessing the next token, guessing the next word, that that would be enough signal that you could actually have something that would be able to gener…”
McGrew: LLM pre-training scaling will inevitably hit a data wall
“It is definitely the case that there is a data wall and that if you take the same techniques that we were using to scale LLMs you know, at some point you're going to run into that.”
McGrew: AI founders should build with frontier models first, distill later
“Yeah, I would say if you're a founder, the right approach is to start with the very best model you can, because, you know, your startup is only going to be successful if it exploits some, something about AI that realistically is going to be on you know, the fr…”
McGrew: AI impact is not visible in productivity statistics
“I mean, yes, AI has had some effects, you know, particularly on people who write code, but, you know, I don't think you can see it in the productivity statistics, unless it's about how big the data centers are that we're building.”
McGrew: Future human jobs will bifurcate into 'genius' and 'manager'
“I think that the role that we're going to be playing, You know, one, I think there's going to be two roles. One will be something like a lone genius. You know, the Alec Radford of the world working alone at his computer, coming up with some crazy idea, but now…”
McGrew: Robotics will see a 'ChatGPT moment' within five years
“Robotics companies now are where, you know, LLM companies were five years ago. So I think in five years, you know, or even, even sometime in the next five years, we will see the chat GPT moment for robotics.”
McGrew: AI will automate scientists before physical experimenters
“I think weirdly we're going to end up with, you know, automating the scientist, the innovator before we automate, you know, the experiment doer.”
McGrew: There is no limit to neural network capability with enough compute and data
“If you could figure out how to pour enough compute and pour enough data into a neural network, there's really no limit to how, how good it could get.”
McGrew: OpenAI models are improving, contrary to user reports of degradation
“Ah, we think it's actually getting better over time that, you know, some of the reports are sort of confounding various different things.”
McGrew: AI scaling will keep working without hitting an asymptote
“The way I think about it is that we are still pretty far away from the level of scale that is the human brain. And so there's no reason for there to be an asymptote. I think it just keeps working.”
McGrew: Human-level multi-agent AI will create its own civilization
“When you push this to the level where AI is at the human level, I mean, they're basically going to be creating their own civilization.”
McGrew: GPT-5 will render current AI infrastructure solutions completely obsolete
“I'm always a little worried about the infrastructure work, because I think, you know, you're solving the problems as they exist today, and when GPD 4.5 and GPD five come out, you know, they're gonna have fundamentally different use cases and fundamentally diff…”
McGrew: FDEs function as product discovery linking client needs to platforms
“What he realized we needed was for the FTEs to act as product discovery. So they would go to the site, they would take the product as it was, and they would fill the gap between what the product did and what the users needed. So, you know, the FDE goes and bui…”
McGrew: Forward deployed engineers must be rapid prototypers, not code craftsmen
“And then for your deltas you want someone who's really good at prototyping. So the wrong profile for a Delta would be someone who's a craftsman who really loves, you know, making sure the abstractions are exactly right. That, you know, they're building softwar…”
McGrew: FDE deployments start at negative margins before becoming profitable
“From a business model perspective, one of the key things that you will see, that you should see, is that it may be the case that you're, when you go into, you do a new deployment at a customer, that you're actually losing money early on. As the longer you're a…”
McGrew: Bringing one-off FDE solutions directly into core products causes over-specialization
“There's a classic failure mode here where, you know, the FD implements something for one customer and you say, great, well, that's how you should do it. And you bring it directly into the product. And it turns out if you do that, you're building something that…”
McGrew: Palantir avoided hiring traditional PMs who lacked abstraction skills
“We didn't hire product managers for a long time. And when it did come time for me to hire product managers, I would interview people who were amazing product managers at, you know, other companies. And I would ask them to think at this level of abstraction. Th…”