Opinion
Nadella: Many open-weight models score well on benchmarks but fail in practice
“In fact, that's one of the challenges of a lot of the open rate models is they look great on one benchmark or two, but they're not great on practice.”
Prediction Not checkable as stated
Nadella: Public AI evals are maxed out; every company will use private evals
“Most importantly, you'll have private evals, because we know all the evals out there are good, interesting, but they're not really that critical. At this point, because they're all can be maxed. And so the point is each company will have its own private eval.”
Insight
Nadella: Managing multi-agent coding requires completely rebuilding IDE interfaces beyond chat
“Coding has worked so well that we now have to rebuild the IDE, right? I mean, it's kind of nuts to see what we launched is like, oh my God, I have these hundred agent sessions. I, the cognitive load, it transfers back to me as a human is so excessive that now …”
Prediction Not checkable as stated
Nadella: In six months users will routinely have AI autopilots working overnight
“I'm positive that six months from now, we'll all be saying, oh, wow, like all through night, the night, there was a bunch of stuff that all these autopilots that I have working on my behalf with my delegated authority, so to speak, right? I can sort of given e…”
Insight
Nadella says private evals and execution traces are a company's biggest IP
“So that's why I would say every company having private evals may be the biggest IP, right? I think about it like what's that private eval that you can then use even a frontier model to hill climb on and not leak the traces. Maybe one of the biggest drivers of …”
Prediction Not checkable as stated
Nadella predicts AI agent knowledge traces will become corporate balance sheet assets
“Which is when a company says it should in fact go onto the balance sheet is how I think about it, right? That's so, in fact, there may be like human capital was never possible to go put on a balance sheet because you didn't know how to capture the tacit knowle…”
Insight
Nadella: SaaS companies must unbundle data and logic to find new models
“So I think the challenge of the SAS business model is we packaged one way. We now have to learn how to unbundle these things and rebundle in new ways and discover new business models, right?”
Prediction Not checkable as stated
Nadella: AI agent usage of Microsoft 365 will exceed human users
“So the value creation opportunity now in the agent world is in fact, 10 X more, but it does require us to have, for example, there's going to be usage around M three six five, right? Which is going to be perhaps more than even the end users. And we have to eve…”
Insight
Nadella: Customers reject outcome-based pricing once outcomes materialize
“Most people love outcomes until they have an outcome. Because once you have an outcome, it's like giving away royalty, right? I mean, I've talked to customers who love, you know, outcome-based pricing, and I say, I'm all in until they, oh my God, like, what ar…”
Prediction Not checkable as stated
Nadella: Software pricing will always combine per-user with consumption meters
“There will always be a per user, but there will have to be a consumption meter.”
Disclosure
Nadella says Azure networking team requested AI tokens over headcount for operations
“So they built this agentic system. They even have a character for it. It's called Miles and it sort of does all this stuff. Right. They started sort of screaming for more tokens and so on, and so they were saying, look, we don't need headcount, we need tokens …”
Prediction Not checkable as stated
Nadella: Next major startup could be a new university or pedagogy
“So I think interestingly enough, maybe the next big startup and success story could be Someone who builds a new university or a new pedagogy even of how to get someone to go through a curriculum and find economic opportunity, ah, that's highly valuable.”
Insight
Nadella: Platforms must create more value above them than they capture
“A platform is defined by fundamentally its ability to create more value about the platform versus what's captured in the platform.”
Insight
Nadella: Prepping the context layer is where agent magic happens
“The other hard lesson we've learned in the last two years is, oh my God, the amount of work you need to do to prep the context layer such that your plan can execute in the most efficient way is where the magic”
Insight
Nadella: Enterprise AI control requires private evals to switch underlying models safely
“Like, so in other words, another asset test is, you have an eval that's private. You're using a model A. Can you switch it to model B and, you know, climb up? If you can, then you're in control. If you can't, you're not in control.”
Disclosure
Nadella: Work IQ turns Microsoft 365 into an accessible database
“The same thing is now happening with M three six five, because with work IQ, we have exposed what was perhaps the most important database in a company that never got used as a database because it was only captive to our apps, right? It was all email operated o…”
Insight
Nadella: Per-user pricing is driven by enterprise budget certainty
“The per-user pricing is really an artifact of someone creating a budget needing certainty, right? Because it's the most, Even important, like somebody wants a budget, they need a per user and per user is just a set of entitlements to usage, right?”
Prediction Not checkable as stated
Nadella predicts generalist roles will see the maximum returns from AI leverage
“I think the generalist role is going to be the most exciting, right? Because the leverage of a generalist is where we are going to see the maximum returns, right?”
Assertion Not checkable as stated
Nadella: Microsoft built more Azure capacity in 15 months than prior 15 years
“You saw that I talked about sort of how we built in the last 15 months more Azure capacity than we built in the first 15 years.”
Insight
Nadella warns AI datacenters require delivering tangible benefits to local communities
“Unless we as an industry are very principled about ensuring That the benefits of all the stuff we're talking about are felt in real ways at the community level, right? Because this is not just a campaign right? It has to be real where people are saying, look, …”
Opinion
Nadella confirms intelligence scaling logarithmically with compute still largely holds true
“This, you know, this crude way of saying it is intelligence is log of compute kind of works.”
Disclosure
Nadella built a personal chief-of-staff autopilot agent deployed to Teams
“I think I just built one even last week where the idea was, hey, can I have an agent that is continuously monitoring essentially my own chief of staff autopilot, right? We're going to have that, obviously, in Scout. That's what we showed. But it is so easy and…”
Assertion Supported
Nadella says LinkedIn merged design, PM, and engineering into full stack builders
“At LinkedIn, they did structurally change and, you know, basically built up a new discipline called full stack builder, right? So they went and said, hey, let's bring people from design and product management, front end engineering, all put them together but a…”