private evals

3 statements across 1 episodes · 1 bullish · 1 bearish · 1 people on the record · first statement Jun 3, 2026 by Satya Nadella · across every show →

Everything said about private evals, oldest first

Jun 3, 2026 positive
Insight
Nadella says private evals and execution traces are a company's biggest IP
“So that's why I would say every company having private evals may be the biggest IP, right? I think about it like what's that private eval that you can then use even a frontier model to hill climb on and not leak the traces. Maybe one of the biggest drivers of …”
Satya Nadella Jun 3, 2026 ▶ 12:24 Satya Nadella on AI: @NoPriorsPodcast x Latent Space Crossover Special at Microsoft Build 2026
Jun 3, 2026 neutral
Insight
Nadella: Enterprise AI control requires private evals to switch underlying models safely
“Like, so in other words, another asset test is, you have an eval that's private. You're using a model A. Can you switch it to model B and, you know, climb up? If you can, then you're in control. If you can't, you're not in control.”
Satya Nadella Jun 3, 2026 ▶ 12:41 Satya Nadella on AI: @NoPriorsPodcast x Latent Space Crossover Special at Microsoft Build 2026
Jun 3, 2026 negative
Prediction Not checkable as stated
Nadella: Public AI evals are maxed out; every company will use private evals
“Most importantly, you'll have private evals, because we know all the evals out there are good, interesting, but they're not really that critical. At this point, because they're all can be maxed. And so the point is each company will have its own private eval.”
Satya Nadella Jun 3, 2026 ▶ 4:07 Satya Nadella on AI: @NoPriorsPodcast x Latent Space Crossover Special at Microsoft Build 2026
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.