Mar 31, 2025 · 47m · 20vc

Kevin Scott, CTO @ Microsoft: An Evaluation of Deepseek and How We Underestimate the Chinese · 20VC with Harry Stebbings

Kevin Scott · 36m spoken Harry Stebbings · 6m spoken
0:00 / 0:00
▶ Watch on YouTube →

gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions

In this deep-dive interview, Microsoft CTO Kevin Scott joins host Harry Stebbings to discuss the future of artificial intelligence, sharing insights on scaling laws, the transition from raw models to product-focused value, the rise of specialized autonomous agents, and the democratization of software development.

How this conversation actually went

Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Harry holds 15.5% of the talking time here. How this is scored →

Harry as informed peer 4.1 Guest teaching 3.8 Guest disagreement 1.4 Harry pushing back 3.3
05100:0015:0030:0045:000:00–2:07 · Harry as informed peer 2/10 Trailer Hook: The Best Time to Be Alive Harry sets up a classic venture capital framing on identifying sustainable value creation during tech shifts. Kevin responds warmly with historical parallels regarding early internet and mobile eras.2:07–4:21 · Harry as informed peer 2/10 Pragmatic Action & Focus on Product over Models Harry asks if investors should sit on their hands or act during confused transition periods. Kevin forcefully rejects the passive option and explains why models are not products.4:21–8:13 · Harry as informed peer 5/10 The Relationship Between Models, Infrastructure, and Products Harry challenges Kevin's 'models aren't products' stance by citing Cerebras CEO Andrew's view that compute holds the true value. Kevin reframes how infrastructure and platform layer value connect to end-user products.8:13–13:07 · Harry as informed peer 5/10 Scaling Laws and the Future of AI Capabilities Harry directly confronts Kevin on his contrarian dismissal of scaling law asymptotes. Kevin breaks down reasoning tokens versus factual recall tokens to explain why capability scaling continues.13:07–16:15 · Harry as informed peer 4/10 Inference Efficiency and the DeepSeek R1 Public Reaction Harry probes Microsoft's internal reaction to the DeepSeek R1 launch. Kevin downplays the breakthrough as part of an ongoing price-performance curve and reveals Microsoft held back superior models.16:15–18:59 · Harry as informed peer 3/10 Open Source vs. Proprietary AI and the Evolution of Pragmatism Kevin discusses his personal evolution from open-source zealot to pragmatic executive. He uses historical search engine market structure to illustrate how open and closed AI models will coexist.18:59–21:57 · Harry as informed peer 4/10 Beyond Chat: A New Paradigm of Human-Computer Interaction Harry questions whether chat interfaces are merely a temporary default UI. Kevin provides a broad historical overview tracing computing paradigms back 200 years to Ada Lovelace.21:57–25:41 · Harry as informed peer 6/10 The Rise of Specialized Agents and Domain-Expert Product Managers Harry pushes back firmly on the defensibility of AI developer agents, noting developers report no switching lock-in. Kevin counters with a search engine comparison to explain user retention.25:41–30:24 · Harry as informed peer 6/10 The Evolution of Agents: Memory, Asynchronous Action, and Optimism Kevin criticizes tech pessimists by asserting there is no prize for pessimism. Harry counters immediately by quoting the Collison brothers on pessimists being right while optimists make money.30:24–35:07 · Harry as informed peer 4/10 AI-Generated Code and the New Abstraction of Programming Kevin predicts 95% of future code will be AI-generated. He quizzes Harry on whether he is a programmer to explain how AI represents the next layer of abstraction in software engineering.35:07–39:01 · Harry as informed peer 4/10 Eliminating Technical Debt at Scale with AI Harry presses Kevin on where Microsoft has been slow despite its massive resources. Kevin explains Microsoft Research initiatives aimed at eliminating technical debt at scale using AI.39:01–46:54 · Harry as informed peer 4/10 Quick-Fire Round & Final Thoughts In the quick-fire round, Harry turns Kevin's histogram metaphor back on him to ask about his personal weaknesses. They also cover China's AI talent and medical diagnostic models.0:00–2:07 · Guest teaching 1/10 Trailer Hook: The Best Time to Be Alive Harry sets up a classic venture capital framing on identifying sustainable value creation during tech shifts. Kevin responds warmly with historical parallels regarding early internet and mobile eras.2:07–4:21 · Guest teaching 3/10 Pragmatic Action & Focus on Product over Models Harry asks if investors should sit on their hands or act during confused transition periods. Kevin forcefully rejects the passive option and explains why models are not products.4:21–8:13 · Guest teaching 4/10 The Relationship Between Models, Infrastructure, and Products Harry challenges Kevin's 'models aren't products' stance by citing Cerebras CEO Andrew's view that compute holds the true value. Kevin reframes how infrastructure and platform layer value connect to end-user products.8:13–13:07 · Guest teaching 5/10 Scaling Laws and the Future of AI Capabilities Harry directly confronts Kevin on his contrarian dismissal of scaling law asymptotes. Kevin breaks down reasoning tokens versus factual recall tokens to explain why capability scaling continues.13:07–16:15 · Guest teaching 4/10 Inference Efficiency and the DeepSeek R1 Public Reaction Harry probes Microsoft's internal reaction to the DeepSeek R1 launch. Kevin downplays the breakthrough as part of an ongoing price-performance curve and reveals Microsoft held back superior models.16:15–18:59 · Guest teaching 4/10 Open Source vs. Proprietary AI and the Evolution of Pragmatism Kevin discusses his personal evolution from open-source zealot to pragmatic executive. He uses historical search engine market structure to illustrate how open and closed AI models will coexist.18:59–21:57 · Guest teaching 6/10 Beyond Chat: A New Paradigm of Human-Computer Interaction Harry questions whether chat interfaces are merely a temporary default UI. Kevin provides a broad historical overview tracing computing paradigms back 200 years to Ada Lovelace.21:57–25:41 · Guest teaching 4/10 The Rise of Specialized Agents and Domain-Expert Product Managers Harry pushes back firmly on the defensibility of AI developer agents, noting developers report no switching lock-in. Kevin counters with a search engine comparison to explain user retention.25:41–30:24 · Guest teaching 3/10 The Evolution of Agents: Memory, Asynchronous Action, and Optimism Kevin criticizes tech pessimists by asserting there is no prize for pessimism. Harry counters immediately by quoting the Collison brothers on pessimists being right while optimists make money.30:24–35:07 · Guest teaching 5/10 AI-Generated Code and the New Abstraction of Programming Kevin predicts 95% of future code will be AI-generated. He quizzes Harry on whether he is a programmer to explain how AI represents the next layer of abstraction in software engineering.35:07–39:01 · Guest teaching 4/10 Eliminating Technical Debt at Scale with AI Harry presses Kevin on where Microsoft has been slow despite its massive resources. Kevin explains Microsoft Research initiatives aimed at eliminating technical debt at scale using AI.39:01–46:54 · Guest teaching 3/10 Quick-Fire Round & Final Thoughts In the quick-fire round, Harry turns Kevin's histogram metaphor back on him to ask about his personal weaknesses. They also cover China's AI talent and medical diagnostic models.0:00–2:07 · Guest disagreement 0/10 Trailer Hook: The Best Time to Be Alive Harry sets up a classic venture capital framing on identifying sustainable value creation during tech shifts. Kevin responds warmly with historical parallels regarding early internet and mobile eras.2:07–4:21 · Guest disagreement 2/10 Pragmatic Action & Focus on Product over Models Harry asks if investors should sit on their hands or act during confused transition periods. Kevin forcefully rejects the passive option and explains why models are not products.4:21–8:13 · Guest disagreement 1/10 The Relationship Between Models, Infrastructure, and Products Harry challenges Kevin's 'models aren't products' stance by citing Cerebras CEO Andrew's view that compute holds the true value. Kevin reframes how infrastructure and platform layer value connect to end-user products.8:13–13:07 · Guest disagreement 2/10 Scaling Laws and the Future of AI Capabilities Harry directly confronts Kevin on his contrarian dismissal of scaling law asymptotes. Kevin breaks down reasoning tokens versus factual recall tokens to explain why capability scaling continues.13:07–16:15 · Guest disagreement 2/10 Inference Efficiency and the DeepSeek R1 Public Reaction Harry probes Microsoft's internal reaction to the DeepSeek R1 launch. Kevin downplays the breakthrough as part of an ongoing price-performance curve and reveals Microsoft held back superior models.16:15–18:59 · Guest disagreement 0/10 Open Source vs. Proprietary AI and the Evolution of Pragmatism Kevin discusses his personal evolution from open-source zealot to pragmatic executive. He uses historical search engine market structure to illustrate how open and closed AI models will coexist.18:59–21:57 · Guest disagreement 1/10 Beyond Chat: A New Paradigm of Human-Computer Interaction Harry questions whether chat interfaces are merely a temporary default UI. Kevin provides a broad historical overview tracing computing paradigms back 200 years to Ada Lovelace.21:57–25:41 · Guest disagreement 3/10 The Rise of Specialized Agents and Domain-Expert Product Managers Harry pushes back firmly on the defensibility of AI developer agents, noting developers report no switching lock-in. Kevin counters with a search engine comparison to explain user retention.25:41–30:24 · Guest disagreement 2/10 The Evolution of Agents: Memory, Asynchronous Action, and Optimism Kevin criticizes tech pessimists by asserting there is no prize for pessimism. Harry counters immediately by quoting the Collison brothers on pessimists being right while optimists make money.30:24–35:07 · Guest disagreement 1/10 AI-Generated Code and the New Abstraction of Programming Kevin predicts 95% of future code will be AI-generated. He quizzes Harry on whether he is a programmer to explain how AI represents the next layer of abstraction in software engineering.35:07–39:01 · Guest disagreement 2/10 Eliminating Technical Debt at Scale with AI Harry presses Kevin on where Microsoft has been slow despite its massive resources. Kevin explains Microsoft Research initiatives aimed at eliminating technical debt at scale using AI.39:01–46:54 · Guest disagreement 1/10 Quick-Fire Round & Final Thoughts In the quick-fire round, Harry turns Kevin's histogram metaphor back on him to ask about his personal weaknesses. They also cover China's AI talent and medical diagnostic models.0:00–2:07 · Harry pushing back 0/10 Trailer Hook: The Best Time to Be Alive Harry sets up a classic venture capital framing on identifying sustainable value creation during tech shifts. Kevin responds warmly with historical parallels regarding early internet and mobile eras.2:07–4:21 · Harry pushing back 1/10 Pragmatic Action & Focus on Product over Models Harry asks if investors should sit on their hands or act during confused transition periods. Kevin forcefully rejects the passive option and explains why models are not products.4:21–8:13 · Harry pushing back 4/10 The Relationship Between Models, Infrastructure, and Products Harry challenges Kevin's 'models aren't products' stance by citing Cerebras CEO Andrew's view that compute holds the true value. Kevin reframes how infrastructure and platform layer value connect to end-user products.8:13–13:07 · Harry pushing back 5/10 Scaling Laws and the Future of AI Capabilities Harry directly confronts Kevin on his contrarian dismissal of scaling law asymptotes. Kevin breaks down reasoning tokens versus factual recall tokens to explain why capability scaling continues.13:07–16:15 · Harry pushing back 3/10 Inference Efficiency and the DeepSeek R1 Public Reaction Harry probes Microsoft's internal reaction to the DeepSeek R1 launch. Kevin downplays the breakthrough as part of an ongoing price-performance curve and reveals Microsoft held back superior models.16:15–18:59 · Harry pushing back 1/10 Open Source vs. Proprietary AI and the Evolution of Pragmatism Kevin discusses his personal evolution from open-source zealot to pragmatic executive. He uses historical search engine market structure to illustrate how open and closed AI models will coexist.18:59–21:57 · Harry pushing back 2/10 Beyond Chat: A New Paradigm of Human-Computer Interaction Harry questions whether chat interfaces are merely a temporary default UI. Kevin provides a broad historical overview tracing computing paradigms back 200 years to Ada Lovelace.21:57–25:41 · Harry pushing back 7/10 The Rise of Specialized Agents and Domain-Expert Product Managers Harry pushes back firmly on the defensibility of AI developer agents, noting developers report no switching lock-in. Kevin counters with a search engine comparison to explain user retention.25:41–30:24 · Harry pushing back 6/10 The Evolution of Agents: Memory, Asynchronous Action, and Optimism Kevin criticizes tech pessimists by asserting there is no prize for pessimism. Harry counters immediately by quoting the Collison brothers on pessimists being right while optimists make money.30:24–35:07 · Harry pushing back 2/10 AI-Generated Code and the New Abstraction of Programming Kevin predicts 95% of future code will be AI-generated. He quizzes Harry on whether he is a programmer to explain how AI represents the next layer of abstraction in software engineering.35:07–39:01 · Harry pushing back 5/10 Eliminating Technical Debt at Scale with AI Harry presses Kevin on where Microsoft has been slow despite its massive resources. Kevin explains Microsoft Research initiatives aimed at eliminating technical debt at scale using AI.39:01–46:54 · Harry pushing back 3/10 Quick-Fire Round & Final Thoughts In the quick-fire round, Harry turns Kevin's histogram metaphor back on him to ask about his personal weaknesses. They also cover China's AI talent and medical diagnostic models.

speaking balance: gold is Harry, purple is the guest (3 minute bins)

0:00 · Harry 38.8% · guest 61.2%0:00 · Harry 38.8% · guest 61.2%3:00 · Harry 27.6% · guest 72.4%3:00 · Harry 27.6% · guest 72.4%6:00 · Harry 9.5% · guest 90.5%6:00 · Harry 9.5% · guest 90.5%9:00 · Harry 14.5% · guest 85.5%9:00 · Harry 14.5% · guest 85.5%12:00 · Harry 15% · guest 85%12:00 · Harry 15% · guest 85%15:00 · Harry 14.7% · guest 85.3%15:00 · Harry 14.7% · guest 85.3%18:00 · Harry 12.2% · guest 87.8%18:00 · Harry 12.2% · guest 87.8%21:00 · Harry 16.9% · guest 83.1%21:00 · Harry 16.9% · guest 83.1%24:00 · Harry 17.7% · guest 82.3%24:00 · Harry 17.7% · guest 82.3%27:00 · Harry 3% · guest 97%27:00 · Harry 3% · guest 97%30:00 · Harry 14% · guest 86%30:00 · Harry 14% · guest 86%33:00 · Harry 13.6% · guest 86.4%33:00 · Harry 13.6% · guest 86.4%36:00 · Harry 1.9% · guest 98.1%36:00 · Harry 1.9% · guest 98.1%39:00 · Harry 19% · guest 81%39:00 · Harry 19% · guest 81%42:00 · Harry 15.6% · guest 84.4%42:00 · Harry 15.6% · guest 84.4%45:00 · Harry 14% · guest 86%45:00 · Harry 14% · guest 86%
Sharpest disagreement ▶ 2:22 Emphatic rejection of sitting on hands

When Harry asks if investors should sit on their hands during transitional confusion, Kevin bluntly interrupts with 'Oh god, no' and forcefully argues against passivity.

Hardest push from Harry ▶ 24:52 Challenging lack of agent lock-in

Harry interrupts Kevin's enthusiasm for software agents to directly challenge their economic value, pointing out that developers admit there is zero lock-in.

Biggest teaching moment ▶ 19:21 200-year history of computing paradigm reframe

Kevin reframes Harry's simple question about chat interfaces by schooling him on the fundamental shift in human-computer interaction since Ada Lovelace.

Harry holds his own ▶ 30:02 Pessimists are right and optimists make money

When Kevin claims there is no prize for pessimism, Harry instantly fires back with a Collison brothers quote defending the analytical accuracy of pessimists.

the scores for every segment, with the reasoning behind each
ChapterTopicHarry as informed peerGuest teachingGuest disagreementHarry pushing backWhy
Trailer Hook: The Best Time to Be Alive 2100 Harry sets up a classic venture capital framing on identifying sustainable value creation during tech shifts. Kevin responds warmly with historical parallels regarding early internet and mobile eras.
Pragmatic Action & Focus on Product over Models 2321 Harry asks if investors should sit on their hands or act during confused transition periods. Kevin forcefully rejects the passive option and explains why models are not products.
The Relationship Between Models, Infrastructure, and Products 5414 Harry challenges Kevin's 'models aren't products' stance by citing Cerebras CEO Andrew's view that compute holds the true value. Kevin reframes how infrastructure and platform layer value connect to end-user products.
Scaling Laws and the Future of AI Capabilities 5525 Harry directly confronts Kevin on his contrarian dismissal of scaling law asymptotes. Kevin breaks down reasoning tokens versus factual recall tokens to explain why capability scaling continues.
Inference Efficiency and the DeepSeek R1 Public Reaction 4423 Harry probes Microsoft's internal reaction to the DeepSeek R1 launch. Kevin downplays the breakthrough as part of an ongoing price-performance curve and reveals Microsoft held back superior models.
Open Source vs. Proprietary AI and the Evolution of Pragmatism 3401 Kevin discusses his personal evolution from open-source zealot to pragmatic executive. He uses historical search engine market structure to illustrate how open and closed AI models will coexist.
Beyond Chat: A New Paradigm of Human-Computer Interaction 4612 Harry questions whether chat interfaces are merely a temporary default UI. Kevin provides a broad historical overview tracing computing paradigms back 200 years to Ada Lovelace.
The Rise of Specialized Agents and Domain-Expert Product Managers 6437 Harry pushes back firmly on the defensibility of AI developer agents, noting developers report no switching lock-in. Kevin counters with a search engine comparison to explain user retention.
The Evolution of Agents: Memory, Asynchronous Action, and Optimism 6326 Kevin criticizes tech pessimists by asserting there is no prize for pessimism. Harry counters immediately by quoting the Collison brothers on pessimists being right while optimists make money.
AI-Generated Code and the New Abstraction of Programming 4512 Kevin predicts 95% of future code will be AI-generated. He quizzes Harry on whether he is a programmer to explain how AI represents the next layer of abstraction in software engineering.
Eliminating Technical Debt at Scale with AI 4425 Harry presses Kevin on where Microsoft has been slow despite its massive resources. Kevin explains Microsoft Research initiatives aimed at eliminating technical debt at scale using AI.
Quick-Fire Round & Final Thoughts 4313 In the quick-fire round, Harry turns Kevin's histogram metaphor back on him to ask about his personal weaknesses. They also cover China's AI talent and medical diagnostic models.

Statements from this episode (19)

Prediction Not checkable as stated
Scott: AI agents will become less transactional and session-oriented
“The agents, they will definitely be less transactional, less session-oriented going forward.”
Kevin Scott Mar 31, 2025 ▶ 0:25
Insight
Scott: AI's economic value will accrue to products, not infrastructure
“But most of the value has to be in the products. Like, you know, we don't build infrastructure just for the sake of infrastructure. Like we build infrastructure so people can make product.”
Kevin Scott Mar 31, 2025 ▶ 5:22
Assertion Not checkable as stated
Scott: AI scaling laws have not hit a limit yet
“I can very clearly see what we're doing now and like what we're doing next. And I don't see the limit to the scaling laws. Like if you're just sort of thinking about the raw capability of the models and like how well you can condition them to reason over incre…”
Kevin Scott Mar 31, 2025 ▶ 8:31
Assertion Not checkable as stated
Scott: Claims about proprietary data's value for AI lack scientific backing
“Most of those assertions that people make are like most of the assertions that people make are just unfounded in any kind of science. Like no, no one's gotta, and like the measurements we do have show that there's a pretty big disconnect around what some peopl…”
Kevin Scott Mar 31, 2025 ▶ 11:50
Insight
Scott: Using AI models as factual databases is inefficient and expensive
“People who think of models as repositories of factual information, and they're treating them like the world's worst and most expensive databases. Like it's not, not super useful.”
Kevin Scott Mar 31, 2025 ▶ 12:18
Insight
Scott: Reasoning models require different training tokens than fact recallers
“What you want models to be able to do is to be able to reason over information. So like if you give them access to information, like how well are they able to reason over a set of information to go do something that's useful for you? And so you just need diffe…”
Kevin Scott Mar 31, 2025 ▶ 12:40
Assertion Supported
Scott: Software optimizations drive AI inference efficiency far more than hardware
“A little bit of that is because you get, you know, maybe like a two X benefit price performance from hardware every generation. Like if you're lucky but you get a much bigger improvement price performance wise from. All of the things that you're doing in the s…”
Kevin Scott Mar 31, 2025 ▶ 14:12
Disclosure
Scott: Microsoft chose not to launch models more interesting than DeepSeek-R1
“We've had models more interesting than Deep Seek R-One that, like, we didn't even We chose not to even launch them.”
Kevin Scott Mar 31, 2025 ▶ 15:05
Assertion Not checkable as stated
Scott: Search economics flow entirely to large integrated infrastructure operators
“All of the economics in search go to like somebody who's stood up a gigantic infrastructure and who's sort of running like a whole. Search business like with its own feedback loop.”
Kevin Scott Mar 31, 2025 ▶ 18:02
Prediction Not checkable as stated
Scott: AI will render traditional product engineering teams obsolete within ten years
“It basically means, and like, I don't think this is next year, but it's probably not going to be 10 years. This whole notion that the, That, that you have teams of people who are, who, whose job is to go anticipate a bunch of very granular user needs in some n…”
Kevin Scott Mar 31, 2025 ▶ 20:35
Prediction Not checkable as stated
Scott: Future AI user interfaces will consist of many specialized agents
“The user interface that surfaces, those capabilities will probably be agents. And, you know, product managers, like I don't all don't believe in this, like one agent. For everything sort of theory. I think you'll have a lot of agents.”
Kevin Scott Mar 31, 2025 ▶ 22:32
Prediction Not checkable as stated
Scott: Future AI product managers must be deep domain experts
“Your product managers are probably going to have to be domain experts, like people who sort of deeply understand something like medicine or, you know, drug discovery or early round venture investing, or, you know, like, you know, just sort of pick your thing.”
Kevin Scott Mar 31, 2025 ▶ 22:53
Prediction Not checkable as stated
Scott: AI agent memory will improve significantly over the next year
“I think one of the things is going to happen because I know lots of people are working on it right now is memory is going to get a lot better over the next year or so, which means that as you're using an agent, like, and it remembers more and more about your p…”
Kevin Scott Mar 31, 2025 ▶ 26:08
Prediction Not checkable as stated
Scott: AI agents will execute tasks asynchronously within the next year
“I think there's going to be more over the next year of you sort of dispatching your agent to go do something and it like goes and works while you are not paying attention to it.”
Kevin Scott Mar 31, 2025 ▶ 27:17
Prediction Open · timeframe Mar 2030
Scott: 95% of net new code will be AI-generated within five years
“95% is going to be AI generated. I think very little is going to be line by line is going to be human written code.”
Kevin Scott Mar 31, 2025 ▶ 30:30
Disclosure
Scott: Microsoft Research launched an initiative to eliminate technical debt using AI
“There's a big research initiative. We've started at Microsoft research about a year ago where like the whole mission of the lab is like eliminate tech debt at scale using these new AI tools.”
Kevin Scott Mar 31, 2025 ▶ 38:17
Insight
Scott: The gap between AI capability and utilization is growing larger
“Like, I think honestly right now there's a bigger gap than there was even two years ago between what the most capable frontier models can do and what they're being used for.”
Kevin Scott Mar 31, 2025 ▶ 38:50
Opinion
Scott: The tech industry must respect the capabilities of Chinese AI developers
“So we should really, really, really respect the capability of Chinese entrepreneurs, scientists, and engineers. They are very good. Like we shouldn't, you know, if you are underestimating it like you shouldn't”
Kevin Scott Mar 31, 2025 ▶ 42:48
Assertion Supported
Scott: Frontier AI models diagnose health issues better than average GPs
“It is already the case that I think the frontier models are probably better like health diagnosticians than Your average GP is”
Kevin Scott Mar 31, 2025 ▶ 43:29

Shorts cut from this episode

▶ The Genius Strategy Everyone Gets Wrong · 20VC with Harry St (@39:25) ▶ "This advice stuck with me” 😮 · 20VC with Harry Stebbings (@39:25) ▶ Why We’ll Have Multiple AI Agents 🤖 · 20VC with Harry Stebb (@0:13) ▶ Is this the biggest mystery in AI? 🤖 · 20VC with Harry Steb (@11:13) ▶ “AI Models Aren’t Products” 🤔 · 20VC with Harry Stebbings (@3:00) ▶ “Now is the best time to be an Entrepreneur” 📈 · 20VC with (@0:00)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.