Apr 4, 2025 · 52m · big-technology
Microsoft AI CEO Mustafa Suleyman: Building AI Personality
0:00 / 0:00
▶ Watch on YouTube →
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
Alex Kantrowitz interviews Microsoft AI CEO Mustafa Suleyman about the transformation of Copilot into an emotionally intelligent, proactive AI companion equipped with autonomous agentic capabilities and persistent memory. Suleyman also delivers critical perspectives on foundational model scaling, Microsoft's strategic partnership with OpenAI, the realistic timeline toward AGI, and the macroeconomic future of AI-assisted human labor.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Alex holds 33.7% of the talking time here. How this is scored →
Alex as informed peer 6.1 Guest teaching 3.6 Guest disagreement 2.3 Alex pushing back 3.8
speaking balance: gold is Alex, purple is the guest (3 minute bins)
Sharpest disagreement ▶ 24:34 Mustafa forcefully rejects LLM scaling stagnation
Mustafa immediately shuts down the conventional narrative that LLMs are experiencing diminishing returns with an emphatic 'No way Jose' and argues that pre-training and inference gains remain massive.
Hardest push from Alex ▶ 28:58 Alex challenges scaling narrative with Reuters data center reportAlex refuses to simply take Mustafa's optimism at face value, directly reading reporting from Reuters showing Microsoft backed out of data center projects totaling two gigawatts of power.
Biggest teaching moment ▶ 29:25 Mustafa explains data center procurement and option contractsMustafa educates Alex on corporate infrastructure accounting, explaining that speculative exploration contracts and unexecuted options were incorrectly reported by journalists as operational cancellations.
Alex holds their own ▶ 41:39 Alex corners Mustafa on the contract-ending AGI thresholdWhen Mustafa insists Microsoft's partnership with OpenAI is secure through 2030, Alex demonstrates insider contract knowledge by bringing up the clause where OpenAI is freed from its obligations once AGI is reached.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | Alex as informed peer | Guest teaching | Guest disagreement | Alex pushing back | Why |
|---|---|---|---|---|---|---|
| Upgrading Copilot with Memory, Actions, and Avatars | 5 | 2 | 1 | 2 | Alex opens with a clear breakdown of Microsoft's Copilot announcements including memory, actions, and avatars, drawing comparisons to OpenAI's memory features. Mustafa details his vision for transitioning from raw intelligence (IQ) to emotional intelligence (EQ) in consumer AI. | |
| Personality Engineering and Setting Emotional Boundaries | 6 | 3 | 2 | 3 | Alex brings up industry benchmarks like Replika and Panos Panay's Amazon efforts to probe how Microsoft plans to differentiate. Mustafa explains the concept of 'personality engineering' and emphasizes strict boundaries against romantic attachments. | |
| Chatbot Refusals and Proactive Companion Features | 6 | 4 | 2 | 3 | Alex highlights industry issues around chatbot refusals and Microsoft's infamous 'Sydney' incident, asking whether safety guards will loosen. Mustafa explains the shift from reactive to proactive companion computing while defending a cautious balance on autonomy. | |
| Debating LLM Scaling Limits and Data Center Infrastructure | 7 | 5 | 4 | 6 | Alex challenges Mustafa on LLM scaling limits and quotes Reuters reporting that Microsoft abandoned 2GW of data center leases due to oversupply. Mustafa flatly rejects the scaling ceiling with 'No way Jose' and explains that the Reuters story confused unexercised option exploration with real demand pullbacks. | |
| Efficient Internal Models, Reasoning Compute, and Economics | 7 | 4 | 2 | 4 | Alex references Jensen Huang's compute claims and quotes thinkers like Chris Dixon and Ethan Mollick while questioning the high unit economics of serving anime images or travel booking. Mustafa articulates Microsoft's Pareto-optimal model strategy and explains how reasoning compute and historical tech deflation justify the investment. | |
| Microsoft's Partnership and Investment Dynamics with OpenAI | 7 | 4 | 3 | 6 | Alex presses on conflicting incentives between Microsoft and OpenAI, specifically raising the contractual clause where an AGI declaration releases OpenAI from licensing obligations. Mustafa frames AGI as a paradigm shift where commercial contract details become irrelevant compared to societal impact. | |
| AGI Timelines and the Evolution of Conversational Search | 6 | 4 | 3 | 4 | Alex contrasts Mustafa's decade-long AGI timeline with Demis Hassabis's shorter 3-to-5-year forecast and asks how conversational AI disrupts Google search and advertising. Mustafa clarifies his wording ('a decade, not decades') and explains why traditional ten blue links are obsolete. | |
| The Future of Labor, Advice for Youth, and Brand Trust | 5 | 3 | 1 | 2 | Alex asks about white-collar job displacement, practical guidance for students entering the workforce, and the future of corporate branding. Mustafa proposes focusing on 'Artificial Capable Intelligence' and argues that brand trust will become essential for emotional rapport. |
Statements from this episode (17)
Suleyman: Copilot will take control of Windows mouse to execute tasks
“Things like it will now be able to take control of your mouse on windows, navigate around, show you, for example, where to turn on a particular setting or to fill out a form or like you may not know how to edit a photo and it'll point out where you need to adj…”
Suleyman: Personal AI companions will be the next major computing platform
“I genuinely think This is going to be the next platform of computing, just as, you know, we had desktops and laptops and smartphones and wearables, and I think over time we're going to have deep and meaningful lasting relationships with our personal AI compani…”
Suleyman: There will be as many AI companions as people
“We are like at the very beginning of a new era where there are going to be as many copilots or AI companions as there are people. There are going to be agents in the workplace that are doing work on our behalf.”
Suleyman: AI development is engineering tokens for feelings, not pixels
“We're no longer just engineering pixels. We're engineering tokens that create feelings, that create lasting, meaningful relationships.”
Suleyman: Copilot uses real-time classifiers to block romantic attachment
“We have classifiers that detect for any of that kind of interaction in real time and will very respectfully and, but very clearly and very firmly push back before anything like that develops. So we have a very, very low instance rate of that.”
Suleyman: Computing will shift from reactive commands to proactive AI actions
“I think that's the big shift that's about to happen. So far, your computer really only ever does stuff when you click a button or, you know, you type something in your keyboard. Now it's going to be proactive. It is going to offer suggestions to you. It'll pro…”
Suleyman: AI memory, personalization, and actions are currently at their 'GPT-3 stage'
“I can see now, having been through this cycle a few times, that we're nearly there with memory, personalization, and actions. It's really at the GBT-III stage, so it's really buggy and stuff, but when it works, it's breathtaking.”
Suleyman: Microsoft Has Contracted 32 to 34 GW of Renewable Power Since 2020
“I think that we've like something like 32 or 34 gigawatts of renewable energy. Since 2020, we've contracted and consumed. So I think we're one of the largest buyers in, in the world.”
Suleyman: All OpenAI Inference Runs on Microsoft, With No Partnership Slowdown
“All of their inference comes through us, and so we, there's no slowdown in our you know, relationship with them. We sell them as much as we want to offer them, and then if there's any extra demand that they have, particularly on the, you know on the Oracle sid…”
Suleyman: Newer models match GPT-3 performance at 100x inference efficiency
“I mean, there are folks who have trained models that perform as well as GPT-III that are a hundred times more inference efficient
that cost an order of magnitude less to train and yet they can still deliver the same predictive capability.”
Suleyman: GPT-4 and GPT-4o Efficiency Will Improve 100x
“So I expect that to happen for GPT-IV, GPT-IV-O and all of the other models down the road.”
Suleyman: Microsoft's OpenAI partnership will last through 2030 and beyond
“Whilst we have a incredibly deep partnership with them, which is going to last way through 20, 30 and beyond,”
Suleyman: AGI is not 2-3 years away, likely a decade away
“It doesn't instinctively feel to me like we're two to three years away. I know some people think that it is, and I respect them deeply. Like a lot of smart people can disagree on stuff like that. I feel like we're still a good decade or so away. And when a sci…”
Suleyman: Conversational AI will replace traditional '10 blue links' search
“I think it's going to fundamentally change. I think instead of browsing 10 blue links, you're just going to ask your AI. It's going to give you a super succinct answer, show you images, maps, videos, all in the feed. You're going to give feedback and be like, …”
Suleyman: Advertising will play an enormous part in AI search
“I still think ads are going to play an enormous part of it. Hopefully those ads are higher quality more personalized, more useful.”
Suleyman: Reasoning models taking desktop action will be cheap and abundant within 15 years
“That's the transition that's going to happen over the next 15 years is that it is going to be a cheap and basically abundant resource to have these reasoning models that can take action in your workplace, that can orchestrate your apps and get things done for …”
Suleyman: Brand is more important in AI due to emotional trust and utility
“I think brand is actually more important than ever in a way, because there's sort of two modes of trust. There's trust based on utility, where it's functionally correct. It's, you know, factually accurate. It does the thing that you've intended it to do, and t…”