Oct 4, 2024 · 42m · big-technology
Meta's Chief Technology Officer On Its Augmented Reality Dreams — With Andrew Bosworth
0:00 / 0:00
▶ Watch on YouTube →
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
In this episode of the Big Technology Podcast, Meta CTO Andrew Bosworth discusses the breakthrough engineering behind the Orion augmented reality glasses, the integration of ambient and agentic AI, and Meta's long-term hardware strategy to define the next major computing paradigm.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Alex holds 18.5% of the talking time here. How this is scored →
Alex as informed peer 4.5 Guest teaching 4.4 Guest disagreement 1.6 Alex pushing back 2.0
speaking balance: gold is Alex, purple is the guest (3 minute bins)
Sharpest disagreement ▶ 31:12 Category Error Rejection
Bosworth rejects the premise that AI models are nearing consciousness, explicitly calling the concept a category error and framing current architectures strictly as associative databases.
Hardest push from Alex ▶ 15:50 Insulation Against Platform MonopolyAlex challenges Bosworth on Meta's competitive vulnerability, quoting his past remarks to push on whether custom silicon can truly insulate them from Apple's platform advantages.
Biggest teaching moment ▶ 26:40 Myelination and Neural Interface BiologyBosworth educates Alex on why consumer invasive brain implants are medically unviable, citing clinical data on tissue myelination and skull insulation requiring repeated invasive surgeries.
Alex holds their own ▶ 10:20 App Store Fees and Anti-Steering PushAlex demonstrates industry depth by immediately pinning Meta's platform grievances down to specific App Store policies, fee structures, and ATT tracking limitations.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | Alex as informed peer | Guest teaching | Guest disagreement | Alex pushing back | Why |
|---|---|---|---|---|---|---|
| Hands-On Experience with Orion Augmented Reality Glasses | 4 | 3 | 1 | 1 | Alex relates his immediate impressions from demoing the Orion AR glasses, asking practical questions about Bosworth's personal usage. Bosworth warmly explains the hardware bring-up and practical in-meeting backchannel utility without friction. | |
| Real-World Presence, Notifications, and Contextual Awareness | 4 | 4 | 1 | 2 | Alex raises the concern of digital distraction and whether glasses pull people further away from real-world presence. Bosworth reframes notifications as an anti-pattern and explains how contextual AI awareness solves the disruption issue. | |
| Proactive AI Assistance and Moving Beyond Smartphone Paradigms | 4 | 4 | 1 | 3 | Alex questions the fundamental consumer need for AR glasses given the ubiquity of smartphones. Bosworth provides a historical perspective on computing adoption cycles and explains how proactive AI assistance eliminates device friction. | |
| Strategic Independence and Meta's Long-Term Commitment to AR | 5 | 4 | 2 | 2 | Alex presses on Meta's core strategic rationale, noting past mobile platform vulnerabilities and App Store frictions. Bosworth agrees on the strategic gatekeeper problem with Apple, but highlights technological ambition and long-term vision under Zuckerberg. | |
| Architectural Design and Novel Interaction Paradigms for AR | 5 | 5 | 2 | 3 | Alex questions platform insulation and quotes Bosworth's remarks regarding potential competitive hardware moves from Apple. Bosworth breaks down the unique architectural requirements of non-direct manipulation operating systems, distinguishing Meta's purpose-built focus from Apple's phone-centric ecosystem. | |
| Rethinking the App Model and the Emergence of Agentic AI | 5 | 5 | 2 | 2 | Alex asks whether dedicated applications will become obsolete in an era dominated by ambient multimodal and voice AI. Bosworth delivers an intellectual deep dive from early DARPA computing history to agentic intermediary layers atop existing app boundaries. | |
| Fluid Computing, Theory of Mind, and Empowering Superpowers | 4 | 4 | 1 | 1 | Alex asks whether AR glasses will fully replace smartphones or merely augment them. Bosworth explains how computing currently lacks a theory of mind and intentionality, contrasting blunt algorithmic responses with intuitive contextual super-tools. | |
| Non-Invasive Neural Interfaces and Limitations of Brain Implants | 5 | 6 | 2 | 2 | Alex probes whether non-invasive neural wristbands are simply stepping stones toward invasive brain-computer implants. Bosworth draws on clinical research with UCSF and undergraduate neurobiology to detail biological hurdles like myelination and skull insulation that make consumer implants impractical. | |
| Philosophical Views on AI Consciousness and Associative Databases | 4 | 5 | 3 | 2 | Alex asks whether Bosworth believes modern AI is approaching consciousness or if humans will merge with AI. Bosworth firmly rejects AI consciousness claims as a category error, referencing Douglas Hofstadter to frame LLMs as generative associative databases. | |
| Differentiating Virtual Reality Headsets and Augmented Reality Glasses | 4 | 4 | 1 | 2 | Alex asks how Meta positions VR/MR headsets against lightweight AR glasses and how developers should navigate the ecosystem. Bosworth draws an analogy to the phone versus laptop dichotomy, explaining that full immersion and ambient awareness serve distinct physiological and interaction needs. | |
| Open-Source AI Strategy and Value Accrual in Foundation Models | 5 | 4 | 1 | 2 | Alex initiates a discussion on value accrual between foundation model providers and application layers. Bosworth articulates Meta's strategy to commoditize its complements by open-sourcing Llama while anticipating application-layer dominance. |
Statements from this episode (27)
Bosworth: Orion AR Glasses Hardware Emerged in 2023, Software in Mid-2024
“The hardware came up last year at this time. And so the software bring up really only came together a few months ago and they just made incredible progress since then already.”
Bosworth: Meta's Orion Codec Avatars Fooled Video Call Recipients
“And then conversely, what they would see is your codec avatar. And we've really fooled some people with the codec avatars. When they've seen the codec avatar call in they don't realize it's a codec avatar. They think it's a real, an image.”
Bosworth: Building smart glasses purely for notifications is an anti-pattern
“Anti-patterns that I've been telling people about for these glasses is just having to be notification services because notification services are an invitation to leave the present moment and instead go elsewhere. Like that's what a notification is intended to …”
Bosworth: Meta expected holograms before AI in smart glasses roadmap
“We really thought early on when we were developing these, even until maybe a year ago, it was going to be holograms and then at some point later, AI. And in fact, it's going to be the opposite. The AI is going to come first. It's already come to the Meta Ray-B…”
Bosworth: Meta is prototyping a persistent three-panel AR workstation
“One of the fun demos that we have in prototyping, it's not even in the demo that you tried yet is this cool thing where you have your whole workstation set up. So you've got like a three panel workstation set up. And then you like just get up and walk around a…”
Bosworth Uses Meta AI 10x More On Ray-Ban Glasses Than Phone
“Now I have Meta AI on the Ray-Ban Meta glasses, and it's like, oh, I use it 10 times more often because just the friction of, like, getting my phone out of my pocket and, like, pulling it up and, like, pulling the app is not trivial to me being able to just, l…”
Bosworth: Smart glasses will offer proactive assistance smartphones cannot match
“Because the glasses are on your face, they're not in your pocket, and they have the ability over time, not immediately, to become aware of the world and to understand what you're trying to do in the world they can actually be very proactively helpful just to y…”
Bosworth: Mobile Gatekeepers, Especially Apple, Stifle Meta's Application Development
“Strategically, we have just been at the mercy of platforms for since the start of the mobile era. And we were a web company, right? We were born of the web, and the web was this, like, amazing, unowned platform that you just, like really had a lot of control o…”
Bosworth: Apple's ATT Self-Preferencing Slowed Down the Games Industry
“We built a app install business and then Apple came for that with ATT, you know, a tremendous amount of kind of self-preferencing for themselves there. And in doing so, they really put a, you know, the brakes on what was a really rapidly growing part of the ga…”
Bosworth: AR Glasses Will Be Usable and Enjoyed Within a Decade
“It's within our lifetime, certainly within the next decade, it's in our view we're going to be able to use and enjoy this technology.”
Bosworth: Meta's Magnesium Orion Glasses Last 2–3 Hours on Battery
“The ones that we actually use are have opaque magnesium shells. The clear transparent ones are super fun to have. They don't, they only work for about half an hour at a time before the thermal shut down because this plastic does not dissipate heat fast enough.…”
Bosworth: Meta uses low-level Android as OS foundation for AR/VR
“You know, we're all, we're using Android at the most underlying low level as the operating system.”
Bosworth: AR is history's first computing platform without direct manipulation
“Well, it's worth noting this is really the first computing platform that we've had ever that didn't have a direct manipulation interface.”
Bosworth: Meta has meaningful tech lead in AR over Apple
“I think we've been investing longer. I think we've believed in it more. And as a consequence of frankly, Mark Zuckerberg's faith and tremendous execution by a team of Thousands of people over a long period of years. I think we have a meaningful lead in a bunch…”
Bosworth: Apple will block third-party AI agents from intermediating iPhone apps
“That is not something that Apple wants some other developer to be able to do, because that would disintermediate their position, their privileged position on the phone.”
Bosworth: App model will not disappear, but gain agentic layer
“So I think the application model doesn't go away. But I do think you end up injecting this potential new layer on top of it, which is an agentic layer.”
Bosworth: Direct manipulation interfaces will persist alongside voice AI
“I think voice is probably not the only piece of it. Voice and text are part of it. I'm sure there will still be a lot of very direct manipulation interfaces for a long time to come.”
Bosworth: AR will conceivably replace smartphones for high-end consumers over time
“We're a long ways from that for a bunch of reasons, not the least of which being the technology is not ready yet, but also because The application ecosystems will take a long time to transfer and user behaviors take a long time to change. So I think we have a …”
Bosworth: Wrist neural interfaces will eventually work without physical gestures
“Over time, we think we can do that without having any gestures at all. Just having the intention, expressing the intention down your control system.”
Bosworth: Invasive brain implants are a consumer non-starter due to myelination
“There's a couple of challenges, one of which is that the brain myelinates the things that are put there, so they become electrically inert over time. So they have to be removed and replaced. And if you leave them in long enough, they can prove fatal or at leas…”
Bosworth: LLMs cannot be conscious and are merely associative databases
“And also I do not believe it is even the kind of thing from which consciousness exists. It doesn't exist in any Again, to my point about Doug Hofstetter it doesn't exist in any self-referential loop. In fact, it doesn't exist at all except when I instantiate i…”
Bosworth: AR Glasses Will Not Replace VR Headsets
“And so I think there continue to be, even when you have these wonderful AR glasses things that can be done in virtual and mixed reality that can be done no other way. Your augmented reality glasses will never convince you that gravity is off because you can li…”
Bosworth: Smartphones haven't changed in 10 years and stifle developer innovation
“The market's super efficient. And so, yep, there's a lot of people on the phone, but it's also the hardest place to get noticed or stand out. It's the hardest place to do new things. Cause there's nothing new that you can do there. It's all been done before. P…”
Bosworth Strongly Advocated Internally For Meta To Open-Source LLaMA
“I was one of the loudest voices internally to channel, encouraging us to open source Llama one, Llama two.”
Bosworth: Tech companies should always commoditize their complements
“And you want to always commoditize your compliments. You always want to make sure that the thing that you depend on is like cheap and getting better by a lot of people, not just by your effort and money.”
Bosworth: Bulk of AI value will accrue to applications, not foundation models
“I think the bulk of the value though, so there will be valuable companies there, but the bulk of the value will be in the application side.”
Bosworth: Pre-LLM virtual assistants had the worst scaling laws in software
“When we got into building our own assistant, I could not believe the, how poorly they scale you because you have to build it for every language, for every device, and for every use case. Oh my gosh, that's not software. That's the worst scaling laws of all tim…”