Nov 22, 2022 · 1h 28m · a16z
Neal Stephenson on the Future of the Metaverse
0:00 / 0:00
▶ Watch on YouTube →
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
In this episode of The a16z Podcast, host Steph Smith interviews author and Lamina One co-founder Neal Stephenson about defining the metaverse, the practical limits of spatial hardware, creator IP rights in the age of generative AI, and technological approaches to climate change.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. The host holds 26.2% of the talking time here. How this is scored →
The host as informed peer 4.5 Guest teaching 4.3 Guest disagreement 1.8 The host pushing back 1.5
speaking balance: gold is the host, purple is the guest (3 minute bins)
Sharpest disagreement ▶ 10:20 Dismissing Web3 Crypto Ideology in Gaming
Neal strongly criticizes crypto proponents pushing extraneous items into established games, calling their suggestions aesthetically offensive and in the 'not even wrong' category of technical ignorance.
Hardest push from the host ▶ 59:50 Refusing the 'Transparent Infrastructure' LabelSteph pushes Neal on whether Lamina One functions as a transparent layer beneath existing game engines, leading Neal to reject the word 'transparent' because financial mechanisms must be explicitly visible to creators.
Biggest teaching moment ▶ 14:38 Dismantling the AR/VR Metaverse MythNeal corrects the popular assumption that the metaverse requires headsets, explaining how billions of people comfortably access 3D spaces on 2D screens and citing VR motion sickness rates as a major adoption barrier.
The host holds their own ▶ 30:00 Recalling Stephenson's Electricity AnalogySteph demonstrates her knowledge by quoting Neal's own metaphor back to him—comparing initial uses of electricity for light to unexpected second-order innovations like electric guitars—to guide the discussion on generative AI.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | The host as informed peer | Guest teaching | Guest disagreement | The host pushing back | Why |
|---|---|---|---|---|---|---|
| Science Fiction Novels as Corporate Roadmaps | 3 | 2 | 1 | 0 | Steph opens by quoting computer scientist Francois Chollet on sci-fi authors being high-impact tech strategists. Neal enthusiastically agrees, referencing his work with Arizona State University and the Hieroglyph anthology. | |
| Defining the Singularity of the Metaverse | 3 | 5 | 2 | 1 | Steph asks if current digital activities like TikTok or online auctions constitute the metaverse. Neal reframes the premise, citing Tony Parisi's first rule that there is only one unitary metaverse rather than multiple disjointed ones. | |
| Building Interoperable Bridges Across Virtual Worlds | 4 | 3 | 1 | 2 | Steph demonstrates industry knowledge by bringing up a recent consortium of 37 tech companies trying to establish open metaverse standards. Neal explains how bottom-up interoperability bridges will emerge organically between dominant games like Fortnite and Roblox. | |
| Game Developers versus Web3 Ideology on Interoperability | 4 | 6 | 4 | 1 | Steph addresses tension between game developers and Web3 proponents. Neal sharply critiques Web3 advocates, describing their technical misunderstandings as 'not even wrong' and aesthetically offensive to game designers who protect curated world integrity. | |
| The Necessity of VR and AR in Spatial Hardware | 4 | 7 | 3 | 2 | Steph asks about the necessity of 3D hardware for metaverse entry. Neal directly rejects his own 30-year-old vision from Snow Crash, explaining that 2D screens with WASD controls are sufficient and pointing out that VR motion sickness rates create a high commercial barrier. | |
| Session Durations and Physical Limitations of Virtual Hardware | 5 | 5 | 2 | 2 | Steph offers an insightful breakdown of why virtual spaces needlessly replicate physical constraints like roofs and scarcity. Neal validates her point while citing evolutionary psychology and Tim O'Reilly to explain why human comfort requires familiar architectural structures. | |
| Content Creation and Environmental Mapping at Magic Leap | 3 | 4 | 1 | 1 | Steph asks about lessons learned from Magic Leap's enterprise pivot. Neal explains the technical details of real-time computer vision mapping and building responsive content stacks on top of physical surroundings. | |
| Generative AI and Emergent Behaviors in Virtual Spaces | 6 | 4 | 1 | 1 | Steph shows deep familiarity with Neal's prior commentary by quoting his exact analogy about electricity enabling electric guitars rather than just lightbulbs. Neal uses this to illustrate emergent AI behaviors in virtual environments like his 'Baby Goats' project. | |
| Intellectual Property, Generative AI, and Smart Contract Waterfalls | 4 | 5 | 1 | 1 | Steph raises questions around generative AI training data and intellectual property ownership. Neal explains how smart contract waterfalls can track asset provenance and distribute revenue streams automatically, comparing it to Hollywood accounting. | |
| Managing Creator Value Chains and Derivative IP Rights | 6 | 3 | 1 | 2 | Steph demonstrates current tech awareness by referencing a Stable Diffusion Reddit thread that converts simple drawings into high-def game assets. Neal details the necessity of creator approval rights and third-party rating systems to protect original IP. | |
| NFT Evolution and Fixing Social Media Revenue Models | 5 | 4 | 2 | 2 | Steph contrasts the dystopian satire of Snow Crash with the organic, consensus-driven world of Bitworld, asking how to design non-dystopian tech. Neal highlights how current ad-driven social media models incentivize outrage and discusses Jaron Lanier's proposed data unions. | |
| Lamina One: Base Layer Infrastructure for the Open Metaverse | 5 | 4 | 2 | 2 | Steph quotes the Lamina One website verbatim and queries why a Layer 1 blockchain was necessary. She gently challenges whether Lamina One acts as a transparent underlying layer, prompting Neal to clarify that economic mechanisms must be explicitly visible to creators. | |
| Game Industry Hesitation, Payment Workflows, and Carbon Neutrality | 5 | 4 | 2 | 2 | Steph inquires about gaming industry hostility toward Web3, noting Minecraft's recent ban on crypto. Neal outlines how Proof of Stake and carbon credit verification in Lamina One aim to overcome regulatory and environmental objections. | |
| Creative Process, Engineering Details, and Sci-Fi Origins | 6 | 5 | 2 | 2 | Steph quotes a specific passage from Snow Crash regarding corporate game programming culture to ask how Neal foresaw remote work dynamics. Neal corrects her timeline, clarifying the book was written in the late 1980s based on his own experience as a solo coder. | |
| Addressing Political Polarization and Pacing Tech Acceleration | 5 | 4 | 2 | 1 | Steph frames a query around exponential tech development outpacing human culture. Neal points out that digital technology moves so fast today that science fiction is actually trailing behind reality rather than predicting it. |
Statements from this episode (26)
Stephenson: AR and VR are not required to build the metaverse
“We absolutely do not need AR and VR in order to build the metaverse.”
Stephenson: Sci-fi novels align tech teams better than corporate PowerPoints
“In some cases, not all, but some cases, a science fiction novel can serve as a kind of template or a roadmap to organize the activities of a company or an open source group that's more effective than typical corporate communication strategies.”
Stephenson: Widely used modern technology is pre-metaverse, not true metaverse
“In general, to address the specific things that you mentioned I think anything that's being used a lot today probably is not very metaverse-like, because in general, when people talk about the metaverse, they're talking about the next thing that's coming along…”
Stephenson: The metaverse is a single unitary space, not multiple metaverses
“Tony Parisi has got seven rules of the metaverse, and rule number one is that there's only the metaverse. There's not a bunch of metaverses. So that, for me, is a strong indicator. If I see someone talking about our metaverse or a metaverse, yeah, I immediatel…”
Stephenson: Metaverse standards will emerge via ad-hoc collaboration, not top-down control
“There's not going to be one top-down big boss that says, here's how it's all going to work. It's going to be some ad hoc arrangements of people trying to work together.”
Stephenson: Fortnite, Roblox, and Minecraft are closest to real metaverse experiences
“I think that the closest things that we currently can see to metaverse-like experiences are games like Fortnite, Roblox, Minecraft, where you've got a bunch of people running around in a space.”
Stephenson: Major game ecosystems will build cross-platform metaverse bridges in coming years
“I suspect that they're talking to one another about how do we build a bridge from our game or our experience to your game so that a person could go from one to the other. It may take some years to really come together, but I think it will come together.”
Stephenson: Crypto interoperability ideology clashes with practical game design
“A lot of the controversy that has that we've been seeing the last, you know, year or so on social media, you know, arises from kind of this friction between the sort of Almost ideological commitment to crypto and interoperability that you see on the part of cr…”
Stephenson: 5% to 10% of high-end VR users suffer motion sickness
“The last I've heard is like maybe five, 10% state-of-the-art quality VR are going to experience some symptoms.”
Stephenson: AR untethered from physical space is just bad VR
“By its nature, when you're in an AR experience, it is or it should be somehow tied to the environment you're sitting in. Because if it's not, it's just VR. It's just kind of bad VR.”
Stephenson: VR headsets are only suitable for 30-45 minute sessions
“For me, if it's a good VR experience, I like going into that level of immersion for half hour, 45 minutes, and having a really intense experience. Beyond that, just the experience of having this thing on my face, not being able to see my real environment not b…”
Stephenson: Mass-market metaverses must enforce standardized avatar size constraints
“I do think that almost any plausible metaverse that I can think of, there's going to have to be some understanding around the size of avatars. It just doesn't make sense and it doesn't work if you've got some avatars that are a 100,000 times bigger than others…”
Stephenson: Mass metaverses will replicate physical architecture like roofs and walls
“I think people are comforted by shelter, by the feeling of privacy that you get when there's some walls around you, there's a roof over your head. So we're going to see those forms recapitulated in metaverse experiences that are geared towards drawing in a mas…”
Stephenson: AI will populate and animate virtual environments in the metaverse
“In the metaverse, I think we're going to see virtual environments that are populated and brought to life by AI. In some cases, it's going to be so what you might think, which is non-player characters that Walk around and, you know, deliver the mail or whatever…”
Stephenson: Crypto smart contracts can automate entertainment revenue waterfalls
“In the motion picture business, they have this lovely term called a waterfall, which is in a contract for a movie. When revenue starts to happen it cascades down and gets diverted off to different people, and there's a whole structure in place for this. So how…”
Stephenson: Protecting digital IP requires third-party evaluators and rating systems
“Because it's too much work to examine every possible site where something like that might be used, you then, you need to go, go up one level and you know, have kind of rating systems, let's say or, you know, so third party evaluators that look at sites, look a…”
Stephenson: Next wave of NFTs will incorporate real IP legal controls
“Right now, it's not being handled at all by the way NFT marketplaces are currently set up. And I think the next wave of NFTs is gonna begin to feature some of these improvements, or I think they're improvements. Some people Some people are going to hate this.”
Stephenson predicts both fiat and crypto will power metaverse economies
“We think that cryptocurrency and fiat currency, you know, in other words, old fashioned non-cryptocurrency, they're both going to be used in the metaverse just as they are in the real world.”
Stephenson: Major game studios are actively avoiding crypto and blockchain integration
“Most of the big players in the game industry are being avoidant of crypto and blockchain and there's different reasons for that you know having to do with you know, they may perceive a risk to their brand Or they may see that just the, there could be a lot of …”
Stephenson: Conventional Hollywood accounting cannot handle metaverse asset complexity
“Creating complicated experiences in a virtual world is not going to be like that. It's not all stove piped into specific You know, big budget projects. It's assets going every which way and appearing in different places. And so trying to track all of that and …”
Stephenson: Lamina1 will require node operators to purchase verified carbon credits
“The system's going to be designed in such a way that in order to participate, to operate a node, you need to demonstrate that you've acquired, you've bought a certain number of carbon credits from a legitimate company”
Stephenson: Snow Crash was written in the late 1980s
“I started working on it in 88, 89, wrote it in 1990 ish. And then it just takes a while for the, book to go through the whole pipeline. So, 92, I think is when it finally came out, but it's very much a work of the late eighties.”
Stephenson: Carbon and political polarization are the defining trends of the next 30 years
“Well, to me, the two most important Things that are carbon and the polarization of society and the way that polarization is being fostered and kind of weaponized by bad actors who benefit, you know, from that, that polarization.”
Stephenson: Digital technology now advances faster than science fiction can anticipate
“I think it's not just that it's decreased, but that it's swapped around. And so now science fiction is trailing behind. Like things are happening faster than science fiction can really anticipate them, at least in kind of digital. When you're talking about big…”