Andreessen: Generative AI projects existing human knowledge rather than creating new thought
Marc Andreessen · Expert AI as a Healthcare Superpower · Jan 9, 2023 · at 7:33
Venture capitalist Mark Andreessen explains the mechanical limits and mechanism of action underlying large language models like GPT.
0:00 / 0:26exact quote · 26.4s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“It's not literally creating new information. Like, what it's doing is, it is it doesn't have, like, it has no opinion. It has no, like, point of view. It has no, like, you know, it's not sitting there, like, thinking on its own, coming up with some new thing. What it's doing is it's basically training, you know, ideally what it's doing is it's training on the sum total of all existing human knowledge, and so for text generation it's training on all existing human text, right, and so it plays back at you, basically, projections from the sort of, you know, assembled composite of all human text”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Marc Andreessen
Andreessen: US institutions recruit African immigrants to avoid hiring African Americans
“Both the universities and the corporate employers are literally, this is true, they're literally, they literally import Africans so that they don't have to hire African Americans because they still count as black.”
Andreessen: Big Tech is aggressively lobbying for regulatory capture against startups
“Quite honestly, I mean, part of what's happening is big tech is against us. There, there's a, there's basically a lot of the political issues now are a civil war inside the tech industry where, The big tech companies are lobbying very aggressively for what the…”
Andreessen: Vinod Khosla lobbied Congress to ban open-source AI
“Vinod has been lobbying to ban open source AI. And by the way, he denies that he's been doing this, but I saw him with my own eyes when the US Congressional China Committee came to Stanford I was in the meeting where he was with, you know, 30 20 or 30 congress…”
Andreessen: Automated and AI-augmented warfare will make conflict much safer
“I actually think warfare is going to get a lot safer. Like, I think, actually, automated warfare would be much, much safer.”
Andreessen: Biden officials explicitly told a16z they planned to ban open-source AI
“They told us that explicitly. And yeah. And they told us exactly what you just said. They told us they're gonna ban open source. And when we challenged them on the ability to ban open source, because it's, you know, we're talking about, you know, math, you kno…”
Andreessen: Paul Thomas Anderson's new film is 'Antifa the movie'
“Arguably, it is kind of salient to our times, because I think if you were to retitle the movie, you would just title it Antifa the movie. Like, it's, like, it's like a full-throated celebration of basically violent social change, violent social revolution, lik…”