large language model

also referred to as: large language models · llm

48 statements across 32 episodes · 16 bullish · 15 bearish · 30 people on the record · first statement Jun 2, 2023 by Barry McArdle · said 1 times in 1 episodes since 2023 · across every show →

Mentions by year

brought up most by June Park (1)

tap a year for its mentions
0011112023episodesmentions
0112023episodes it came up in
000.50.5112023episodesmentions per episode
2023 1 mention in 1 episode

every mention, scene by scene, with the transcript →

Everything said about large language model, oldest first

Jun 2, 2023 neutral
Insight
Barry McArdle: Passing too much context into LLM prompts confuses the model
“I think we've been, we were tempted early on to try to shove as much context as we could in. You kind of figure like the more I can tell this model, the better. And you realize you can pretty easily confuse a model in terms of the amount of context you're pass…”
Barry McArdle Jun 2, 2023 ▶ 25:04 Embedded AI: The Questions Every CEO is Asking
Aug 25, 2023
Assertion Supported
Appenzeller: Larger LLMs improve reasoning beyond mere knowledge acquisition
“For a large language model, it turns out that just making a larger model and training on more data has more benefits than just absorbing more knowledge. It also means that it's better in reasoning and, you know, understanding abstract context and then, you kno…”
Guido Appenzeller Aug 25, 2023 ▶ 12:43 Chasing Silicon: The Race for GPUs
Sep 1, 2023 neutral
Assertion Not checkable as stated
Appenzeller: LLM inference costs between a tenth and hundredth of a cent
“You know, if you run the numbers, like a large language model, you actually at a fraction of a cent, like a 10th of a cent or a 100th of a cent, somewhere in that ballpark. For the inference.”
Guido Appenzeller Sep 1, 2023 ▶ 8:33 The True Cost of Compute
Sep 1, 2023 bullish
Prediction Not checkable as stated
Appenzeller: Well-funded startups will drive future LLM innovation
“Today, training a large language model is something that is definitely within reach for a well-funded startup, right? So, and for that reason, we expect to see more innovation in that area in the future.”
Guido Appenzeller Sep 1, 2023 ▶ 12:47 The True Cost of Compute
Sep 1, 2023
Assertion Not checkable as stated
Appenzeller: Training large language models costs tens of millions of dollars
“Training one of these large language models today is, it's not a 100,000 dollar thing, it's probably millions of dollars thing. Practically speaking, what we're seeing in industry is that it's actually more of a tens of millions of dollars thing.”
Guido Appenzeller Sep 1, 2023 ▶ 7:39 The True Cost of Compute
Sep 25, 2023 neutral
Assertion Not checkable as stated
Horowitz: No large language model has ever decided to do anything
“No LLM has ever decided to do anything.”
Ben Horowitz Sep 25, 2023 ▶ 21:24 AI Food Fights in the Enterprise with Databricks' Ali Ghodsi
Nov 6, 2023
Insight
Park: Simply prompting LLMs fails to sustain long-term agent simulations
“What we found was if we want to populate the spaces over a longer period of time, so we can do, for instance, longitudinal study, or gameplay that's going to last forever, then for those kind of instances, simply prompting these models wouldn't work.”
June Park Nov 6, 2023 ▶ 18:20 Inside AI Town: What AI Can Teach Us About Being Human
Nov 6, 2023
Insight
Park: Generative agent architectures function as operating systems for LLMs
“Philosophically, to some extent, I think this is akin to creating the operating system around learned language model in the way we sort of, we are prompting learned language model.”
June Park Nov 6, 2023 ▶ 5:29 Inside AI Town: What AI Can Teach Us About Being Human
Dec 16, 2023 bullish
Prediction Not checkable as stated
Lai: Video game players will readily accept LLM-powered AI companions
“The idea of just turbocharging disks of large language models to make them more lifelike and enable them to have a wider range of expression and behavior, I think is going to be Very well accepted by players.”
Jonathan Lai Dec 16, 2023 ▶ 10:01 2024 Big Ideas: AI-First Games That Never End with Jonathan Lai
Dec 16, 2023 negative
Assertion Not checkable as stated
Lai: Cloud inference costs break traditional gaming monetization models
“The challenge is that with an AI game, if you have a game that's running a large language model in the cloud, the influence costs of serving users dynamically generated worlds or texts would probably make either of these models unprofitable right off the bat, …”
Jonathan Lai Dec 16, 2023 ▶ 17:30 2024 Big Ideas: AI-First Games That Never End with Jonathan Lai
Dec 23, 2023 neutral
Assertion Not checkable as stated
Midha: The AI industry cannot currently observe internal LLM decision-making
“Where we are in the industry right now is that from the outside, we can't really see what's happening in these kitchens. So you have no idea how they made that decision.”
Anjney Midha Dec 23, 2023 ▶ 3:05 Big Ideas 2024: AI Interpretability: From Black Box to Clear Box with Anjney Midha
Dec 28, 2023
Assertion Not checkable as stated
Mensch: LLM training is 100,000x less data efficient than the human brain
“If you compare like the training process of a large language model to the brain, you have like a factor I think 100,000.”
Arthur Mensch Dec 28, 2023 ▶ 32:34 Safety in Numbers: Keeping AI Open
Dec 28, 2023
Insight
Mensch: LLMs function as programming languages, not standalone products
“If you look at what the LLM does, it's not really different from a programming language. It's actually used very much as a programming language by the application makers. There's a strong confusion made between what we call a model and what we call an applicat…”
Arthur Mensch Dec 28, 2023 ▶ 27:39 Safety in Numbers: Keeping AI Open
Dec 28, 2023 positive
Assertion Supported
Mensch: Top mathematicians like Terence Tao use LLMs for proof steps
“We're starting to see some very good mathematicians I'm thinking of Terence Tao that are using large language models for some things obviously not the high level reasoning, but for some part of their proofs.”
Arthur Mensch Dec 28, 2023 ▶ 34:40 Safety in Numbers: Keeping AI Open
Dec 28, 2023 negative
Opinion
Mensch: AI regulation should target applications, not foundational math
“What you want to regulate is the application, and the issue we had, and the issue we're still having now is, We hear a lot of people saying we should regulate the tech, so we should regulate the function, the mathematics behind it, but really you never use a l…”
Arthur Mensch Dec 28, 2023 ▶ 28:44 Safety in Numbers: Keeping AI Open
Mar 5, 2024 bullish
Assertion Partly supported
Casado: LLMs for legal work are 10,000x to 100,000x cheaper than lawyers
“And so again, to use an LLM Is four to five orders of magnitude cheaper and faster?”
Martin Casado Mar 5, 2024 ▶ 6:42 The Future of AI Is Amazing
Mar 11, 2024 negative
Assertion Not checkable as stated
Casado: There is no evidence of agentic behavior in LLMs
“The thing that we've not seen any evidence of is agentic behavior.”
Martín Casado Mar 11, 2024 ▶ 13:23 Intelligence in the Age of AI with new CTO of the CIA
Mar 11, 2024 negative
Insight
Casado: LLM errors accumulate exponentially when operating out of distribution
“If it generates anything out of distribution. Like, and by the way, out of distribution means it's not commonly represented in the training set. Then that error is going to accrue and it tends to accrue exponentially provably, right?”
Martín Casado Mar 11, 2024 ▶ 13:32 Intelligence in the Age of AI with new CTO of the CIA
Mar 20, 2024 neutral
Prediction Not checkable as stated
D'Angelo: LLMs will never acquire unrecorded human knowledge
“There's knowledge that people have in their heads that is not in, is not on the internet and is not in any book. And so no LLM is going to have that knowledge.”
Adam D'Angelo Mar 20, 2024 ▶ 18:18 Bringing AI to the Masses with Adam D'Angelo, CEO of Quora
Mar 20, 2024 bullish
Prediction Not checkable as stated
D'Angelo: AI UX will shift to direct source attribution over pure synthesis
“I expect that that is going to lead to some kind of product or some kind of user experience where the LLM is helping you sort through your sources and quoting exact experts or exact sources, as opposed to just synthesizing it all and giving you something where…”
Adam D'Angelo Mar 20, 2024 ▶ 19:22 Bringing AI to the Masses with Adam D'Angelo, CEO of Quora
Jun 19, 2024 bullish
Prediction Open · timeframe Jun 2029
Andreessen: Local hardware devices like doorknobs will run onboard LLMs
“There's just gonna be such a giant number of like local use cases. Like, you know, your doorknob is gonna have an LLM in it that's gonna control whether or not people get through the door, right?”
Marc Andreessen Jun 19, 2024 ▶ 34:40 Marc Andreessen & Andrew Chen Talk Creative Computers
Jun 28, 2024 bullish
Insight
Yoo: LLMs can unbundle care by automating triage, even without physical treatment
“Unbundling the role of a clinician. You know, there's one part which is actually the treatment part, so that's the part where maybe we can't necessarily today build an LLM that will stitch your finger. But the notion of triage, right and kind of getting you to…”
Julie Yoo Jun 28, 2024 ▶ 26:48 Grand Challenges in Healthcare AI with Vijay Pande and Julie Yoo
Jun 28, 2024 positive
Insight
Pande: LLMs' primary underappreciated value is serving as user interfaces
“Well, so I think the thing that's really underappreciated out of the LLM is like people think of it as like this Oracle or something like that, but I think it's maybe at least for us, I think of it as a UI.”
Vijay Pande Jun 28, 2024 ▶ 20:28 Grand Challenges in Healthcare AI with Vijay Pande and Julie Yoo
Oct 22, 2024 negative
Opinion
Andreessen: Major commercial AI models are heavily shackled and hobbled
“The, large language models you know, like ChatGPT from the big labs from the big companies they basically all have in common. Grok is a little bit more liberated, but with the other ones that people use, all have in common is they, they've been like, just like…”
Marc Andreessen Oct 22, 2024 ▶ 5:00 Truth Terminal - The AI Bot That Became a Crypto Millionaire
Feb 28, 2025 negative
Assertion Supported
Ayrey: LLMs generate security vulnerabilities at rates matching junior developers
“And in fact, there's been research into how often a code spit out from an LLM has security vulnerability. And more often than not, if you ask us to develop an entire application, it'll write vulnerabilities at a rate The same as a junior developer, if not a li…”
Dylan Ayrey Feb 28, 2025 ▶ 4:11 Avoiding vulnerabilities in AI code
Feb 28, 2025 negative
Insight
Ayrey: Filtering API keys from training risks degrading AI data science skills
“So if we do our reinforcement learning and we skew it towards code snippets that's generating that don't have API keys, inadvertently, we may be training this thing to behave less like a data scientist. And then we lose the entire discipline of data science in…”
AI Security Researcher Feb 28, 2025 ▶ 9:48 Avoiding vulnerabilities in AI code
Mar 15, 2025 positive
Prediction Not checkable as stated
Kumar: Transcription-free conversational AI models are coming soon
“A pretty clear path that a lot of, I think, labs are taking, and we're taking as well, and will be in kind of future versions, is just kind of transcription free. Just go straight into the text component which will kind of obviate transcription entirely. That …”
Ankit Kumar Mar 15, 2025 ▶ 5:37 Building the Next Generation of Conversational AI
Apr 14, 2025 bullish
Insight
Yudis: Transformer architectures bring LLM-style data scaling laws to autonomy
“There's a similar you know, let's say paradigm shift happening in autonomy and in vision systems as well with transformers, and so what that ultimately means in autonomy is the similar dynamics in large language models, you can put lots of data in, and you get…”
Qasar Younis Apr 14, 2025 ▶ 10:20 Autonomy is no longer a moonshot—it’s a market
Jun 16, 2025 positive
Assertion Not checkable as stated
De la Garza: ChatGPT is 100% accurate at detecting suspicious emails
“To drop a suspicious email into a, into ChatGPT and ask if it's suspicious, and it's like a hundred percent accurate, right? Like if you want to like find sensitive information, you ask the LLM, is this sensitive information? And it's like a hundred percent ac…”
Joel de la Garza Jun 16, 2025 ▶ 22:21 AI is Revolutionizing Web Security - Bots, Agents, & Real-Time Defense
Jul 28, 2025 negative
Opinion
Martin Casado: A single LLM cannot perform both fuzzy and deterministic tasks
“Can you build one LLM? And I think the answer to me is obviously no, but, you know, I've heard arguments that it can.”
Martin Casado Jul 28, 2025 ▶ 55:18 Balaji Srinivasan: How AI Will Change Politics, War, and Money
Aug 14, 2025 neutral
Insight
Lingelbach: LLMs, not video models, limit real-time AI actors
“Oh, a hundred percent. But I think that the bigger limitation is not the video model right now. I think the bigger limitation is actually that I think large language models still have a lot of work in terms of making people feel very authentic.”
Michael Lingelbach Aug 14, 2025 ▶ 22:32 Why AI Characters & Virtual Influencers Are the Next Frontier in Video ft Hedra’s Michael Lingelbach
Sep 9, 2025 negative
Opinion
Mark Cuban says research hospitals are idiots to publish or patent IP
“Because if I'm MD Anderson, if I'm Stanford, any research hospital, any scientist in healthcare, you're an idiot if you publish it. You're an idiot if you patent it. Because it's immediately going to get absorbed into a large language model. And you've lost co…”
Mark Cuban Sep 9, 2025 ▶ 19:49 Mark Cuban on the NBA, Cost Plus Drugs, and How to Fix Politics
Oct 13, 2025 positive
Insight
Misra: Chain-of-thought prompting works by reducing LLM prediction entropy
“That's why chain of heart works. What happens with chain of thought is you ask the LLM to do something chain of thought. It starts breaking the problem into small steps. These steps it has seen in the past. It has been trained on maybe with some different numb…”
Vishal Misra Oct 13, 2025 ▶ 10:12 Will LLMs Get Us To AGI?
Oct 13, 2025 negative
What-if
Misra: LLMs trained on pre-1915 physics could not discover relativity
“Any LLM that was trained on pre-nineteen-fifteen physics would never have come up with a theory of relativity.”
Vishal Misra Oct 13, 2025 ▶ 0:00 Will LLMs Get Us To AGI?
Oct 13, 2025 neutral
Assertion Not checkable as stated
Misra: LLMs hallucinate when straying from learned Bayesian manifolds
“And as long as the LLM is going in sort of traversing through these manifolds, it is confident. And it can produce something which is, which makes sense. The moment it sort of wears away from the manifold, then it starts hallucinating and start spotting nonsen…”
Vishal Misra Oct 13, 2025 ▶ 4:28 Will LLMs Get Us To AGI?
Oct 23, 2025 positive
Insight
Masad: Discrete verification loops unlock mathematical and coding reasoning in LLMs
“And so that, that's a resurgence of that movement where we have this amazing generative neural network that is the LLM. And now let's layer on More discrete ways of trying to verify whether it's doing the right thing or not. And let's put that in a training lo…”
Amjad Masad Oct 23, 2025 ▶ 25:40 Marc Andreessen & Amjad Masad on “Good Enough” AI, AGI, and the End of Coding
Nov 6, 2025 positive
Disclosure
Chan: LLMs provided the breakthrough needed to analyze CZI's biological datasets
“We were already Building tools to measure interesting data. Building the data sets. But we didn't really know what to do with them yet. And large language models coming onto the scene, we're like, wow, we can make sense of all of this now.”
Priscilla Chan Nov 6, 2025 ▶ 11:08 Mark Zuckerberg & Priscilla Chan: How AI Will Cure All Disease
Nov 17, 2025
Insight
Shear: In AI agents, care equates to loss and reward correlation
“Care is basically like reward. Like how much does this state correlate with survival? How much does this state correlate with your inclusive, your full inclusive reproductive fitness? For a somewhat thing that learns evolutionarily, or for a reinforcement lear…”
Emmett Shear Nov 17, 2025 ▶ 23:57 Emmett Shear on Building AI That Actually Cares: Beyond Control and Steering
Nov 17, 2025 negative
Assertion Not checkable as stated
Shear: LLMs cannot achieve sentience due to attention span limits
“Which by the way, I definitely don't think you'd find it in LLM. Like, in fact, I know you can't find them because it, these things don't have attention spans like that at all.”
Emmett Shear Nov 17, 2025 ▶ 46:32 Emmett Shear on Building AI That Actually Cares: Beyond Control and Steering
Dec 12, 2025 bearish
Prediction Not checkable as stated
Evans: AI features will not commoditize premium smartphone hardware
“Am I going to buy the one that's a 10th of the price and just use the LLM on it? No, because I'll still want the good camera and this good screen and the good battery life.”
Benedict Evans Dec 12, 2025 ▶ 49:58 AI Eats the World: Benedict Evans on the Next Platform Shift
Mar 12, 2026 bullish
Prediction Not checkable as stated
Karp: Palantir will be the last software company standing against LLMs
“I would say the last company standing before we all have to salute the overload of the LLM will be Palantir”
Alex Karp Mar 12, 2026 ▶ 9:17 Palantir CEO on Iran, AI Weapons and American Domination | a16z American Dynamism Summit
Mar 17, 2026
Assertion Not checkable as stated
Misra: LLM deception is driven by training data, not architecture
“That's not a function of the architecture. That's a function of the training data. It has been fed, you know, articles on Reddit or Asimo or whatever.”
Vishal Misra Mar 17, 2026 ▶ 25:47 Why Scale Will Not Solve AGI | Vishal Misra - The a16z Show
Mar 17, 2026 negative
Prediction Open · timeframe Mar 2031
An LLM trained on pre-1916 physics will never derive general relativity
“Take an LLM and train it on pre-nineteen-sixteen or nineteen-eleven physics and see if it can come up with the theory of relativity. If it does, then we have AGI. I mean, it's a high bar, but, you know, we should have high bars. It won't.”
Vishal Misra Mar 17, 2026 ▶ 32:31 Why Scale Will Not Solve AGI | Vishal Misra - The a16z Show
Apr 13, 2026 positive
Insight
Jessie Genet: Prompting AI agents with curated literature prevents generic stock outputs
“The homeschool one was the most obvious one to me, because I was like, I want you to literally, like, use this curriculum or use this book as a reference point, but then I noticed how well it worked, and I was like, okay, what if I take this agent over here th…”
Jessie Genet Apr 13, 2026 ▶ 38:32 Building Agents at Home: Homeschooling, Parenting and More | The a16z Show
May 4, 2026 negative
Assertion Contradicted
Rogers: Draft foreign legislation imposes strict criminal liability on LLM output
“And I've seen draft legislation that imposes like strict criminal liability if the LLM Is even capable of generating certain kinds of content.”
Sarah Rogers May 4, 2026 ▶ 16:13 Digital Freedom, AI Regulation, and the Fight for the Western Internet | The a16z Show
May 12, 2026 negative
Insight
Blankfein: LLMs create systemic risk by removing institutional intuition and audit trails
“You know, one of the, you know, when you get, when you go into some of these large language models, you don't know the thought process. You lose intuition in these things. It used to be when I started out in the business, You know, people be shrieking each oth…”
Lloyd Blankfein May 12, 2026 ▶ 1:04:34 Goldman Sachs Chairman on Why Finance Adopts AI Differently | a16z
May 12, 2026 neutral
Prediction Not checkable as stated
Blankfein: The large language model market will eventually consolidate to two winners
“The world may not need 10 large language models. Maybe it needs four will be winners, and two will be very big winners, and the other two will get by, and maybe it'll get reduced over time to two.”
Lloyd Blankfein May 12, 2026 ▶ 1:01:33 Goldman Sachs Chairman on Why Finance Adopts AI Differently | a16z
Aug 5, 2026 neutral
Insight
Moe: LLM serving differs fundamentally from traditional ML workloads
“Serving large language model is a fundamentally different problem. Because serving it requires to run it on accelerators like GPUs or TPUs, and it is a computationally intensive process that will require a lot of engineering and ensuring that for each request,…”
Simon Moe Aug 5, 2026 ▶ 1:53 How Open Source Became AI's Backbone | Inferact with a16z
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,000 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.