Shah: GPT-3 and GPT-4 are reasoning engines, not knowledge bases
Dharmesh Shah · Brainstorming ChatGPT Business Ideas With A Billionaire | ft. Dharmesh Shah (#438) · Mar 30, 2023 · at 18:12
HubSpot co-founder Dharmesh Shah explains how modern large language models operate beyond simple static data lookup.
0:00 / 0:27exact quote · 27.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“GPT three and now four is, is a reasoning engine. And Sam Altman has talked about this. It's not a knowledge base where it's like, and so people kind of latch on to this fact that, oh, the data that it has is from September, 20, 21, then I'm going to teach you some new things. That's really not what it's about. What they've built is a reasoning engine that says given this set of facts that it knows about the world based on what was available when it took its last lap snapshot in. How can it try to logically come up with something that answers the question?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dharmesh Shah
Shah: OpenAI is the startup most likely to reach $1T valuation
“It, it'd be up there in the top three. I honestly can't think of who else would rank higher in terms of probability of getting to that.”
Shah: LLM capabilities cannot be explained by simple next-token prediction
“It's able to do things. That are not explainable by a simple probabilistic model of auto-suggesting next character, next word, next token, next sentence, right? Like it's gone well beyond that.”
Shah: Prompt-driven text-to-video with director styles will arrive in 2023
“I would not be surprised, let's say by the end of this year, that we have a reasonable way to kind of describe in textual form what we want, who the characters are, what the scene is what kind of stylistic attributes we want. We can point it to, oh, I want thi…”
Shah: AI is an order of magnitude bigger than mobile
“I think it's the single largest opportunity and biggest kind of a tech paradigm shift we've seen since the internet originally came out. Like mobile was big but there was a discrete set of use cases. Like when you put a camera on a phone, when you put a GPS de…”