Coates: Factual LLM outputs are merely the hallucinations that users prefer
Glen Coates · No Priors Ep. 49 | With Shopify VP of Core Product Glen Coates · Jan 31, 2024 · at 26:59
Shopify VP Glen Coates shares a mental model on the nature of generative language models while discussing AI reliability challenges.
0:00 / 0:08exact quote · 8.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Yeah, you know, that's its job, right? You know that every time it emits a token, it's hallucinating, right? It's just that you like some of the hallucinations more than the others, right?”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Glen Coates
Coates: Companies trying to serve both SMB and enterprise usually fail
“The world is littered with the corpses of, you know, the companies that tried to serve SMB and enterprise at the same time.”
Coates: AI agents reach 75% in 10 minutes, but 95% is brutal
“Well, look, I mean, I think the exciting and frustrating thing about LLMs right now is that you can get an LLM like agent thing, like a sidekick-esque thing. You can get it to like 75% in like 10 minutes. And then it's like this brutal hill climb to get it to,…”
Coates: GUI AI agents instantly turn the open web into an app store
“If it actually works, the strategic brilliance of that is they instantly have the world's largest app store because the world's largest app store is just the web, right?”
Coates: Redundant systems at the same stack layer cause compounding upstream delays
“The real answer to how do you solve this problem is one is developing extremely good intuitions for when you are accidentally creating duplicates at the same layer of the stack. So you just never get into the problem in the first place. And then the second par…”
Coates: AI copilots remove UI complexity barriers for entrepreneurs
“AI brings us into the world of like, okay, well, what if we can give you the driver in the car who knows how all these switches work and can help you along without having to learn all the switches? It's probably one of the most powerful opportunities for more …”
Coates: Perplexity sits exactly between ChatGPT's interface and Google's search
“The sort of the triangle of like perplexity, Google, ChatGPT of like, it's basically like LLM native search and like ChatGPT really good at the LLM interface thing, not amazing at search yet. Google amazing at search, not really figured out the LLM thing yet. …”