Levie: AI context windows grew 500x in 18 months
Aaron Levie · Aaron Levie: How the Business Model of SaaS Changes Forever & Startups vs Incumbents:Who Wins?|E1155 · 20VC with Harry Stebbings · May 22, 2024 · at 8:00
Aaron Levie, CEO of Box, compares model benchmarks from the launch of GPT-3.5 to Google Gemini's announcement at Google I/O.
0:00 / 0:29exact quote · 29.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The token context window was more or less, I think, 4000 tokens. So you kind of give it like a blog post to analyze just in the past, you know, week at Google IO Sundar announced a two million token window model or version of Gemini. So think about that. That's about a 500 X improvement in 18 months of how much data you can give the model or get back from the model. And there's just nothing in technology history that, that grows at 500 X Every 18 months.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Aaron Levie
Levie: Incumbents will capture AI value as effectively as startups
“That is as much going to be an incumbent's game as a startup's game this time around.”
Levie: One-person billion-dollar AI startups will be rare novelties
“There's a lot of belief that like, oh, well, well, you might have these solo companies that, you know, become multi-billion dollar companies with just one person or, you know, three people and a bunch of AI. I think that will be done, you know, just by virtue …”
Levie: There will be more lawyers in 5 years than today
“There are going to be more lawyers in the next five years than we have today.”
Levie: US-China AI race is commercial, not existential
“You know, the idea that we're in some kind of, you know, kind of race, existential race where a month or two of advantage is gonna, you know, change the total outcome of AI progress and what everybody does between us and China. I just don't agree with, I think…”
Levie: Only 1 to 3 independent horizontal LLM startups will reach scale
“But I think for like the pure play horizontal LLMs we, I think those will largely be subsumed by the big players with maybe room for one, two, three independent companies at scale that are not in the hyperscalers, but there will not be room for 50 companies. T…”