Roy: A massive gap remains between AI benchmarks and real-world enterprise execution
Ranjan Roy · Are AI Glasses Over? + Big Technology AI Summit Audience Questions · Jun 22, 2026 · at 15:43
Ranjan Roy, VP of Strategy at Writer and co-host of Big Technology, discusses enterprise adoption of autonomous AI agents during an audience Q&A.
0:00 / 0:31exact quote · 31.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I still think there's such a massive gap in terms of what does the data look like? What is the actual problem? Does the customer, Or the person actually understand the goal in a clear enough way that they're able to define it to kind of push that loop forward. So I think it's an interesting, I think with a lot of AI, again, even around the benchmarking, like again, versus real world understanding of how to use it, what's happening and what's available for it to use. There's still a lot of work to be done.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Ranjan Roy
Roy: Tesla and SpaceX will inevitably have to merge
“Giving that little nugget to the world, starting to seed that idea, and I think it's almost, it has to happen, because these two companies, again, Tesla has a car business, SpaceX kind of has a space business, still has an internet satellite business, but they…”
Roy: SpaceX's S-1 filing positions it as an AI company, not space
“But, so they have already filed their S-one, and have positioned themselves squarely in the AI camp. Like, this is not a space company anymore. This is an AI company.”
Roy: Late-Stage AI Valuations Are Juiced to Anchor Retail IPO Pricing
“You have every incentive in the world to juice the valuation because that means that it gets anchored there and then you go out at a higher value. Like, then you realize that at the expense of the retail market.”
AI compute demand growth will be linear rather than exponential
“I don't think it's necessarily exponential in the way everyone is looking at it right now. And the way these deals are being done, and the way people are chasing it, and again, when it benefits both parties involved, I do think that It can be more of a linear …”
Roy: Apple Intelligence launch ads were "flat-out lies" about product capabilities
“Those ads were so misleading, just flat out lies about the capabilities that were existing at the time. Took, I mean, Apple, very few companies have ever done any, like, have done something that egregious.”
Roy: OpenAI is merely chasing and following Anthropic's enterprise strategy
“They are chasing Anthropic strategically. They're going after Enterprise, again, like Mythos gets released, and then Five Four Cyber gets released right after. It's like everything they're doing is right after Anthropic and following them”