Apr 24, 2025 · 52m · mad
Glean’s Breakthrough: CEO Arvind Jain on Scaling AI Agents & Search
gold bands on the timeline = statements, start to end. Hover to read, click to jump. CC turns on captions
In this episode of The MAD Podcast, host Matt Turck interviews Arvind Jain, Founder and CEO of Glean, to discuss the evolution of enterprise AI search, RAG, and AI agents. Jain shares strategic insights on AI model selection, open-source adoption, building defensible enterprise tech stacks, and the future of AI-assisted workplace productivity.
How this conversation actually went
Every chapter scored 0–10 on four independent dynamics. Hover any point for the reasoning behind the score. Matt holds 24.8% of the talking time here. How this is scored →
speaking balance: gold is Matt, purple is the guest (3 minute bins)
When prompted by the host for an agent definition, the guest playfully pushes back by stating he doesn't know if the world is looking for one more definition.
Hardest push from Matt ▶ 39:18 Host challenges practical reality of LLM agnosticismThe host presses past marketing terminology to ask what being LLM agnostic really means in practice when new models exhibit vastly different behaviors and require constant re-evaluation.
Biggest teaching moment ▶ 19:25 Guest reframes Glean origins from market foresight to personal painWhen the host frames Glean's 2019 founding around industry cycles and transformer timing, the guest clarifies that starting the company stemmed from personal frustration with fragmented data at Rubrik rather than grand market insight.
Matt holds his own ▶ 19:25 Host details legacy enterprise search graveyardThe host showcases deep domain knowledge by listing classic 2000s enterprise search companies like FAST, Endeca, Autonomy, and Verity, citing HP's $8 billion write-off to establish the challenge Glean faced.
the scores for every segment, with the reasoning behind each
| Chapter | Topic | Matt as informed peer | Guest teaching | Guest disagreement | Matt pushing back | Why |
|---|---|---|---|---|---|---|
| The Macro AI Model Landscape | 5 | 3 | 1 | 2 | The host displays strong domain knowledge by bringing up specific recent releases like O3, O4 Mini, Gemini 2.5 Flash, and new model startups like Thinking of Machines and SSI. The guest collaboratively explains enterprise model adoption phases, outlining why closed models dominate early before companies transition to distilled open-source models for cost and control. | |
| Defining AI Agents and Their Current Reality | 3 | 4 | 2 | 2 | The guest mildly pushes back against adding yet another agent definition to the industry noise before breaking down the evolution from RPA to supervised AI agents. He educates the host on how full autonomy is rare in enterprise settings, emphasizing that agents currently deliver 90% efficiency gains through human-in-the-loop review. | |
| The Origins and Evolution of Glean | 6 | 3 | 2 | 3 | The host shows deep industry memory by listing historical enterprise search pioneers like FAST, Endeca, Autonomy, and Verity, noting HP's $8 billion write-off. The guest gently corrects the host's premise about grand market foresight, explaining Glean was born out of raw personal frustration with fragmented SaaS data at Rubrik. | |
| Glean's Agentic Era and Platform Strategy | 4 | 3 | 1 | 2 | The host cites specific figures including 50 million automated agent actions and asks why Glean pursued a horizontal strategy instead of building vertical per-function products. The guest explains how rebranding apps to agents aligned with market terminology and how existing search connectors naturally enabled horizontal workflows. | |
| Technical Deep Dive: Enterprise Search Architecture and Agent Design | 5 | 4 | 2 | 3 | The host asks probing technical questions regarding search permissions, document decay, model routing, and why Glean chose tool-use architecture over computer-use. The guest politely clarifies that computer-use isn't inherently rejected but prioritized behind immediate customer demand for tool integration. | |
| Data Flywheels and Personalization in Glean | 3 | 4 | 0 | 1 | The host inquires about data flywheels and usage-based intelligence accumulation. The guest educates the host on how implicit human signals—such as answering questions in Slack with links or peer endorsements—feed authority scores and expert mapping in Glean. | |
| AI Prompt Studio, Prompt Libraries, and Agents | 3 | 4 | 3 | 3 | The host pushes on defensibility and how Glean builds a moat as competition heats up. The guest rejects traditional consumer network-effect framings like eBay for enterprise software, arguing that moats in B2B come solely from speed of execution and solving immediate customer problems. | |
| The Future of Work and Enterprise AI Architecture | 3 | 3 | 0 | 1 | The host asks for the guest's long-term vision regarding centralized enterprise AI versus departmental agents. The guest paints a clear architectural vision of horizontal data and search layers supporting thousands of specialized functional AI assistants. |