Glean Built Custom Enterprise Embeddings on Top of BERT
Arvind Jain · No Priors Ep. 115 | With Glean Founder and CEO Arvind Jain · May 15, 2025 · at 3:30
Glean CEO Arvind Jain discusses the original architectural design and technical foundation of Glean's search system.
0:00 / 0:13exact quote · 13.9s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“We started with this BERT model that Google had put in open domain, which was trained on all of the internet's, you know, data and knowledge. And we would then take those models and then for every customer of ours, we'd actually build custom embeddings, you know, on their business content.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Arvind Jain
Jain: Vector Search Alone Cannot Solve Enterprise Search
“There's a lot of focus on embeddings and vector search over the last few years, but that's actually only one part of, ah, building a good search system. Because if you think about an enterprise, ah, imagine a company that has been around for a few decades. You…”
Glean CEO: AI models are nowhere near replacing retrieval via infinite context
“I mean, I think there's always this thought of that, like, you know, the models will have near infinite context windows and you can just give them everything and they can figure things out automatically. But I don't think, you know, like they're anywhere close…”
Jain: Companies feared effective search because it exposed internal governance gaps
“We started to hear from businesses that, oh, I'm scared of good search. I don't want a good search product in my company because I have all these governance gaps. I have like, you know, sensitive information all over the place.”
Jain: Missing enterprise knowledge is a bigger problem than AI hallucinations
“People talk about hallucinations as a big problem with AI models. You know, we feel like, you know, a bigger problem for us is not even hallucinations. It's about Like, you know, most of the times you can't even, you know, find that information. Sometimes it's…”
Jain: Workers will have personal AI teams performing 90% of their work
“And one thing that's going to fundamentally happen is that each one of us is going to have this amazing team Of, you know, call it assistants, coworkers, coaches that are truly personal to you. And, you know, you're always surrounded by that team. And this tea…”
Jain: Enterprise search requires transformer models due to scarce user signals
“On the web, even if you don't have good semantic understanding, there is so much that you're going to learn from people's behavior because, you know, you have a billion people, you know, coming and using your product. In the enterprise, you don't have that lux…”