BERT

3 statements across 3 episodes · 1 bullish · 0 bearish · 3 people on the record · first statement May 4, 2023 by Kelvin Guu · said 14 times in 9 episodes since 2023 · across every show →

Mentions by year

brought up most by Kelvin Guu (3), Jensen Huang (3), Dr. Shiv Rao (2), Kevin Scott (1), Elias Torres (1), Edo Liberty (1), Dr. Percy Liang (1), Clem Delangue (1)

tap a year for its mentions
0053105202320242025episodesmentions
035202320242025episodes it came up in
0012.525202320242025episodesmentions per episode
2025 3 mentions in 2 episodes 2 per episode
2024 2 mentions in 2 episodes 1 per episode
2023 9 mentions in 5 episodes 2 per episode

every mention, scene by scene, with the transcript →

Everything said about BERT, oldest first

May 4, 2023 positive
Assertion Supported
Guu: BERT Demonstrated Vast Unprogrammed World Knowledge Purely From Pre-Training
“I think one of the things that became very apparent early on when playing with BERT was unlike all the prior generations of models, it had a large amount of world knowledge that we didn't deliberately encode into it. It wasn't in, you know, the fine tuning dat…”
Kelvin Guu May 4, 2023 ▶ 1:23 No Priors Ep. 15 | With Kelvin Guu, Staff Research Scientist, Google Brain
Feb 22, 2024 neutral
Assertion Not checkable as stated
Liberty: Mainstream Engineers Were Already Adopting BERT by 2019
“In 2019, the earthquake had already happened. Deep learning models and so on have already been grappled with. Large language models and transformer models like BERT and others started being used by the more mainstream engineering cohorts.”
Edo Liberty Feb 22, 2024 ▶ 2:28 No Priors Ep. 52 | With Pinecone CEO Edo Liberty
May 15, 2025
Disclosure
Glean Built Custom Enterprise Embeddings on Top of BERT
“We started with this BERT model that Google had put in open domain, which was trained on all of the internet's, you know, data and knowledge. And we would then take those models and then for every customer of ours, we'd actually build custom embeddings, you kn…”
Arvind Jain May 15, 2025 ▶ 3:30 No Priors Ep. 115 | With Glean Founder and CEO Arvind Jain
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 100 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.