BERT, every mention
11 scenes · ← back to BERT
tap a year for its mentions
every year anyone Kelvin Guu 3Jensen Huang 3Dr. Shiv Rao 2Kevin Scott 1Elias Torres 1Edo Liberty 1Dr. Percy Liang 1Clem Delangue 1Arvind Jain 1
Verbatim, from the transcripts: the passages where BERT comes up
No Priors Ep. 115 | With Glean Founder and CEO Arvind Jain
- ▶ 3:30 Arvind Jain Like, you know, we, you know, we started with this, uh, BERT, uh, model that Google had put in open domain, which was trained on all of the, all of the internet's, you know, data and knowledge.
No Priors Ep. 108 | With Abridge Founder and CEO Shiv Rao, MD
- ▶ 9:46 Dr. Shiv Rao When we started with Bird or BioBird, a longformer, a Pegasus, all these other pre-trained models, we, we got to the point where we had a product that worked.
- ▶ 14:03 Dr. Shiv Rao And again, like these weren't even LLMs yet in 2021, we were using like Burt and BioBurt and like,
No Priors Ep. 94 | With CEO and Founder of Agency Elias Torres
- ▶ 7:41 Elias Torres I knew BERT.
No Priors Ep. 52 | With Pinecone CEO Edo Liberty
- ▶ 2:32 Edo Liberty Large language models and transformer models like BERT and others started being used by the more mainstream engineering cohorts.
No Priors Ep. 18 | With Kevin Scott, CTO of Microsoft
- ▶ 11:42 Kevin Scott But like the really exciting thing was when it started working for language with Elmo and then Bert and then Roberta and Turing and like a bunch of things that we were doing.
No Priors Ep. 5 | With Huggingface’s Clem Delangue
- ▶ 4:13 Clem Delangue Um, and then at some point, especially when, when transformer models started to work, when we started to see, you know, birds, uh, getting, getting some, some traction, we just saw like the number of people using our open source.
No Priors Ep. 15 | With Kelvin Guu, Staff Research Scientist, Google Brain
- ▶ 1:05 Kelvin Guu The group that I'm part of right now, which is now part of Google Brain, at the time was looking into very, at the time, early ideas on pre-training language models, which eventually became BERT. 2 times in the scene
- ▶ 5:00 Kelvin Guu At the time of the Realm paper, we were doing something called masked language modeling, which was popularized by Byrd.
No Priors Ep. 7 | With Stanford Professor Dr. Percy Liang
- ▶ 15:37 Dr. Percy Liang And that in turn, and many other data sets that were developed both at Stanford and elsewhere, I think led to the development of these powerful language models that then like Bert and Roberta
No Priors Ep. 13 | With Jensen Huang, Founder & CEO of NVIDIA
- ▶ 16:07 Jensen Huang BERT was a big deal. 3 times in the scene