RoBERTa, every mention
7 scenes across 3 shows · ← back to RoBERTa
tap a year for its mentions
Latent Space 5
No Priors 2
20VC 1
every year every show Latent Space 5 No Priors 2 20VC 1
Verbatim, from the transcripts: passages where RoBERTa comes up on Latent Space, No Priors, 20VC
Cohere's Chief AI Officer, Joelle Pineau: Why Scaling Laws Will Continue & Future of Synthetic Data · 20VC with Harry Stebbings
- ▶ 57:39 Joelle Pineau We had a model like Roberta from 2019, small language model, was getting twenty million downloads a month.
[Paper Club] Embeddings in 2024: OpenAI, Nomic Embed, Jina Embed, cde-small-v1 - with swyx
- ▶ 18:42 unnamed speaker Like these, this is definitely sort of benchmark maxing, um, compared to the more practical, uh, oriented people who are like, no, like you actually want to use like a Roberta, um, and, uh, and keep it, keep it to like sub one B.
[Paper Club] BERT: Bidirectional Encoder Representations from Transformers
[LLM Paper Club] Llama 3.1 Paper: The Llama Family of Models
- ▶ 7:05 unnamed speaker They have like Roberta based, um, filters for high quality.
No Priors Ep. 18 | With Kevin Scott, CTO of Microsoft
- ▶ 11:42 Kevin Scott But like the really exciting thing was when it started working for language with Elmo and then Bert and then Roberta and Turing and like a bunch of things that we were doing.
No Priors Ep. 7 | With Stanford Professor Dr. Percy Liang
- ▶ 15:37 Dr. Percy Liang And that in turn, and many other data sets that were developed both at Stanford and elsewhere, I think led to the development of these powerful language models that then like Bert and Roberta