Yarats: The best AI research breakthroughs came from top software engineers
Denis Yarats · No Priors Ep. 9 | With Perplexity AI’s Aravind Srinivas and Denis Yarats · Apr 25, 2023 · at 11:07
Perplexity CTO Denis Yarats argues that engineering skill, rather than pure academic credentials, drives major AI breakthroughs.
0:00 / 0:23exact quote · 23.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“Turns out through my experience, the best research scientists, also very good engineers, like very good engineers. And we've noticed like through DeepMind and OpenAI is just like the companies that made the most progress over like last six years or five years where people were companies where they're like extremely good engineers.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Denis Yarats
Denis Yarats says sacrificing work-life balance is required to beat competition
“It's kind of like work life balance, maybe not the ideal but you know, but that's the only way to sort of like beat competition and sort of like iterate very fast and do great things.”
Denis Yarats argues AI answer engines fundamentally break Google's monetization model
“And it's also kind of like why we believe my, it might be very hard for Google to fully launch this system. Like answer engine, because it just like breaks monetization strategy for them.”
Yarats: AI search monetization will feature fewer but more expensive clicks
“So there is gonna be few, few clicks, but each click is gonna be more expensive.”
Yarats: Aspiring AI researchers should work in industry before a PhD
“I think it's best to not go to PhD right after undergrad and kind of like spend at least like couple of years in industry. I think that goes to my point to me, like the best researchers are those who can, who are also very good engineers.”
Yarats: Perplexity prefers raw drive over extensive experience when hiring
“Personally, I would rather like get somebody who has this Burning desire to work on these things rather than somebody who already has a lot of experience and not going to put a lot of, or like as much effort as other people.”
Yarats: Rejection sampling significantly boosts LLM quality before full RLHF
“Full blown, like RLHF is, you know, definitely something we're going to look into that, but there is like several many steps that you can have in between that significantly can increase your quality. So for example, I mean like even using something like a reje…”