Srinivas: Academic AI researchers should pursue radical alternatives to transformers
Aravind Srinivas · No Priors Ep. 9 | With Perplexity AI’s Aravind Srinivas and Denis Yarats · Apr 25, 2023 · at 36:14
Aravind Srinivas, co-founder and CEO of Perplexity AI, gives advice on research directions for academic AI scientists competing with industry labs.
0:00 / 0:14exact quote · 14.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“I think it's best to look for alternatives to the transformer, alternatives to like language models, that sort of radical directions, then Trying to improve them because there's so much incentive for the existing companies to do that.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Aravind Srinivas
Aravind Srinivas argues AI application builders understand LLMs better than trainers
“The people who use the LLMs for building stuff, Understand it better than the people who actually did gradient descent and train these models.”
Srinivas: AI search will incentivize publishers to create higher-quality content
“I think it's just going to incentivize people to publish higher quality content. In order to get cited by an LLM powered answer, like Substack or things like that try to do, like you want to own your content and you publish it and make sure it's high quality a…”
Aravind Srinivas says pursuing an AI PhD is a terrible career choice
“Especially a PhD student is one of the worst Jobs you can go for in a time when AI is so hot and so highly paid and you can do a startup or join a startup.”
Working in AI research or product does not require an AI background
“So it's always been clear to me that in order to work in AI, both research and product, you do not need to already have been in AI.”
Standalone LLMs cannot solve hallucination without a platform for user curation
“And I also don't think One LLM will just magically solve this problem. You need to build an end-to-end platform where users can correct the mistakes of an LLM, and that also means you need to design the platform where the incentive is right for the user”