Branson warns biological models showing 0.9 accuracy usually contain underlying errors
Kim Branson · AI in Pharmaceutical R&D with Kim Branson · Aug 1, 2024 · at 2:34
Kim Branson, Global Head of AI and Machine Learning at GSK, discusses model performance limits in biological data science during a discussion with a16z partner Vijay Pande.
0:00 / 0:08exact quote · 8.2s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“In biology, as you know, like, the best model you can build has, like, a figure of merit of accuracy, like.6, if it's .9, anything that looks great, there's something wrong.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Kim Branson
Branson predicts every drug launched by GSK will have accompanying software
“So every, every software, every drug VSK will launch will have software that sits around it. I think that's gonna be true of everybody, and there's, we're going to see, there's software that will sit around every drug, and we'll say, you know, who should use i…”
GSK's active learning target discovery is 20% faster than random screening
“That's about 20% faster we've shown than doing a random screen.”
Branson notes simple ML models yield most gains over complex ones
“Basically the simple stuff gets you there, and for the extra five percent gained, you need all the extra complexity. I think that is still true now.”
Branson calls human outcome data big pharma's biggest competitive AI advantage
“Outcome data is, is, is the gold standard data to have, right? It's the rarest data that's really, like, one of the advantages of pharmaceutical companies have, because they can generate data in humans at scale in a safe, ethical manner.”
GSK made AI core to its strategy via in-house functional genomics
“They're fully investing in the things I thought were very important at the time, which was, you know, these large genetic databases coming online and functional genomics. So he was way ahead in the, in sort of the thinking about CRISPR and like the gene pertur…”