Burke: Current virtual cell models have only around 10% predictive accuracy
Dave Burke · No Priors Ep. 103 | With Vevo Therapeutics and the Arc Institute · Feb 25, 2025 · at 33:19
Dave Burke (CTO at Arc Institute) evaluates the current benchmark state of virtual cell models predicting differentially expressed genes post-perturbation.
0:00 / 0:10exact quote · 10.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“The reality is today the best models are very poor at this. like the predictive ability of the DEGs as we call them is, is in the order of 10%.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Dave Burke
Burke: Virtual cell accuracy is limited by data quality, not architecture
“One of our conjectures is that one of the reasons the models aren't doing well is not just simply model structure. We have a lot of rich structures that we understand in the ML space and machine learning space that the issue is the Data quality.”
Burke: Arc Institute built SC Basecamp with 230M single cells
“We've created something called SC Basecamp and you can almost think of it like the Google crawler and index, so we've built this agent that goes onto the internet, And basically mines public single cell sequenced RNA data, and then curates it in a very sort of…”
Burke: Transcriptomic level is the right abstraction for cell modeling
“And so I think our belief around the room is the right level of abstraction is at the sort of transcriptomic level because you have these very complex gene pathways. And so whenever a cell is changing to its environment reacting, that it will be reflected and …”
Burke: Evo 2 trained on 9.3 trillion nucleotides predicts BRCA1 pathogenicity
“Like, if you look at the EVO II model, we trained it on 9.3 trillion
nucleotides, but we didn't tell it anything about DNA.
We just like, here's a lot of DNA on the planet across, you know, every single piece of DNA we could get a hold of.
And then what di…”