Çubuk: Materials science lacks a CASP-like benchmark database for machine learning
Doğuş Çubuk (Doj Chubuk) · Can AI revolutionize materials discovery? · Sep 19, 2024 · at 34:38
Google DeepMind research scientist Doğuş Çubuk discusses the lack of standardized benchmarks in materials science compared to structural biology.
0:00 / 0:11exact quote · 11.5s
720p mp4 · rendered on demand · StarZero watermark
“And I think now, maybe because now machine learning really needs this high precision, large data set, there are these bigger efforts trying to create a CAASPP-like database, but it's not there yet.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Doğuş Çubuk (Doj Chubuk)
Çubuk: AI simulations will never completely eliminate physical lab work
“So I think, I can't imagine a future where we completely eliminate lab work. Because, first of all, we don't know if quantum mechanical simulations will ever become good enough to correctly predict experiments, you know, all the time.”
Çubuk: Physical materials experiments are as noisy as computational simulation errors
“In material science, I think one of the issues is the experimental data is actually quite noisy. So, you know, this is something that you might hear often that simulations and DFT isn't very accurate, and that's true, but maybe one thing that People don't noti…”
Çubuk: AI models excel at textbook science but cannot generate paradigm shifts
“AI hasn't really done this yet. Even today's best AI models seem to be really good at kind of doing the textbook stuff, you know, like high school, college, but then when you think about being more creative and, you know, trying to shift the paradigm, it's bee…”
Çubuk: Deep learning scaling laws apply to quantum mechanics and materials
“The more training data you put into LLMs, the better results you get, and how much better your results are actually predictable. It's kind of like a power law. This comes back from, you know, a paper from Baidu Research from back in 2016, I think, and it seems…”
Çubuk: Deep expertise optimizing existing materials hinders discovering radically different ones
“The better you know a system,
The more you can continue optimizing the system, but it doesn't necessarily mean that knowledge will help you discover something different.
And I think this is probably why a lot of important discoveries are serendipitous, because…”
Çubuk: Optimization of decades-old materials impedes commercialization of new discoveries
“If you think about plastics, we're still mostly using things that we discovered 70 years ago, 80 years ago, and we've gotten so good at, you know, manufacturing them, optimizing them, so now
For someone to come up and say, oh, I discovered a completely differe…”