Protein Language Models
topic on 2 shows · 3 statements across 2 episodes
3 statements about Protein Language Models, every show
Alex Rives: Protein language models emergently learn biological structure and function
“One of the classes of models that we train are these protein language models. So they're really, you know, it's trained on the codes of proteins, and so anything they learn about biology is, is kind of emergent. And we've seen that they can learn things like b…”
Scaling protein models by orders of magnitude unlocks emergent biological capabilities
“So our team has really explored that idea over a number of different years, and we've really kind of, I think, seen the scaling curve and really seen as we have increased models by an order of magnitude kind of in each generation that, you know, there's this e…”
Rives: Amino acid sequence patterns allow protein language models to learn biology
“The contexts in which an amino acid can occur are really determined by, you know, the structure, the function of the protein, its biological roles, you know, these I mean, very complex phenomenon both the intrinsic biology of the protein and its relation to al…”