scaling laws

“The most technical definition of scaling law does apply and we have seen it apply in this domain. And it's somewhat not surprising because like if you think about like the scaling law in the most technical sense, which is if you scale up data and you scale up …”

“It's very unclear whether you can really the scaling law is really enough to get Get you to prove Riemann hypothesis or any of the math conjectures. So you know, and also you have to be superhuman performance in some sense, right? So if you turn on just the co…”

“When people talk about the scaling loss in neural networks, the scaling laws are actually a to a large extent of a property of the transformer. Before the transformer, people were playing with LSTMs and stacking them, etc. You don't actually get like clean sca…”

“We're starting to enter into a sort of flat part of the curve and we're certainly past the point where if you just interact with a model, You can know how smart it is. Like the vibe checks, they're losing utility.”

“We've, we're seeing evidence of scaling laws in biology across proteins, right? That's been shown in the protein language models across DNA, which is what we've shown in our EVO series of models from ARC. We're also seeing inference time scaling laws which in,…”