large models

“I do say these large models as well should be viewed as fiction, creative models, not fact models, because otherwise we've created the most efficient compression in the world. Does it make sense you can take terabytes of data and compress it down to a few giga…”

“I think that small models will outperform large models massively, like I said, the Hive model aspect”

“Today to train these large models, you need all of the GPUs co-located because there is enough data transfer between different chips, right? Between your nodes. And there's a physical constraint on that in that you need to get that much power and to a data, da…”

“Over time, applications are going to want efficient inference, and, like, really large models are impossible today to serve for the vast majority of use cases from a cost and speed perspective”