world models

“If you think about predicting the next word, It's, it seems very simple, but you have to really internalize a lot of what is going on in this context. What are the previous words? What's the syntax? What's who's saying them? And all of that information and con…”

“I actually don't know that I believe that any of the sort of more immediate term commercial applications of these models are interesting. People are like, oh, we can generate games or we'll have like gaming assets or we'll use the data for robotics training or…”

“To create world models, three-D foundation models we require More and more sophisticated data engineering, data acquisition, data processing, and data synthesis. So I am envious of my NLP LLM colleagues that the data is so abundant on the internet, and we don'…”

“And I think that the way we would see the ultimate architectures of these platforms is Probably for a while, not an all in one thing. We would probably see some hyper efficient thousand person synchronization state engine.”