NeurIPS

“The first sort of deep learning workshops workshop at NIPS back in the day, now NeurIPS that was basically like 30, 40 people all the now super famous folks”

“And that led, actually, this was two years of research. We published it also at NeurIPS and a bunch of other conferences. We call this RPT-ONE, so RAPID-ONE stands for relational pre-trained transformers. It's still based on the transformer architecture, but w…”

“Internally we have this system. We talked about it briefly once at NeurIPS. We have a huge HSTU-based system that models the whole companies.”

“Also the IR community and the retrieval community is also like always behind the mainstream. And then now it's just probably gotten even more worse because of ILM and stuff. So, okay, I'm getting into Hottick territory, but it's just, like, certain conferences…”

“You go to the major international conferences, Nureps, ICML, and others, and often the best paper awards are actually won by researchers out of universities.”

“Jensen was sitting towards the front row. And it's not like he hired somebody to take notes on. He's sitting there taking notes, showing up himself and trying to observe, absorb all the recent developments in artificial intelligence.”

“The focus I saw is that model papers at NeurIPS are kind of dead. No one really presents models anymore. It's just data sets because it's all the grad students are working on.”

“I think it's like over 10,000 attendees. There were 3000 papers, more than 3000 papers accepted, and I think back in 2017 there was only around 600 papers.”