AI research

“And I think what you're going to see is that there's a lot of work that's going to be done in games, but the goal is, of course, bring it out of the game, and actually use it to solve problems in the real world, and to actually, you know, be able to interact w…”

“And you know, it's not the kind of sexy research that people want to see, where you have like some hierarchy of big RNN, but it actually, this kind of research, I think at this point will advance field the most.”

“And what people do is people kind of try to invent problems and the, such as solving some complicated games of character structure, and they try to Add kind of extra features to their models to combat those problems, but I think there's very little research ha…”

“I'm very pro open publishing. Like, I think, like, it should be the default, and it's like, I'm still disputing situations where I'm like, you shouldn't publish on this stuff. Just because like, I think it is actually to the benefit of everybody to know what t…”

“Just getting to that point where it's sort of plausibly begins to work is, is a huge, difficult problem. And it's completely separate from using scaling laws. Now, once you get it to work, that's when scaling laws come into play.”

“I think almost everything kind of has to be done empirically. Like, you can kind of, like, come up with theories, but in practice, like, the first thing you're gonna do with your theory is test it, and most of the time you'll have gotten it wrong. So you shoul…”

“But I think one of the interesting things that's come out of progress in artificial intelligence is we're seeing this big unification in neuroscience and AI. I think we're actually learning a lot from AI research, more than I think we thought we would learn fr…”