chain of thought

“The components that you just mentioned, I'm pretty sure will be part of the final architecture for AGI. So I think they've come such a long way now and we've proven out so many things about what they can do. I can't see a world in which we will sort of realize…”

“If you chain of thought it on all the bubble sort input and output, it will only do bubble sort. In fact, it won't even do bubble That well.”

“There already exists some type of recursion that people are used to in LLMs, which is a chain of thought we mentioned earlier, but that is a recursion that's happening in the token space of the model's outputs, not inherent to the model itself. That's sort of …”

“Unless you're training it on human labeled traces for which there's a lot of problems like the millennial prize problem. We don't have the trace for it.”

“That's the most important part, is that if we had Sudoku, and we know how to solve Sudoku, because like we were just, you know, dumb homo sapiens that didn't know how to solve Sudoku, like it would just have solved it. And that's why it's cool, because it actu…”

“And so it's completely true that at test time, they are turn complete. And you can simulate all turn computable functions at test time.”