Symbolic World Models
topic on 1 show · 1 statements across 1 episodes
1 statements about Symbolic World Models, every show
Manning: Reward hacking is unsolved in symbolic and pixel-based models
“I mean, to the extent that there's a misspecified reward that it seems like it could be hacked
In a more symbolic world or in a more pixel based world. I don't know if Sun's got any thoughts, but I don't think that's really being solved.”