Learning Rate
topic on 2 shows · 3 statements across 3 episodes
3 statements about Learning Rate, every show
Modon: Treating construction projects as one-offs eliminates learning curve benefits
“When we move into projects world, everything's a snowflake. It's like, you know, everything's end of one. Even a project that we're building, you know, we built lots of refineries. That next refinery that we build is still an end of one project. And because it…”
Bakouch: Optimizer ablations must wait for full learning rate decay
“Especially when doing optimizer ablation, you never want to look at early curve, and you want to, like, wait for the long rate to have fully decay, and, like, do anything to be to zero, or whatever value.”
Kann: Nuclear fission struggles on learning curves because it is an engineered project
“I think that's where things like nuclear fission have struggled in the past. It's not really a manufactured technology. It's an engineered project. And it's tougher to get the kind of learning rates with stuff like that.”