alignment tax
1 statements across 1 episodes · 0 bullish · 1 bearish · 1 people on the record · first statement Oct 20, 2023 by Jeremy Howard · across every show →
Everything said about alignment tax, oldest first
Oct 20, 2023 negative
Alignment tax happens because models are fine-tuned instead of continued pre-trained
“ULM fit is the wrong approach and that's why we're seeing a lot of these You know, so-called alignment tax, and this view of like, oh, a model can't both code and do other things. You know, I think it's actually because people are training them wrong.”