Alignment Tax
topic on 1 show · 1 statements across 1 episodes
1 statements about Alignment Tax, every show
Alignment tax happens because models are fine-tuned instead of continued pre-trained
“ULM fit is the wrong approach and that's why we're seeing a lot of these You know, so-called alignment tax, and this view of like, oh, a model can't both code and do other things. You know, I think it's actually because people are training them wrong.”