asynchronous model merging
1 statements across 1 episodes · 1 bullish · 0 bearish · 1 people on the record · first statement May 9, 2025 by Will Brown · across every show →
Everything said about asynchronous model merging, oldest first
May 9, 2025 positive
Weight updates across specialized tasks are orthogonal enough to merge asynchronously
“The updates made to model weights are orthogonal enough for specialized tasks that this is actually like totally fine. Things are nice and linear in most cases, things are nice and orthogonal, and you can get away with a lot of async updates to models that are…”