LLM pre-training
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Aug 24, 2023 by Jakob Uszkoreit · across every show →
Everything said about LLM pre-training, oldest first
Aug 24, 2023
Uszkoreit: Human learning is fine-tuning, while evolution is pre-training
“But I think that's because we confuse fine tuning and pre-training. Pre-training is all of evolution. And then basically you arrive at this thing that It's maybe doing something that's completely, in a certain sense, a completely irrelevant task at first, but …”