domain specific models
also referred to as: domain-specific models
1 statements across 1 episodes · 2 bullish · 0 bearish · 2 people on the record · first statement Jun 25, 2024 by Jonathan Frankle · across every show →
Everything said about domain specific models, oldest first
Jun 25, 2024 positive
Frankle: Dynamic data mixing during pre-training is effective for domain-specific models
“We've had some surprisingly good luck with this. We just released a paper on it. The details matter a lot and it really matters what you're trying to do with the model. But it's been quite effective for us depending on the setting. And certainly when we're thi…”
Jul 16, 2026 bullish
Beam: Lila's 10-trillion-token general science model beats specialized AI
“So we have assembled this reasoning data set of 10 trillion scientific tokens reasoning traces that are experimentally verified across life sciences, chemistry, and material sciences, and we have seen that this general model often beats the domain-specific mod…”