speculator
1 statements across 1 episodes · 0 bullish · 0 bearish · 1 people on the record · first statement Aug 3, 2026 by Philip Kiely · across every show →
Everything said about speculator, oldest first
Aug 3, 2026
Training speculative decoding models requires hidden states from the base model
“Now, with speculators today, you need to train the speculator using the base model itself, because you're getting hidden states out of the model from running inference on these specific prompts, and that is the training data you use to create the speculator.”