Code Completion
topic on 2 shows · 3 statements across 3 episodes
3 statements about Code Completion, every show
Mohan: Evaluating coding models requires hundreds of thousands of completions
“It's honestly really hard to get signal unless you have like a non-trivial amount of usage. Non-trivial meaning you're getting, you're doing hundreds of thousands of completions, if not millions of completions.”
Steinberger: Magic skipped launching code completions because next-gen models will obsolete them
“Like, we decided not to launch completions, because it's just obviously going to get killed by the next thing.”