compute capacity

3 statements across 3 episodes · 0 bullish · 0 bearish · 2 people on the record · first statement Aug 25, 2023 by Guido Appenzeller · across every show →

Everything said about compute capacity, oldest first

Aug 25, 2023 neutral
Insight
Appenzeller: AI founders should shop around across cloud providers
“I think my number one advice would be to shop around. For a certain process which you don't want to use, there's capacity, but for another one that you do want to use, they don't have the capacity.”
Guido Appenzeller Aug 25, 2023 ▶ 0:15 Chasing Silicon: The Race for GPUs
Sep 1, 2023
Assertion Not checkable as stated
Appenzeller: Training open-source LLMs requires $2M to $10M in compute
“You need to find a couple of million or ten million dollars of compute capacity to do it, and that makes it so much harder, right?”
Guido Appenzeller Sep 1, 2023 ▶ 10:50 The True Cost of Compute
Dec 28, 2023 neutral
Insight
Mensch: Compute-optimal LLM scaling requires equal relative growth in parameters and data
“In common words, if you multiply by four your compute capacity, you should multiply by two, the model size and by two, the data size.”
Arthur Mensch Dec 28, 2023 ▶ 4:09 Safety in Numbers: Keeping AI Open
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 1,000 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.