foundational models

3 statements across 3 episodes · 0 bullish · 2 bearish · 3 people on the record · first statement Jul 23, 2024 by Thomas Scialom · across every show →

Everything said about foundational models, oldest first

Jul 23, 2024 bearish
Opinion
Scialom: AI has minted infrastructure unicorns but few successful application companies
“I see like now a lot of fundamental stacks that are like the unicorn of today. Foundational models, foundational like clusters, data notations, things like that. There's a lot, but less successful yet, for now at least, application company. And it's hard to bu…”
Thomas Scialom Jul 23, 2024 ▶ 1:02:32 Training Llama 2, 3 & 4: The Path to Open Source AGI — with Thomas Scialom of Meta AI
Aug 7, 2024 neutral
Disclosure
Meta FAIR focuses on building foundational models, not specific use cases
“Fair, we don't really build with a specific use case in mind. We try to build like these foundational models that can be applied to lots of different use cases out of the box.”
Nikhila Ravi Aug 7, 2024 ▶ 34:47 Segment Anything 2: Memory + Vision = Object Permanence — with Nikhila Ravi and Joseph Nelson
Aug 22, 2024 negative
Opinion
Step-by-step prompting on foundational models cannot achieve SOTA SWE-bench performance
“I think it's fairly obvious that with the foundational models, like you can ask them to think by step by step and ask them to plan and stuff, but that isn't enough because if you look at how those models score on these benchmarks and then they're not They're n…”
Alistair Pullen Aug 22, 2024 ▶ 31:38 Is finetuning GPT4o worth it?
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.