Godement: OpenAI will only build tools closest to the model
Olivier Godement · Building AGI in Real Time (OpenAI Dev Day 2024) · Oct 4, 2024 · at 31:05
Olivier Godement discusses OpenAI's product scope and developer tooling strategy relative to other AI infra providers.
0:00 / 0:20exact quote · 20.6s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“There is no freaking way that OpenAI can build everything. Like, there is just too much to build, frankly. And so, my philosophy is, essentially, we'll focus on, like, the tools which are, like, the closest to the model itself. So that's why you see us, like, you know, investing quite a bit in, like, fine-tuning, distillation, evaluation, because we think that it actually makes sense to have, like, in one spot.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Olivier Godement
Godement: Developers will rely on continuous, automated fine-tuning within years
“The vision we have is, fast forward a couple of years, I think, like, most developers will essentially, like, have an automated, continuous, fine-tuned model. The more, like, you use the model, the more data you pass to the mobile provider, like, the model is …”
Godement: OpenAI plans API knobs for developers to adjust safety thresholds
“And so I think the direction where we'll go here is that, basically, there will always be, like, you know, a set of behavior that will, you know, just, like, forbid, frankly, because they're illegal against our terms of services, but then there will be, like, …”
Godement: Vision fine-tuning shows higher performance uplift than text
“We've been alpha testing, like, the vision fine tuning, like, for several weeks at that point. We are seeing, like, even higher performance uplift compared to text fine tuning.”
Godement: Founders should build apps slightly too difficult for current models
“As a developer, as a founder, you basically want to build an app, which is a bit too difficult for the model today, right? Like what you think is right. It's like sort of working, sometimes not working. And that way, you know, that basically gives us like a go…”