Prediction Held up AI assessment confidence: 90% certainty 2/5 debate potential 1/5

Biggio: Real-time video/vision is likely the next Realtime API feature

Ilan Biggio · Building AGI in Real Time (OpenAI Dev Day 2024) · Oct 4, 2024 · at 16:15

Ilan Biggio, Developer Experience Engineer at OpenAI, discusses the roadmap for OpenAI's newly announced Realtime API at OpenAI DevDay 2024.

0:00 / 0:13exact quote · 13.3s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“To use ChatGPT's voice mode as an example, like we've demoed the video, right? Like real-time image, right? So I'm not actually sure what timelines are, but I would expect, if I had to guess, that like that is probably the next thing that we're going to be making.”

quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →

More from Ilan Biggio

Insight
Biggio: Forcing function calls over voice yields reliable UI control
“Speech to text is really interesting because you can prevent, you can prevent responses like audio responses and force function calls. And so you can do stuff like UI control that is like super, super reliable... If you like cut out the audio outputs and make …”
Ilan Biggio Oct 4, 2024 ▶ 16:56 Building AGI in Real Time (OpenAI Dev Day 2024)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.