Valenzuela: Creative AI alignment requires making models expressible and controllable
Cristobal Valenzuela · No Priors Ep. 2 | With Runway ML’s Cristobal Valenzuela · May 1, 2023 · at 46:05
Runway ML CEO Cristobal Valenzuela outlines the primary technical hurdles facing generative media models before they become fully mature creative mediums.
0:00 / 0:29exact quote · 30.0s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“These models and the systems need to become really expressible and controllable, which is somehow the way I like to think about alignment is like you have an intention and you want to express that intention in a very controllable way, right? These models are yet not controllable, right? Not exactly as we would like them to be, right? And the reason why, because of that is we're still very early. Like, there's a lot that had to be invented to control them and have them be very expressive and have them work in the way that you really want them to work.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Cristobal Valenzuela
Valenzuela: AI models on their own are not products
“Models on their own are not products, right? A model is, is, is a research component and taking a model and productionalizing that model, it's a different problem that actually building one single model, right?”
Valenzuela: Creative AI succeeds early because creative workflows tolerate 80% accuracy
“And in research, going from 80% to a hundred percent is really hard. I think that you'll be seeing that in, like, autonomous vehicles where, like, it's always, like, two years ahead and, like, always 80%, but, like, that 20, 10% is just really hard. This is re…”
Valenzuela: In decades, AI art will be seen as a natural, necessary transition
“What are we going to be asking ourselves in like, 1020 years, 30 years? I think it's the realization that we'll look back and we'll look at this moment as in like, yeah, I mean, it was a natural transition and we needed it. It allowed us to do so many things t…”
Valenzuela: It takes 12-24 months to understand new AI breakthroughs
“The moment something gets released, like, let's say transformers or a particular piece of technology that you think would be interesting or could be worth experimenting with, I think it takes a collective set of months, like, 12, 24 months sometimes to underst…”
Valenzuela: Runway had to own its AI stack to push creative tools forward
“If we really want to make and move the standard of like creative tools in the ways and vision that we had to own our stack. And so we started building this research team, right?”
Valenzuela: Multimodal AI will merge previously siloed creative software tools
“I think a common natural evolution of just the creative stack or the creative software solutions out there, they tend to be very specific to domains of content. So you have a tool that's specialized on, like, Image editing. And then you have a tool that specia…”