Audio Video Generation
topic on 1 show · 1 statements across 1 episodes
1 statements about Audio Video Generation, every show
He: Audio-video models require precise time alignment unlike text-to-video
“So one important thing is like the alignment. So the model has to know like the video and audio, the it has to have a time based alignment, like at which time step the video and the audio token correspond to each other. We actually don't have these kind of ali…”