Presentation
Just-Dub-It: Video dubbing via Joint Audio-Visual Diffusion
SessionMultimodal Learning
DescriptionJUST-DUB-IT is a unified audio-video diffusion model for automatic video dubbing. It jointly synthesizes translated speech and synchronized lip movements via a lightweight LoRA adapter, replacing traditional pipeline approaches. Trained on synthetically generated multilingual data with strategic inpainting, it achieves superior visual quality and lip sync across varied motion scenarios.
Event Type
Technical Paper
TimeThursday, 23 July 20264:25pm - 4:35pm PDT
LocationRoom 403 A
Digital Library
PDF
Session Time & Location
Sunday, 19 July 20266:00pm - 8:45pm PDTHall K
Thursday, 23 July 20263:45pm - 5:15pm PDTRoom 403 A
Artificial Intelligence/Machine Learning
Generative AI
Full Conference Supporter
Full Conference
