使用Player FM应用程序离线!
#182 Monsters, Aliens, and Lip-Synced Dubbing with MARZ CEO Jonathan Bronfman
Manage episode 376327569 series 2975363
“The face is the uncanny valley. The nuance and detail in the face and the way it moves is a very difficult thing to animate,” Jonathan Bronfman, CEO of MARZ explains on SlatorPod.
Canada-based MARZ, which stands for Monsters Aliens Robots Zombies, was founded in 2018 to leverage AI and bring quantifiable metrics like time and cost to the business of visual effects (VFX).
Bronfman recounts how their research for Vanity AI, a solution that creates effects such as de-aging, cosmetic, wig, and prosthetic fixes, led to them becoming an “expert at the face” and launching LipDub AI, a solution to solve the “mismatch between spoken word and visuals for viewers”.
According to Bronfman, users can take an audio stem (the dialogue track), the original piece of footage, and push both through LipDub and have a lip-synced visual in 30 seconds. Bronfman also explains that their USP is that LipDub is Hollywood-grade and works on 4K and ProRes files.
The two also discuss how actors feel about the emergence of lip-syncing visual effects and why Bronfman does not think an expansion into the creator market is on the cards for MARZ.
Florian shares that as a life-long consumer of dubbed content he sees the massive potential in a solution that improves the viewer experience and makes it more natural.
章节
1. Intro (00:00:00)
2. MARZ in a Nutshell (00:01:20)
3. Growth Journey (00:06:37)
4. LipDub AI Launch (00:08:17)
5. Target Market (00:10:04)
6. Reception from Clients (00:12:38)
7. Linguistic Challenges (00:15:05)
8. Actor's Feedback (00:18:44)
9. Manipulating Beyond the Mouth (00:22:37)
10. Language Aspect and Other Media (00:24:22)
11. Audio Production (00:25:30)
12. AI Hype and Impact (00:26:39)
13. Thoughts on the Creator Market (00:28:44)
225集单集
Manage episode 376327569 series 2975363
“The face is the uncanny valley. The nuance and detail in the face and the way it moves is a very difficult thing to animate,” Jonathan Bronfman, CEO of MARZ explains on SlatorPod.
Canada-based MARZ, which stands for Monsters Aliens Robots Zombies, was founded in 2018 to leverage AI and bring quantifiable metrics like time and cost to the business of visual effects (VFX).
Bronfman recounts how their research for Vanity AI, a solution that creates effects such as de-aging, cosmetic, wig, and prosthetic fixes, led to them becoming an “expert at the face” and launching LipDub AI, a solution to solve the “mismatch between spoken word and visuals for viewers”.
According to Bronfman, users can take an audio stem (the dialogue track), the original piece of footage, and push both through LipDub and have a lip-synced visual in 30 seconds. Bronfman also explains that their USP is that LipDub is Hollywood-grade and works on 4K and ProRes files.
The two also discuss how actors feel about the emergence of lip-syncing visual effects and why Bronfman does not think an expansion into the creator market is on the cards for MARZ.
Florian shares that as a life-long consumer of dubbed content he sees the massive potential in a solution that improves the viewer experience and makes it more natural.
章节
1. Intro (00:00:00)
2. MARZ in a Nutshell (00:01:20)
3. Growth Journey (00:06:37)
4. LipDub AI Launch (00:08:17)
5. Target Market (00:10:04)
6. Reception from Clients (00:12:38)
7. Linguistic Challenges (00:15:05)
8. Actor's Feedback (00:18:44)
9. Manipulating Beyond the Mouth (00:22:37)
10. Language Aspect and Other Media (00:24:22)
11. Audio Production (00:25:30)
12. AI Hype and Impact (00:26:39)
13. Thoughts on the Creator Market (00:28:44)
225集单集
Alle episoder
×欢迎使用Player FM
Player FM正在网上搜索高质量的播客,以便您现在享受。它是最好的播客应用程序,适用于安卓、iPhone和网络。注册以跨设备同步订阅。