Led by a founder who sold a video startup to Apple, Panjaya uses deepfake techniques to bite into video dubbing
Localization scope is expanding beyond text to video, audio, and interactive content,
Why this matters
- New AI dubbing tool could enhance video localization quality.
- Increased demand for localized video content may drive industry growth.
- Potential for significant viewer engagement improvements with native language content.
Panjaya, a startup emerging from stealth mode, has introduced BodyTalk, a groundbreaking generative AI dubbing tool that mimics the original speaker’s voice and physical movements in translated videos. With a recent funding round of $9.5 million, the company aims to revolutionize video localization by offering near real-time translation in 29 languages, enhancing the viewer experience with uncanny realism. Co-founders Hilik Shani and Ariel Shalom, alongside CEO Guy Piekarz, leverage their deep learning expertise to create a platform that not only translates but also modifies video content seamlessly.
This innovation is significant for the localization industry as it addresses the growing demand for high-quality dubbed content, particularly in B2B contexts. Panjaya’s technology has already shown promising results, with TED reporting a 115% increase in views for dubbed Talks, illustrating that native language content can drive better engagement. As the market shifts towards more immersive and authentic experiences, tools like BodyTalk could redefine how businesses approach video localization.
For localization professionals, the rise of AI-driven dubbing solutions like BodyTalk presents an opportunity to enhance content accessibility and engagement. As demand for localized video content grows, embracing such technologies could be key to staying competitive in an evolving landscape.
Source: techcrunch.com