Description:
The Automatic Dubbing Solution (ADS) project aims to automate the entire dubbing pipeline—from transcription to translation to speech synthesis—using state-of-the-art artificial intelligence technologies such as Automatic Speech Recognition (ASR), Natural Language Processing (NLP), and Text-to-Speech (TTS). To ensure a high-quality user experience, the project integrates speech morphing techniques that generate lifelike voices faithful to the original actors, maintaining emotion, tone, and rhythm. Moreover, the solution will incorporate a better lip-sync accuracy without altering the visual content. The transcription module, powered by advanced deep learning algorithms, feeding into the ADS pipeline leverages VoiceInteraction proven know-how in transcription and subtitling. Similarly, the machine translation module will provide accurate translations, mindful of the character count for lip-synching, tailored to each target language. By combining transcription, translation, and speech synthesis in a single pipeline, ADS will significantly reduce localization costs and timelines, helping content creators reach global audiences faster. Aligned with Portugal's National Strategy for Smart Specialization (ENEI) and the Lisbon Regional Smart Specialization Strategy (RIS3), the ADS project supports technological innovation in the creative industries. It strengthens Portugal's role in the digital economy and promotes the internationalization of national companies. With the APAC and North American markets in mind, the platform is designed to scale globally, contributing to broader access to multilingual content and positioning VoiceInteraction as a key provider of AI-powered speech processing technologies.

Grants: Project title: ADS – Automatic Dubbing Solution

Project code: Portugal 2030 – 14385

Intervention region: Lisbon region, Portugal

Beneficiary entity: VOICEINTERACTION - Tecnologias de Processamento de Fala, S.A.

Start Date: 01-08-2022

Completion Date: 31-07-2024

Total eligible cost: €314.784,42

VOICEINTERATION Investment: €786.961,05