Augmented Audiovisual Translation: the Perks and Perils of the Implementation of Artificial Intelligence in Subtitling and Dubbing

This thesis examines the state of audiovisual translation (AVT) in the aftermath of the COVID-19 emergency, highlighting new trends with regards to the implementation of AI technologies as well as their strengths, constraints, and ethical implications. It starts with an overview of the current AVT landscape, focusing on future projections about its evolution and its critical aspects such as the worsening working conditions lamented by AVT professionals – especially freelancers – in recent years and how they might be affected by the advent of AI technologies in the industry. The second chapter delves into the history and development of three AI technologies which are used in combination with neural machine translation in automatic AVT tools: automatic speech recognition, speech synthesis and deepfakes (voice cloning and visual deepfakes for lip syncing), including real examples of start-up companies that utilize them – or are planning to do so – to localize audiovisual content automatically or semi-automatically. The third chapter explores the many ethical concerns around these innovative technologies, which extend far beyond the field of translation; at the same time, it attempts to revindicate their potential to bring about immense progress in terms of accessibility and international cooperation, provided that their use is properly regulated. Lastly, the fourth chapter describes two experiments, testing the efficacy of the currently available tools for automatic subtitling and automatic dubbing respectively, in order to take a closer look at their perks and limitations compared to more traditional approaches. This analysis aims to help discerning legitimate concerns from unfounded speculations with regards to the AI technologies which are entering the field of AVT; the intention behind it is to humbly suggest a constructive and optimistic view of the technological transformations that appear to be underway, whilst also acknowledging their potential risks.

Audiovisual materials and second-language acquisition: a comparison between native language subtitles and target language captions.

Over the last few years, the massive popularity of video streaming platforms has managed to impact our daily habits by making the watching of movies and TV shows one of the main activities of our free time. By providing a wide range of foreign language audiovisual content, these entertainment services may represent a powerful resource for language learners, as they provide them with the possibility to be exposed to authentic input. Moreover, research has shown the beneficial role of audiovisual textual aids such as native language subtitles and target language captions in enhancing language skills such as vocabulary and listening comprehension. The aim of this thesis is to analyze the existing literature on the subject of subtitled and captioned audiovisual materials used as a pedagogical tool for informal language learning.