The orchestration of modes and EFL audio-visual comprehension: A multimodal discourse analysis of vodcasts

This thesis explores the role of multimodality in language learners’ comprehension, and more specifically, the effects on students’ audio-visual comprehension when different orchestrations of modes appear in the visualization of vodcasts. Firstly, I describe the state of the art of its three main areas of concern, namely the evolution of meaning-making, Information and Communication Technology (ICT), and audio-visual comprehension. One of the most important contributions in the theoretical overview is the suggested integrative model of audio-visual comprehension, which attempts to explain how students process information received from different inputs. Secondly, I present a study based on the following research questions: ‘Which modes are orchestrated throughout the vodcasts?’, ‘Are there any multimodal ensembles that are more beneficial for students’ audio-visual comprehension?’, and ‘What are the students’ attitudes towards audio-visual (e.g., vodcasts) compared to traditional audio (e.g., audio tracks) comprehension activities?’. Along with these research questions, I have formulated two hypotheses: Audio-visual comprehension improves when there is a greater number of orchestrated modes, and students have a more positive attitude towards vodcasts than traditional audios when carrying out comprehension activities. The study includes a multimodal discourse analysis, audio-visual comprehension tests, and students’ questionnaires. The multimodal discourse analysis of two British Council’s language learning vodcasts, entitled English is GREAT and Camden Fashion, using ELAN as the multimodal annotation tool, shows that there are a variety of multimodal ensembles of two, three and four modes. The audio-visual comprehension tests were given to 40 Spanish students, learning English as a foreign language, after the visualization of vodcasts. These comprehension tests contain questions related to specific orchestrations of modes appearing in the vodcasts. The statistical analysis of the test results, using repeated-measures ANOVA, reveal that students obtain better audio-visual comprehension results when the multimodal ensembles are constituted by a greater number of orchestrated modes. Finally, the data compiled from the questionnaires, conclude that students have a more positive attitude towards vodcasts in comparison to traditional audio listenings. Results from the audio-visual comprehension tests and questionnaires prove the two hypotheses of this study.

International conference paper presentations: A multimodal analysis to determine effectiveness

International conference presentations represent one of the biggest challenges for academics using English as a Lingua Franca (ELF). This paper aims to initiate exploration into the multimodal academic discourse of oral presentations, including the verbal, written, non-verbal material (NVM) and body language modes. It offers a Systemic Functional Linguistic (SFL) and multimodal framework of presentations to enhance mixed-disciplinary ELF academics' awareness of what needs to be taken into account to communicate effectively at conferences. The model is also used to establish evaluation criteria for the presenters' talks and to carry out a multimodal discourse analysis of four well-rated 20-min talks, two from the technical sciences and two from the social sciences in a workshop scenario. The findings from the analysis and interviews indicate that: (a) a greater awareness of the mode affordances and their combinations can lead to improved performances; (b) higher reliance on the visual modes can compensate for verbal deficiencies; and (c) effective speakers tend to use a variety of modes that often overlap but work together to convey specific meanings. However, firm conclusions cannot be drawn on the basis of workshop presentations, and further studies on the multimodal analysis of ‘real conferences’ within specific disciplines are encouraged.

Multimodal analysis of a sample of political posters in Ireland during and after the Celtic Tiger

The aim of this research paper is to analyse the key political posters made for the campaigns of Irish political party Fianna Fáil framed in the Celtic Tiger (1997-2008) and post-Celtic Tiger years (2009-2012). I will then focus on the four posters of the candidate in the elections that took place in 1997, 2002, 2007 and 2011 with the intention of observing first how the leader is represented, and later on pinpointing the similarities and possible differences between each. This is important in order to observe the main linguistic and visual strategies used to persuade the audience to vote that party and to highlight the power of the politician. Critical discourse analysis tools will be helpful to identify the main discursive strategies employed to persuade the Irish population to vote in a certain direction. Van Leeuwen’s (2008) social actor theory will facilitate the understanding of how participants are represented in the corpus under analysis. Finally, the main tools of Kress and van Leeuwen’s visual grammar (2006) will be applied for the analysis of the images. The study reveals that politicians are represented in a consistently positive way, with status and formal appearance so that people are persuaded to vote for the party they represent because they trust them as political leaders. The study, thus, points out that the poster is a powerful tool used in election campaigns to highlight the power of political parties.

The conversation on political issues on Twitter: an analysis of the participation and frames in the debate on the 'Wert law' and evictions in Spain

The aim of this study is to determine which social agents are involved in the political debate on Twitter and whether the interpretive hegemony of actors that have traditionally been the most prominent is tempered by the challenge of framing shared with audiences. The relationship between the interpretations expressed and the profiles of participants is analyzed in comparison with the frames used by mainstream media. The chosen methodology combines content analysis and discourse analysis techniques on a sample of 1,504 relevant tweets posted on two political issues –the approval of the education law LOMCE and the evictions caused by the crisis, which have also been studied in the front pages of four leading newspapers in Spain. The results show a correlation between political issue singularities, frames and the type of discussion depending on the participants.