A Cross-Cultural Examination of the Use of Multimodal Metaphor in English and Arabic Cartoons of the ‘Arab Spring’ in Egypt

El estudio de Lakoff y Johnson Metáforas de la vida cotidiana (1980) ha dotado al campo de la metáfora de un renovado interés, y a éste siguieron numerosas publicaciones abordándolo desde diversas perspectivas. Lakoff y Johnson (1980) aseguran que la metáfora es, de hecho, una característica del pensamiento y, por consiguiente, ya no es una propiedad exclusiva del lenguaje. La metáfora sería en realidad un reflejo de cómo concebimos e interpretamos el mundo en que vivimos, en la medida en que está conformada por nuestras experiencias corporales, un fenómeno al que Lakoff y Johnson se refieren como la “mente corpórea”. La metáfora cumple la función de “comprender” y facilitar la interpretación de un ámbito o experiencia en los términos de otro ámbito o experiencia (Lakoff & Johnson, 1980: 36). Los conceptos abstractos son difíciles de ser pensados per se; consecuentemente, las personas recurren a la metáfora para concebirlos en los términos de otras nociones más concretas que están, en cierto grado, vinculadas a nuestras experiencias somáticas. Si bien no escasean las investigaciones en el campo de las metáforas, parece haber, sin embargo, cierto vacío en lo tocante a la manifestación de la metáfora en modos distintos del modo verbal. Forceville (2009: 19) afirma que uno de los principios fundamentales de la Teoría de la Metáfora Conceptual es la idea de que el variado empleo de metáforas por parte del ser humano sugiere “que piensa en gran medida metafóricamente”. Esto lleva a la conclusión de que la manifestación de la metáfora debería estar presente en los diversos modos del pensamiento, y no únicamente en el verbal. Estos otros modos de pensamiento incluyen, entre otros, las imágenes, la música, los sonidos y los gestos. Asimismo, la mayoría de estudios que se han realizado en el área de las metáforas multimodales ha sido aplicada al terreno de la publicidad. Los anunciantes parecen advertir el ! 2! poder que se invierte en las metáforas, y las usan profusamente para transmitir mensajes a los consumidores. No obstante, recientemente existe un nuevo interés por investigar el uso de metáforas multimodales en las caricaturas (véase, por ejemplo, El Refaie 2003, 2009; Schilperoord y Maes 2009; Yus 2009; Bergen 2003; Marin Aresse 2008). Las tiras cómicas se distinguen de los anuncios principalmente por el hecho de que las caricaturas transmiten una postura negativa frente a un sujeto particular, mientras que los anuncios presentan una actitud positiva. Igualmente, les diferencia el hecho de que las tiras cómicas requieren un conocimiento social y político específico. El presente escrito examina y compara el uso de metáforas multimodales en caricaturas políticas – tanto inglesas como árabes – que retratan la Primavera Árabe en Egipto, con el fin de determinar: (1) si la mayoría de caricaturas son conceptualmente específicas o culturalmente específicas; (2) los principales dominios fuente empleados por los caricaturistas ingleses y árabes para interpretar la Primavera Árabe; (3) si hay semejanzas o diferencias entre las caricaturas inglesas y las árabes en su elección del dominio meta; y (4) observar también cómo los distintos modos (aquí esencialmente los modos verbal y pictórico) contribuyen a representar la Primavera Árabe. El corpus para este estudio se compone de un total de 50 tiras cómicas, 25 de ellas inglesas y las 25 restantes árabes. En cada una de estas tiras debe haber al menos una metáfora que representa la Primavera Árabe o alguno de sus subtemas. Las tiras han sido seleccionadas aleatoriamente a través de Internet. Para el análisis, la investigadora ha seguido el marco teórico propuesto por Bounegru y Forceville (2011) en cuanto a la determinación de metáforas en general, así como la determinación de metáforas multimodales de tipo verbovisual en particular. Por cada tira cómica se ha llevado a cabo un análisis independiente, determinando el dominio fuente y el dominio meta, las metáforas, las asignaciones, qué se está representando verbalmente y qué se representa pictóricamente. Además, la autora ha analizado ! 3! posteriormente si estas metáforas son culturalmente específicas o no, y/o si están relacionadas con metáforas más genéricas o universales. El análisis que comprende este trabajo se divide en dos secciones. La primera parte es un estudio detallado de los dos corpora, abordando los distintos escenarios de los dominios fuente empleados por los dibujantes según su similitud. Esta sección presenta a su vez un análisis de los diversos modos que se utilizan para revelar el dominio fuente así como el dominio meta. Del mismo modo, se incluyen las metáforas específicas manejadas en cada tira cómica y, cuando se da el caso, aquellas metáforas genéricas o universales a las que remite. La segunda sección del análisis presenta una comparativa entre ambos corpora basada en el análisis expuesto en la primera parte. Además, trata varios de los fenómenos lingüísticos a los que han recurrido frecuentemente los dibujantes ingleses y árabes. Estos fenómenos son principalmente la metonimia y la personificación. Igualmente, en esta sección la autora investiga en mayor profundidad las metáforas usadas por los dibujantes ingleses y los árabes, determinando si son ora conceptualmente específicas, ora culturalmente específicas, a partir del hecho de que las metáforas sirven como herramienta para reconocer la forma en que personas distintas, o bien culturas distintas, interpretan varias cuestiones. Por ejemplo, a la hora de conceptualizar el futuro, algunas culturas lo representan espacialmente como delante del hablante, mientras que otras se refieren al mismo como localizado detrás del sujeto (Lakoff y Johnson 1980: 14). Este trabajo ha permitido varios hallazgos. En cuanto a las metáforas empleadas para representar la Primavera Árabe, tanto las tiras inglesas como las árabes han recurrido a una cierta variedad de metáforas. Algunas de las tiras presentan más de una metáfora operando a la vez. Los dibujantes ingleses y árabes parecen haberse apoyado siempre en el modo pictórico para presentar el dominio fuente, así como en el modo verbal para mostrar el dominio meta. ! 4! Además, respecto a la naturaleza de las metáforas que figuran en sendos corpora, casi todas las metáforas son conceptuales en cuanto que se corresponden con nuestras experiencias corporales; no hay, por otro lado, ninguna metáfora culturalmente específica. Asimismo, la única diferencia a este respecto entre ambos corpora es una variación en lo que constituye el prototipo de una categoría particular – aquí concretamente la categoría “primavera” en cada una de las culturas –. En las tiras inglesas, una flor es empleada para representar la primavera, mientras que en las árabes el elemento natural más frecuente para simbolizar la primavera es un árbol.

A multimodal genre recognition prototype

In this paper, a multimodal and interactive prototype to perform music genre classification is presented. The system is oriented to multi-part files in symbolic format but it can be adapted using a transcription system to transform audio content in music scores. This prototype uses different sources of information to give a possible answer to the user. It has been developed to allow a human expert to interact with the system to improve its results. In its current implementation, it offers a limited range of interaction and multimodality. Further development aimed at full interactivity and multimodal interactions is discussed.

International conference paper presentations: A multimodal analysis to determine effectiveness

International conference presentations represent one of the biggest challenges for academics using English as a Lingua Franca (ELF). This paper aims to initiate exploration into the multimodal academic discourse of oral presentations, including the verbal, written, non-verbal material (NVM) and body language modes. It offers a Systemic Functional Linguistic (SFL) and multimodal framework of presentations to enhance mixed-disciplinary ELF academics' awareness of what needs to be taken into account to communicate effectively at conferences. The model is also used to establish evaluation criteria for the presenters' talks and to carry out a multimodal discourse analysis of four well-rated 20-min talks, two from the technical sciences and two from the social sciences in a workshop scenario. The findings from the analysis and interviews indicate that: (a) a greater awareness of the mode affordances and their combinations can lead to improved performances; (b) higher reliance on the visual modes can compensate for verbal deficiencies; and (c) effective speakers tend to use a variety of modes that often overlap but work together to convey specific meanings. However, firm conclusions cannot be drawn on the basis of workshop presentations, and further studies on the multimodal analysis of ‘real conferences’ within specific disciplines are encouraged.

The orchestration of modes and EFL audio-visual comprehension: A multimodal discourse analysis of vodcasts

This thesis explores the role of multimodality in language learners’ comprehension, and more specifically, the effects on students’ audio-visual comprehension when different orchestrations of modes appear in the visualization of vodcasts. Firstly, I describe the state of the art of its three main areas of concern, namely the evolution of meaning-making, Information and Communication Technology (ICT), and audio-visual comprehension. One of the most important contributions in the theoretical overview is the suggested integrative model of audio-visual comprehension, which attempts to explain how students process information received from different inputs. Secondly, I present a study based on the following research questions: ‘Which modes are orchestrated throughout the vodcasts?’, ‘Are there any multimodal ensembles that are more beneficial for students’ audio-visual comprehension?’, and ‘What are the students’ attitudes towards audio-visual (e.g., vodcasts) compared to traditional audio (e.g., audio tracks) comprehension activities?’. Along with these research questions, I have formulated two hypotheses: Audio-visual comprehension improves when there is a greater number of orchestrated modes, and students have a more positive attitude towards vodcasts than traditional audios when carrying out comprehension activities. The study includes a multimodal discourse analysis, audio-visual comprehension tests, and students’ questionnaires. The multimodal discourse analysis of two British Council’s language learning vodcasts, entitled English is GREAT and Camden Fashion, using ELAN as the multimodal annotation tool, shows that there are a variety of multimodal ensembles of two, three and four modes. The audio-visual comprehension tests were given to 40 Spanish students, learning English as a foreign language, after the visualization of vodcasts. These comprehension tests contain questions related to specific orchestrations of modes appearing in the vodcasts. The statistical analysis of the test results, using repeated-measures ANOVA, reveal that students obtain better audio-visual comprehension results when the multimodal ensembles are constituted by a greater number of orchestrated modes. Finally, the data compiled from the questionnaires, conclude that students have a more positive attitude towards vodcasts in comparison to traditional audio listenings. Results from the audio-visual comprehension tests and questionnaires prove the two hypotheses of this study.

The importance of promoting multimodal teaching in the foreign language classroom for the acquisition of social competences: practical examples

This article analyses the way in which the subject English Language V of the degree English Studies (English Language and Literature) combines the development of the five skills (listening, speaking, reading, writing and interacting) with the use of multimodal activities and resources in the teaching-learning process so that students increase their motivation and acquire different social competences that will be useful for the labour market such as communication, cooperation, leadership or conflict management. This study highlights the use of multimodal materials (texts, videos, etc.) on social topics to introduce cultural aspects in a language subject and to deepen into the different social competences university students can acquire when they work with them. The study was guided by the following research questions: how can multimodal texts and resources contribute to the development of the five skills in a foreign language classroom? What are the main social competences that students acquire when the teaching-learning process is multimodal? The results of a survey prepared at the end of the academic year 2015-2016 point out the main competences that university students develop thanks to multimodal teaching. For its framework of analysis, the study draws on the main principles of visual grammar (Kress & van Leeuwen, 2006) where students learn how to analyse the main aspects in multimodal texts. The analysis of the different multimodal activities described in the article and the survey reveal that multimodality is useful for developing critical thinking, for bringing cultural aspects into the classroom and for working on social competences. This article will explain the successes and challenges of using multimodal texts with social content so that students can acquire social competences while learning content. Moreover, the implications of using multimodal resources in a language classroom to develop multiliteracies will be observed.

Multimodal analysis of a sample of political posters in Ireland during and after the Celtic Tiger

The aim of this research paper is to analyse the key political posters made for the campaigns of Irish political party Fianna Fáil framed in the Celtic Tiger (1997-2008) and post-Celtic Tiger years (2009-2012). I will then focus on the four posters of the candidate in the elections that took place in 1997, 2002, 2007 and 2011 with the intention of observing first how the leader is represented, and later on pinpointing the similarities and possible differences between each. This is important in order to observe the main linguistic and visual strategies used to persuade the audience to vote that party and to highlight the power of the politician. Critical discourse analysis tools will be helpful to identify the main discursive strategies employed to persuade the Irish population to vote in a certain direction. Van Leeuwen’s (2008) social actor theory will facilitate the understanding of how participants are represented in the corpus under analysis. Finally, the main tools of Kress and van Leeuwen’s visual grammar (2006) will be applied for the analysis of the images. The study reveals that politicians are represented in a consistently positive way, with status and formal appearance so that people are persuaded to vote for the party they represent because they trust them as political leaders. The study, thus, points out that the poster is a powerful tool used in election campaigns to highlight the power of political parties.

A multimodal tablet-based interface for designing and reviewing 3D engineering models

The ability to view and interact with 3D models has been happening for a long time. However, vision-based 3D modeling has only seen limited success in applications, as it faces many technical challenges. Hand-held mobile devices have changed the way we interact with virtual reality environments. Their high mobility and technical features, such as inertial sensors, cameras and fast processors, are especially attractive for advancing the state of the art in virtual reality systems. Also, their ubiquity and fast Internet connection open a path to distributed and collaborative development. However, such path has not been fully explored in many domains. VR systems for real world engineering contexts are still difficult to use, especially when geographically dispersed engineering teams need to collaboratively visualize and review 3D CAD models. Another challenge is the ability to rendering these environments at the required interactive rates and with high fidelity. In this document it is presented a virtual reality system mobile for visualization, navigation and reviewing large scale 3D CAD models, held under the CEDAR (Collaborative Engineering Design and Review) project. It’s focused on interaction using different navigation modes. The system uses the mobile device's inertial sensors and camera to allow users to navigate through large scale models. IT professionals, architects, civil engineers and oil industry experts were involved in a qualitative assessment of the CEDAR system, in the form of direct user interaction with the prototypes and audio-recorded interviews about the prototypes. The lessons learned are valuable and are presented on this document. Subsequently it was prepared a quantitative study on the different navigation modes to analyze the best mode to use it in a given situation.

Investigation of brain function in neuropsychiatric disorder using multimodal imaging analysis

Otto-von-Guericke-Universität Magdeburg, Fakultät für Naturwissenschaften, Dissertation, 2016

Multimodal Imaging and Choroidal Volumetric Changes After Half-fluence PDT in Central Serous Chorioretinopathy.

PURPOSE The purpose of this study was to identify SD-OCT changes that correspond to leakage on fluorescein (FA) and indocyanine angiography (ICGA) and evaluate effect of half-fluence photodynamic therapy (PDT) on choroidal volume in chronic central serous choroidoretinopathy (CSC). METHODS Retrospective analysis of patients with chronic CSC who had undergone PDT. Baseline FA and ICGA images were overlaid on SD-OCT to identify OCT correlates of FA or ICGA hyperfluorescence. Choroidal volume was evaluated in a subgroup of eyes before and after PDT. RESULTS Twenty eyes were evaluated at baseline, of which seven eyes had choroidal volume evaluations at baseline and 3 months following PDT. SD-OCT changes corresponding to FA hyperfluorescence were subretinal fluid (73%), RPE microrip (50%), RPE double-layer sign (31%), RPE detachment (15%), and RPE thickening (8%). ICGA hyperfluoresence was correlated in 93% with hyperreflective spots in the superficial choroid. Choroidal volume decreased from 9.35 ± 1.99 to 8.52 ± 1.92 and 8.04 ± 1.7 mm(3) (at 1 and 3 months post PDT, respectively, p ≤ 0.001). CONCLUSIONS We identified specific OCT findings that correlate with FA and ICGA leakage sites. SD-OCT is a valuable tool to localize CSC lesions and may be useful to guide PDT treatment. Generalized choroidal volume decrease occurs following PDT and extends beyond PDT treatment site.

Responsive multimodal transportation management strategies and IVHS. Final report.

Federal Highway Administration, Office of Safety and Traffic Operations Research and Development, McLean, Va.

Nellie Landblom's copybook for beginners in research work; computational procedures used in applied biometrics.

Multigraphed.

Greenpeaces modelläsare : En multimodal textanalys av Greenpeace i Sveriges externa mejl

I denna uppsats undersöker jag vilka modelläsare som skapas i två olika sorters mejl från Greenpeace i Sverige till personer som engagerar sig i organisationens arbete. Jag gör en multimodal textanalys med utgångspunkt i dialogism och sociosemiotisk teori, och jag använder analysmetoder från den systemisk-funktionella grammatiken. Resultatet visar att de två mejltyperna i det stora hela är mycket lika varandra, men att det finns vissa skillnader och att de olika mejltyperna därigenom konstruerar delvis olika modelläsare som verkliga läsare måste förhålla sig till. Modelläsarna skapas genom realiseringar av olika språkliga och visuella betydelseskapande resurser som t.ex. presuppositioner, processer, distans och språk- och bildhandlingar. Det gemensamma för modelläsarna är att de sympatiserar med Greenpeace, har en aktiv aktörsroll och har en nära och jämlik relation till organisationen. 

Multimodal Transportation in Northeast Seattle: An Integrated Design

Thesis (Master's)--University of Washington, 2016-06

Multimodal affective interaction: a comment on musical origins

THE RIGORS OF ESTABLISHING INNATENESS and domain specificity pose challenges to adaptationist models of music evolution. In articulating a series of constraints, the authors of the target articles provide strategies for investigating the potential origins of music. We propose additional approaches for exploring theories based on exaptation. We discuss a view of music as a multimodal system of engaging with affect, enabled by capacities of symbolism and a theory of mind.