A multimodalidade no livro didático de inglês como língua estrangeira: padrões de representação narrativa e de interação

O presente trabalho visa a contribuir com o avanço das pesquisas na área de multimodalidade, mais especificamente na área aplicada ao contexto de ensino de língua estrangeira. Analisa-se uma amostra de textos multimodais em um livro didático produzido e utilizado no Brasil como ferramenta para o ensino de inglês como língua estrangeira para alunos adultos iniciantes em um curso livre. Tendo em vista a preocupação, apontada no próprio material didático, em atender às necessidades e expectativas desses alunos, objetiva-se, através desta investigação: verificar como se dá a interação entre o verbal e o visual no livro didático selecionado; verificar como essa interação contribui para atingir os objetivos pedagógicos propostos pelo material; e, por fim, contribuir, de alguma maneira, para o letramento multimodal de alunos em língua estrangeira. Tais objetivos determinam a natureza híbrida desta pesquisa que, além da sua dimensão analítico-descritiva, apresenta também uma dimensão pedagógica, que visa a apresentar propostas de trabalho multimodal com algumas das atividades selecionadas para análise. A seleção dos textos multimodais para a composição do corpus desta pesquisa foi baseada na observação da recorrência de imagens com determinados personagens ao longo do livro. Tal recorrência provocou questionamentos que só poderiam ser respondidos a partir da análise desses personagens representados em situações de (inter)ação, o que deu lugar à seleção das representações narrativas que os incluíssem. Os personagens em questão são desenhos criados para os fins pedagógicos do material e são representados em situações sociais muito limitadas: a maior parte dessas representações parece formar uma sequência narrativa cuja interação acontece em uma festa; entre as outras representações, que não representam a referida festa como contexto, incluem-se interações no escritório, no restaurante, no parque e ao telefone. Uma análise da representação visual desses atores sociais revelou que, apesar da inclusão de uma negra entre os personagens, e a consequente suposta visão multicultural transmitida com essa inclusão, os participantes representam um grupo homogêneo, pertencentes ao mesmo segmento social, que só interagem entre eles mesmos em situações sociais limitadas, não sendo, portanto, representativos da diversidade étnica, social e cultural do Brasil, ou dos países em que o inglês é falado. Após a análise da representação dos atores sociais, analisam-se, com vistas a atingir os objetivos deste trabalho, os padrões de representação e de interação nos textos multimodais selecionados, segundo categorias do quadro da multimodalidade de van Leeuwen (1996). Verifica-se, a partir de tais análises, que o verbal e o visual nem sempre apresentam uma relação direta, e que, quando apresentam, tal relação não é explorada pelo material, tornando o visual um elemento meramente decorativo que, na maioria das vezes, em nada contribui para o desenvolvimento das unidades. Por essa razão, e por se tratar de uma pesquisa centrada no contexto pedagógico, propõem-se, ao final das análises, atividades de exploração de alguns dos textos multimodais analisados, visando à formação multimodal do aluno em língua estrangeira

A leitura crítica de textos multimodais nas aulas de inglês: uma proposta de letramento com base na linguística sistêmico-funcional

Segundo os PCN, o ensino de Inglês deve contribuir para a formação de indivíduos questionadores e autônomos, que sejam capazes de fazer uso da linguagem como prática social. Este trabalho tem como objetivo apresentar uma proposta para desenvolver o letramento crítico através da leitura (KLEIMAN, 1995; SOARES, 2006), de forma a atender essa necessidade. Para tanto, indico, nesta dissertação, formas de abordar textos multimodais didaticamente, através da Análise Crítica do Discurso (FAIRCLOUGH, 2003) usando os pressupostos teórico-metodológicos e as categorias analíticas oferecidas pela Linguística Sistêmico-Funcional. A relevância do estudo de textos com imagens na escola está na possibilidade de trazer para esse ambiente a discussão de como essas semioses expressam diferentes modos de acesso ao conhecimento. Além disso, apesar da existência de trabalhos dedicados à habilidade de leitura em Inglês (RAMOS, 2004; BAMBIRRA, 2007; VIAN JR., 2009) e, por outro lado, de pesquisas acerca da leitura de imagens e ensino (SARDELICH, 2006: OLIVEIRA, 2006), poucos são os trabalhos que contemplam a leitura crítica em língua estrangeira no que diz respeito à integração da linguagem verbal e visual para a produção de sentidos. Para investigar as escolhas linguísticas e imagéticas e sua relação, responsáveis pela mensagem a ser negociada com o leitor, foram estudados dezessete textos, separados em quatro grupos representando quatro gêneros textuais compostos pelo verbal e pelo visual: cinco artigos de revista, três resenhas, cinco tirinhas e quatro anúncios publicitários. Eles foram examinados separadamente através de algumas das seguintes categorias dentro das três metafunções: a ideacional, principalmente pela análise dos Processos (HALLIDAY & MATTHIESSEN, 2004; KRESS & VAN LEEUWEN, 2006) e da Representação dos Atores Sociais (VAN LEEUWEN, 1997 e 2008); a interpessoal, pela Valoração (MARTIN e WHITE, 2005) e as instâncias de Contato, Distância Social e Atitude no visual (KRESS & VAN LEEUWEN, 2006); a textual, somente na imagem, quanto à Saliência, ao Valor Informacional e à Moldura (KRESS & VAN LEEUWEN, 2006). A partir da descrição e discussão dos resultados das análises de cada gênero, proponho algumas atividades para exemplificar a aplicação da LSF em contexto escolar. A construção dos exercícios baseou-se principalmente no artigo de Ramos (2004) sobre a implementação de gêneros em sala de aula. Assim, o trabalho com os corpora se dividiu em três momentos, usando cada gênero de uma vez: 1) descrição do gênero em seu contexto situacional e considerações sobre o contexto cultural; 2) análise do corpus aplicando a LSF e 3) exemplificação de atividades a partir da análise. Os resultados indicam que verbal e visual tendem a se complementar nos gêneros estudados e os ferramentais teóricos utilizados se mostraram como um generoso ponto de partida para o desenvolvimento de atividades de leitura crítica

Disquietude: A Sonata-Form Inquiry Into Multiliteracies Practices in an EAL Classroom

This narrative case study describes an English as an Additional Language teacher’s struggle to understand her young adult learners’ apparent resistance toward multiliteracies pedagogical practices in a college setting. Multiliteracies Pedagogy (New London Group, 1996) advocates the use of digital media, and home languages and culture, to engage diverse youth in designing personally meaningful multimodal texts that can significantly impact learner identity, voice, and agency. This arts-based study uses an innovative sonata-style format to document the making of a class documentary, accompanied by teacher reflections on the video project in the form of poetry, journal excerpts, and classroom dialogue. The sonata form provides a unique methodology for teacher inquiry, allowing the teacher-researcher to explore the ways in which curriculum, pedagogy, and sociocultural influences intersect in the classroom. The study does not end with a clear resolution of the problem; instead, the process of inquiry leads to deeper understandings of what it means to teach in the complex worlds of diverse learners.

New media reading strategy

This dissertation addresses the need for a strategy that will help readers new to new media texts interpret such texts. While scholars in multimodal and new media theory posit rubrics that offer ways to understand how designers use the materialities and media found in overtly designed, new media texts (see, e.g,, Wysocki, 2004a), these strategies do not account for how readers have to make meaning from those texts. In this dissertation, I discuss how these theories, such as Lev Manovich’s (2001) five principles for determining the new media potential of texts and Gunther Kress and Theo van Leeuwen’s (2001) four strata of designing multimodal texts, are inadequate to the job of helping readers understand new media from a rhetorical perspective. I also explore how literary theory, specifically Wolfgang Iser’s (1978) description of acts of interpretation, can help audiences understand why readers are often unable to interpret the multiple, unexpected modes of communication used in new media texts. Rhetorical theory, explored in a discussion of Sonja Foss’s (2004) units of analysis, is helpful in bringing the reader into a situated context with a new media text, although these units of analysis, like Iser’s process, suggests that a reader has some prior experience interpreting a text-as-artifact. Because of this assumption of knowledge put forth by all of the theories explored within, I argue that none alone is useful to help readers engage with and interpret new media texts. However, I argue that a heuristic which combines elements from each of these theories, as well as additional ones, is more useful for readers who are new to interpreting the multiple modes of communication that are often used in unconventional ways in new media texts. I describe that heuristic in the final chapter and discuss how it can be useful to a range of texts besides those labelled new media.

La representación de las mujeres inmigrantes en una muestra de la prensa española: deconstruyendo la invisibilidad

Esta investigación tiene como objetivo principal estudiar la representación de las mujeres inmigrantes en una muestra de la prensa española. Para ello, se recopiló un corpus de noticias sobre mujeres inmigrantes desde febrero de 2012 hasta julio de 2014, lo que suma un total de dos años y medio, de los tres principales periódicos españoles: El País, El Mundo y ABC. El número total de noticias recopiladas es de 56. En este estudio se analizarán los principales temas que se tratan en las noticias seleccionadas y las principales características lingüísticas y visuales empleadas para hablar sobre las mujeres inmigrantes. El análisis crítico del discurso (ACD) se empleará en este trabajo por su interés en la dimensión social del discurso al estudiar la lengua unida a temas sociales y por permitir profundizar en la ideología. En este sentido, el ACD puede ayudar a desentrañar problemas relacionados con las desigualdades de género al observar el modo en que las mujeres inmigrantes aparecen representadas en los textos objeto de estudio. Además, se empleará el modelo de gramática visual propuesto por Kress y van Leeuwen (2006) con el fin de analizar las principales características de las fotografías. Los principales resultados obtenidos del estudio señalan que la representación de las mujeres inmigrantes en la prensa española es escasa y que cuando éstas aparecen como protagonistas de noticias suelen representarse como víctima y se las relaciona fundamentalmente con la prostitución.

Spatial literacies, design texts and emergent pedagogies in purposeful literacy curriculum

There has recently been an emphasis within literacy studies on both the spatial dimensions of social practices (Leander & Sheehy, 2004) and the importance of incorporating design and multiple modes of meaning-making into contemporary understandings of literacy (Cope & Kalantzis, 2000; New London Group, 1996). Kress (2003) in particular has outlined the potential implications of the cultural shift from the dominance of writing, based on a logic of time and sequence in time, to the dominance of the mode of the image, based on a logic of space. However, the widespread re-design of curriculum and pedagogy by classroom teachers to allow students to capitalise on the various affordances of different modes of meaning-making – including the spatial – remains in an emergent stage. We report on a project in which university researchers’ expertise in architecture, literacy and communications enabled two teachers in one school to expand the forms of literacy that primary school children engaged in. Starting from the school community’s concerns about an urban renewal project in their neighbourhood, we worked together to develop a curriculum of spatial literacies with real-world goals and outcomes.

"I’m making it different to the book” : transmediation in young children’s print and digital texts

Young children shift meanings across multiple modes long before they have mastered formal writing skills. In a digital age, children are socialised into a wide range of new digital media conventions in the home, at school, and in community-based settings. This article draws on longitudinal classroom research with a culturally diverse cohort of eight-year old children, to advance new understandings about children’s engagement in transmediation in the context of digital media creation. The author illuminates three key principles of transmediation using multimodal snapshots of storyboard images, digital movie frames, and online comics. Insights about transmediation are developed through dialogue with the children about their thought processes and intentions for their multimedia creations.

Doing new things with texts : multimodality and Mao’s Last Dancer

This paper describes a senior, multimodal task developed by Shauna O’Connor and the English staff at Brigidine College after consultation in the form of media workshops with Anita Jetnikoff. Gunther Kress (2006) suggested recently that due to the affordances of media platforms such as Web 2.0, “we need to be doing new things with texts”. The year 11 unit’s Finding a Voice parent text was the memoir, Mao’s last Dancer. The summative assessment task morphed over time from an ‘identity portrait’, into ‘a multimodal, first person narrative’.

Parsing the Australian curriculum English : grammar, multimodality and cross-cultural texts

The release of the Australian Curriculum English (ACE) by the Australian Curriculum, Assessment and Reporting Authority (ACARA) has revived debates about the role of grammar as English content knowledge. We consider some of the discussion circulating in the mainstream media vis-à-vis the intent of the ACE. We conclude that this curriculum draws upon the complementary tenets of traditional Latin-based grammar and systemic functional linguistics across the three strands of Language, Literature and Literacy in innovative ways. We argue that such an approach is necessary for working with contemporary multimodal and cross-cultural texts. To demonstrate the utility of this new approach, we draw out a set of learning outcomes from Year 6 and then map out a framework for relating the outcomes to the form and function of multimodal language. As a case in point, our analysis is of two online Coca-Cola advertising texts, one each from South Korea and Australia.

Writing the visible page : a multimodal approach to graphic devices in literary fiction

This practice-led project has two outcomes: a collection of short stories titled 'Corkscrew Section', and an exegesis. The short stories combine written narrative with visual elements such as images and typographic devices, while the exegesis analyses the function of these graphic devices within adult literary fiction. My creative writing explores a variety of genres and literary styles, but almost all of the stories are concerned with fusing verbal and visual modes of communication. The exegesis adopts the interpretive paradigm of multimodal stylistics, which aims to analyse graphic devices with the same level of detail as linguistic analysis. Within this framework, the exegesis compares and extends previous studies to develop a systematic method for analysing how the interactions between language, images and typography create meaning within multimodal literature.

Scaffolding multimodal literacies: Learning in and out of the classroom

This chapter presents data produced by a research project that looked at pedagogy for print and digital literacies in a high poverty, high diversity primary school. The student population included refugee, immigrant and Aboriginal and Torres Strait Islander young people. In an environment in which schools, such as the study site, are under pressure to narrow the curriculum to ‘the basics’, the project sought to support teachers as they worked to create a rich curriculum for all students. The chapter will focus on pedagogy in an after-school media club. The aim of the club, which ran weekly for several years, was to build students’ media literacy skills. The data suggest that established ways of scaffolding linguistic texts cannot be simply transferred to multimodal text production. The chapter will also address implications from the research outcomes for other teachers working with At Risk EAL students.

Interrogating policy contradictions in literacy reforms about persuasive texts

Objectives Our overarching objective is to demonstrate the political contradictions about about how persuasive texts should be taught in the middle years of schooling, analysing two contradictory Australian wide educational reforms. We consider the complexities of power and access to literacy for students in relation to these reforms about the privileged genre of persuasion. Our work is framed by our appreciation of literacy as a social justice issue, and the notion of students’ pedagogic rights (Bernstein, 2000). Specifically, we introduce and analyse the knowledge and skills about persuasive text sanctioned by the Australian high-stakes test, the National Assessment Program for Literacy and Numeracy (NAPLAN), for students in the middle years of schooling (ACARA, 2013). We compare this to the contemporary emphasis on multimodal persuasive texts sanctioned by the recently released Australian Curriculum English (ACARA, 2014). We conclude our analysis by identifying biases in the structure of particular knowledges and the inherent threats to democracy.

Walking and talking with living texts: Breathing life against static standardisation

Current educational reform, policy and public discourse emphasise standardisation of testing, curricula and professional practice, yet the landscape of literacy practices today is fluid, interactive, multimodal, ever-changing, adaptive and collaborative. How then can English and literacy educators negotiate these conflicting terrains? The nature of today’s literacy practices is reflected in a concept of living texts which refers to experienced events and encounters that offer meaning-making that is fluid, interactive and changing. Literacy learning possibilities with living texts are described and discussed by the authors who independently investigated the place of living texts across two distinctly different learning contexts: a young people’s community arts project and a co-taught multiliteracies project in a high school. In the community arts project, young people created living texts as guided walks of urban spaces that adapt and change to varying audiences. In the multiliteracies project, two parents and a teacher created interactive spaces through co-teaching and cogenerative dialoguing. These spaces generate living texts that yield a purposefully connected curriculum rich in community-relevant and culturally significant texts. These two studies are shared with a view of bringing living texts into literacy education to loosen rigidity in standardisation.

A proposal for teaching with authentic texts in order to develop social awareness in a language subject in tertiary education

The University of the 21st century has to establish links with society and prepare students for the demands of the working world. Therefore, this article is a contribution to the integral preparation of university students by proposing the use of authentic texts with social content in English lessons so that students acquire emotional and social competencies while still learning content. This article will explain how the choice of texts on global issues such as racism and gender helps students to develop skills such as social awareness and critical thinking to deepen their understanding of discrimination, injustice or gender differences in both oral and written activities. A proposal will be presented which involves using the inauguration speech from Mandela's presidency and texts with photographs of women so that students analyse them whilst utilising linguistic tools that allow them to explore a text's social dimension.

(Re)criando (mini)contos de terror: uma experiência de ensino de leitura e escrita de gênero multimodal

Given the multiplicity of languages and media present in contemporary texts, the work with digital genres characterizes itself as essential for teaching, reading and writing. Virtual media is already present in many dayly activities that require the use of language. This shows that the globalized world brings new demands of literacy and various reading practices. Given this perspective, we propose to work the multiliteracies present in the new texts from the enunciative discourse Bakhtinian assumptions. For this, we chose to be as the object of research / intervention, the horror flash fiction multimodal discursive genre, because it is a multissemiótico digital statement of virtual circulation. In this context, this study aimed to understand how the teaching of this kind can contribute to the development of knowledge related to reading and text production, required by multiliteracies, by performing a Didactic Sequence in the classroom, specifically for two classes of elementary school, 7th and 8th grades of public school. The research was based on Bakhtin's theory and the Circle (2009, 2011) on gender perspective in a dialogic and the proposed Dolz and Schneuwly (2004) for the text of teaching through sequences Teaching. We also use the precepts of multiliteracies focused on Rojo (2012, 2013). The methodology used was based on a qualitative approach. We consider the analysis of minicontos produced by students, it's own hibridism of multiliteracies, the discursive characteristics such as composition, style and subject content, in addition to relations dialogicity present in these statements. At the end of the study, we realized that our intervention contributed to the expansion of knowledge of the subjects involved related to reading and multimodal genre production.