Shrek meets Vygotsky : rethinking adolescents' multimodal literacy practices in schools

Recent research has emphasized the multimodal and digital nature of adolescent literacy practices. These practices cross multiple social spaces, particularly settings outside of schools. This article re-examines current research to yield three caveats that counter assumptions about the pervasiveness, relevance, and spontaneity of youths’ multimodal practices in the digital communications environment: 1. It is incorrect to assume that today’s adolescents are all “digital natives”; 2. Engaging adolescents in multimodal textual practices must involve more than conforming the curriculum to their interests and practices, extending students’ repertoire of skills and genres; and 3. While some new multimodal practices are taken up by adolescents with minimal instruction in informal contexts, greater emphasis should be placed on expert scaffolding of these literacies in school settings.

Valuing Indigenous heritage through multimodal literacy

The study on which this presentation is based focuses on the particular ways in which students’ counter-narratives about race were embedded in multimodal and digital design in the development of a digital cultural heritage. The multimodal texts were analysed as a site for students’ views of Indigenous oppression in relation to the colonial powers and ownership of the land in Australian history. In this presentation, Kathy will demonstrate how pedagogies that explore counter-narratives of cultural heritage in the official curriculum can encourage students to reframe their own racial identity, while challenging dominant white, historical narratives of colonial conquest, race, and power. In the second part of this session, Indigenous Principal, John Davis and teachers from HymbaYumba Community Hub will provide a school-based, Indigenous panel to inspire educators with authentic ways to embed Indigenous knowledge in the curriculum.

Multimodal Literacy as a form of Communication : What is the state of the students at Dalarna University multimodal literacy?

Literacy is an invaluable asset to have, and has allowed for communication, documentation and the spreading of ideas since the beginning of the written language. With technological advancements, and new possibilities to communicate, it is important to question the degree to which people’s abilities to utilise these new methods have developed in relation to these emerging technologies. The purpose of this bachelor’s thesis is to analyse the state of students’ at Dalarna University mulitimodal literacy, as well as their experience of multimodality in their education. This has led to the two main research questions: What is the state of the students at Dalarna University multimodal literacy? And: How have the students at Dalarna University experienced multimodality in education? The paper is based on a mixed-method study that incorporates both a quantitative and qualitative aspect to it. The main thrust of the research paper is, however, based on a quantitative study that was conducted online and emailed to students via their program coordinators. The scope of the research is in audio-visual modes, i.e. audio, video and images, while textual literacy is presumed and serves as an inspiration to the study. The purpose of the study is to analyse the state of the students’ multimodal literacy and their experience of multimodality in education. The study revealed that the students at Dalarna University have most skill in image editing, while not being very literate in audio or video editing. The students seem to have had mediocre experience creating meaning through multimodality both in private use and in their respective educational institutions. The study also reveals that students prefer learning by means of video (rather than text or audio), yet are not able to create meaning (communicate) through it.

Spatial literacies, design texts and emergent pedagogies in purposeful literacy curriculum

There has recently been an emphasis within literacy studies on both the spatial dimensions of social practices (Leander & Sheehy, 2004) and the importance of incorporating design and multiple modes of meaning-making into contemporary understandings of literacy (Cope & Kalantzis, 2000; New London Group, 1996). Kress (2003) in particular has outlined the potential implications of the cultural shift from the dominance of writing, based on a logic of time and sequence in time, to the dominance of the mode of the image, based on a logic of space. However, the widespread re-design of curriculum and pedagogy by classroom teachers to allow students to capitalise on the various affordances of different modes of meaning-making – including the spatial – remains in an emergent stage. We report on a project in which university researchers’ expertise in architecture, literacy and communications enabled two teachers in one school to expand the forms of literacy that primary school children engaged in. Starting from the school community’s concerns about an urban renewal project in their neighbourhood, we worked together to develop a curriculum of spatial literacies with real-world goals and outcomes.

Literacy and Digital Culture in the Early Years

In this chapter we present data drawn from observations of kindergarten children using iPads and talk with the children, their parents/guardians and teachers. We identify a continuum of practices that extends from ‘educational apps’ teaching handwriting, sight words and so forth to uses of the iPad as a device for multimodal literacy development and substantive conversation around children’s creative work. At the current time high stakes testing and the implementation of the Australian Curriculum are prompting new public and professional conversations about literacy and digital technology. The iPad is construed as both cause of and solution to problems of traditional literacy education. In this context we describe the literacies enabled by educational software available on iPads. We higlight the time constraints which bore on teachers' capacity to enact their visions of literacy education through the iPad platform and suggest ways of reflecting on responses to this constraint.

Indigenous ways with literacies: Transgenerational, multimodal, placed, and collective

This research describes some of the salient features of Indigenous ways of working with multimodal literacies in digital contexts of use that emerged within an Indigenous school community with the oversight of Aboriginal Elders. This is significant because the use of multimodal literacy practices among a growing number of Indigenous school community groups has not been an emphasis of multimodal literacy research to date. Furthermore, authentic examples of Indigenous multimodal texts are often difficult to locate within Euro-centric educational systems of postcolonial countries. The research was conducted over a full year with students from middle and upper primary (aged 8.5–12.5 years) in an Indigenous Independent school in South-East Queensland, Australia. The project applied participatory research methods in which the research agenda was negotiated with the cultural community. Indigenous ways of multimodal literacy practices emerged as transgenerational, multimodal, placed, and collective. The findings have implications for teachers and researchers to re-envisage Indigenous ways of multimodal literacy practices in the digital age.

Critically deconstructing race through a multimodal analysis of iPad Tellagami videos

Drawing on multimodal texts produced by an Indigenous school community in Australia, I apply critical race theory and multimodal analysis (Jewitt, 2011) to decolonise digital heritage practices for Indigenous students. This study focuses on the particular ways in which students’ counter-narratives about race were embedded in multimodal and digital design in the development of a digital cultural heritage (Giaccardi, 2012). Data analysis involved applying multimodal analysis to the students’ Gamis, following social semiotic categories and principles theorised by Kress and Bezemer (2008), and Jewitt (2006, 2011). This includes attending to the following semiotic elements: visual design, movement and gesture, gaze, and recorded speech, and their interrelationships. The analysis also draws on critical race theory to interpret the students’ representations of race. In particular, the multimodal texts were analysed as a site for students’ views of Indigenous oppression in relation to the colonial powers and ownership of the land in Australian history (Ladson-Billings, 2009). Pedagogies that explore counter-narratives of cultural heritage in the official curriculum can encourage students to reframe their own racial identity, while challenging dominant white, historical narratives of colonial conquest, race, and power (Gutierrez, 2008). The children’s multimodal “Gami” videos, created with the iPad application, Tellagami, enabled the students to imagine hybrid, digital social identities and perspectives of Australian history that were tied to their Indigenous cultural heritage (Kamberelis, 2001).

A multimodalidade no livro didático de inglês como língua estrangeira: padrões de representação narrativa e de interação

O presente trabalho visa a contribuir com o avanço das pesquisas na área de multimodalidade, mais especificamente na área aplicada ao contexto de ensino de língua estrangeira. Analisa-se uma amostra de textos multimodais em um livro didático produzido e utilizado no Brasil como ferramenta para o ensino de inglês como língua estrangeira para alunos adultos iniciantes em um curso livre. Tendo em vista a preocupação, apontada no próprio material didático, em atender às necessidades e expectativas desses alunos, objetiva-se, através desta investigação: verificar como se dá a interação entre o verbal e o visual no livro didático selecionado; verificar como essa interação contribui para atingir os objetivos pedagógicos propostos pelo material; e, por fim, contribuir, de alguma maneira, para o letramento multimodal de alunos em língua estrangeira. Tais objetivos determinam a natureza híbrida desta pesquisa que, além da sua dimensão analítico-descritiva, apresenta também uma dimensão pedagógica, que visa a apresentar propostas de trabalho multimodal com algumas das atividades selecionadas para análise. A seleção dos textos multimodais para a composição do corpus desta pesquisa foi baseada na observação da recorrência de imagens com determinados personagens ao longo do livro. Tal recorrência provocou questionamentos que só poderiam ser respondidos a partir da análise desses personagens representados em situações de (inter)ação, o que deu lugar à seleção das representações narrativas que os incluíssem. Os personagens em questão são desenhos criados para os fins pedagógicos do material e são representados em situações sociais muito limitadas: a maior parte dessas representações parece formar uma sequência narrativa cuja interação acontece em uma festa; entre as outras representações, que não representam a referida festa como contexto, incluem-se interações no escritório, no restaurante, no parque e ao telefone. Uma análise da representação visual desses atores sociais revelou que, apesar da inclusão de uma negra entre os personagens, e a consequente suposta visão multicultural transmitida com essa inclusão, os participantes representam um grupo homogêneo, pertencentes ao mesmo segmento social, que só interagem entre eles mesmos em situações sociais limitadas, não sendo, portanto, representativos da diversidade étnica, social e cultural do Brasil, ou dos países em que o inglês é falado. Após a análise da representação dos atores sociais, analisam-se, com vistas a atingir os objetivos deste trabalho, os padrões de representação e de interação nos textos multimodais selecionados, segundo categorias do quadro da multimodalidade de van Leeuwen (1996). Verifica-se, a partir de tais análises, que o verbal e o visual nem sempre apresentam uma relação direta, e que, quando apresentam, tal relação não é explorada pelo material, tornando o visual um elemento meramente decorativo que, na maioria das vezes, em nada contribui para o desenvolvimento das unidades. Por essa razão, e por se tratar de uma pesquisa centrada no contexto pedagógico, propõem-se, ao final das análises, atividades de exploração de alguns dos textos multimodais analisados, visando à formação multimodal do aluno em língua estrangeira

Literacy Theories for the Digital Age: Social, Critical, Multimodal, Spatial, Material and Sensory Lenses

Literacy Theories for the Digital Age insightfully brings together six essential approaches to literacy research and educational practice. The book provides powerful and accessible theories for readers, including Socio-cultural, Critical, Multimodal, Socio-spatial, Socio-material and Sensory Literacies. The brand new Sensory Literacies approach is an original and visionary contribution to the field, coupled with a provocative foreword from leading sensory anthropologist David Howes. This dynamic collection explores a legacy of literacy research while showing the relationships between each paradigm, highlighting their complementarity and distinctions. This highly relevant compendium will inspire readers to explore new frontiers of thought and practice in times of diversity and technological change.

Decolonizing digital heritage practices for Indigenous literacy: A multimodal analysis of iPad Tellagami videos

Purpose Drawing on multimodal texts produced by an Indigenous school community in Australia, we apply critical race theory and multimodal analysis to decolonize digital heritage practices for Indigenous students. This study focuses on the particular ways in which students’ counter-­‐narratives about race were embedded in multimodal and digital design in the development of a digital cultural heritage (Giaccardi, 2012). Pedagogies that explore counter-­‐narratives of cultural heritage in the official curriculum can encourage students to reframe their own racial identity, while challenging dominant white, historical narratives of colonial conquest, race, and power (Gutierrez, 2008). The children’s digital “Gami” videos, created with the iPad application, Tellagami, enabled the students to imagine hybrid, digital social identities and perspectives of Australian history that were tied to their Indigenous cultural heritage (Kamberelis, 2001).

Historical timelines : analyzing multimodal text design

The recent focus on literacy in Social Studies has been on linguistic design, particularly that related to the grammar of written and spoken text. When students are expected to produce complex hybridized genres such as timelines, a focus on the teaching and learning of linguistic design is necessary but not sufficient to complete the task. Theorizations of new literacies identify five interrelated meaning making designs for text deconstruction and reproduction: linguistic, spatial, visual, gestural, and audio design. Honing in on the complexity of timelines, this paper casts a lens on the linguistic, visual, spatial, and gestural designs of three pairs of primary school aged Social Studies learners. Drawing on a functional metalanguage, we analyze the linguistic, visual, spatial, and gestural designs of their work. We also offer suggestions of their effect, and from there consider the importance of explicit instruction in text design choices for this Social Studies task. We conclude the analysis by suggesting the foci of explicit instruction for future lessons.

“Now I know their secrets” : Kineikonic texts in the literacy classroom

Kineikonic texts – sites of the moving image – are increasingly prevalent with the rise of digital television, Web 2.0 tools, broadband Internet, and sophisticated mobile technologies. Digital practices are changing the shape of the literacy curriculum, calling for new metalanguages to describe digital and multimodal texts. This paper combines multiliteracies and functional approaches to map conventional and new textual features of a popular kineikonic text – the claymation movie. Enlivened with data from an ethnically diverse, Year 6 classroom, the author outlines filmic conventions to enable teachers and students to analyse and design movies

Reading in the Australian curriculum English : describing the effects of structure and organisation on multimodal texts

The recently introduced Australian Curriculum: English Version 3.0 (Australian Curriculum, Assessment and Reporting Authority [ACARA], 2012) requires students to ‘read’ multimodal text and describe the effects of structure and organisation. We begin this article by tracing the variable understandings of what reading multimodal text might entail through the Framing Paper (National Curriculum Board, 2008), the Framing Paper Consultation Report (National Curriculum Board, 2009a), the Shaping Paper (National Curriculum Board, 2009b) and Version 3.0 of the Australian Curriculum English (ACARA, 2012). Our findings show that the theoretical and descriptive framework for doing so is implicit. Drawing together multiple but internally coherent theories from the field of semiotics, we suggest one way to work towards three Year 5 learning outcomes from the reading/writing mode. The affordances of assembling a broad but explicit technical metalanguage for an informed reading of the integrated design elements of multimodal texts are noted.

School Leadership, Literacy and Social Justice : The Place of Local School Curriculum Planning and Reform

School reform is a matter of both redistributive social justice and recognitive social justice. Following Fraser (Justice interruptus: critical reflections on the “postsocialist” condition. Routledge, New York, 1997), we begin from a philosophical and political commitment to the more equitable redistribution of knowledge, credentials, competence, and capacity to children of low socioeconomic, cultural, and linguistic minority and Indigenous communities whose access, achievement, and participation historically have “lagged” behind system norms and benchmarks set by middle class and dominant culture communities. At the same time, we argue that the recognition of these students and their communities’ lifeworlds, knowledges, and experiences in the curriculum, in classroom teaching, and learning is both a means and an end: a means toward improved achievement measured conventionally and a goal for reform and alteration of mainstream curriculum knowledge and what is made to count in the school as valued cultural knowledge and practice. The work that we report here was based on an ongoing 4-year project where a team of university teacher educators/researchers have partnered with school leadership and staff to build relationships within community. The purpose has been to study whether and how engagement with new digital arts and multimodal literacies could have effects on students “conventional” print literacy achievement and, secondly, to study whether and how the overall performance of a school could be generated through a focus on professional conversations and partnerships in curriculum and instruction – rather than the top-down implementation of a predetermined pedagogical scheme, package, or approach.

Creativity is as important as literacy : making a film trailer responding to literature

The first part of the title is from Sir Ken Robinson (Robinson, 2009), the esteemed educator and champion of creativity in schools. Sometimes in the face of meeting the demands of time, timetabling, demanding administration tasks and teaching for high stakes testing accountability, we can find ourselves desperate for time to remember that English has always been one of the places in schools where creativity can flourish. English is a place for the play of the imagination. English teachers are the purveyors of narrative; the keepers and teachers of stories. The new Australian Curriculum: English, (Australian Curriculum and Assessment Reporting Authority (ACARA), 2012) asks us to be using ICT technologies in creative ways to tell those stories. The curriculum asks students to access texts receptively and to then speak about, write and create texts productively. There are so many interesting things to do with texts beyond word processing of print based resources. Responding to literature through media is always an alternative option to writing or simply speaking about it. In this paper my QUT pre-service student Chrystal Armitage describes how she made a mini story via a film trailer in response to a short story, ‘Turned’ (Gilman, 1987) in the unit, Literature in Secondary Teaching.