Doing new things with texts : multimodality and Mao’s Last Dancer

This paper describes a senior, multimodal task developed by Shauna O’Connor and the English staff at Brigidine College after consultation in the form of media workshops with Anita Jetnikoff. Gunther Kress (2006) suggested recently that due to the affordances of media platforms such as Web 2.0, “we need to be doing new things with texts”. The year 11 unit’s Finding a Voice parent text was the memoir, Mao’s last Dancer. The summative assessment task morphed over time from an ‘identity portrait’, into ‘a multimodal, first person narrative’.

Parsing the Australian curriculum English : grammar, multimodality and cross-cultural texts

The release of the Australian Curriculum English (ACE) by the Australian Curriculum, Assessment and Reporting Authority (ACARA) has revived debates about the role of grammar as English content knowledge. We consider some of the discussion circulating in the mainstream media vis-à-vis the intent of the ACE. We conclude that this curriculum draws upon the complementary tenets of traditional Latin-based grammar and systemic functional linguistics across the three strands of Language, Literature and Literacy in innovative ways. We argue that such an approach is necessary for working with contemporary multimodal and cross-cultural texts. To demonstrate the utility of this new approach, we draw out a set of learning outcomes from Year 6 and then map out a framework for relating the outcomes to the form and function of multimodal language. As a case in point, our analysis is of two online Coca-Cola advertising texts, one each from South Korea and Australia.

Multimodality, media, and access to multiliteracies

In many English-speaking countries bilingual and multilingual speakers of English are integrated into mainstream classrooms, where the teacher is expected to help them “catch up” with speakers of the dominant language. In this presentation, I argue that we teach in culturally and linguistically diverse societies that are increasingly interconnected through a broadened range of multimodal and digital textual practices. Intuitively, one might expect that multimodal approaches are more equitable than exclusively print-based approaches because learners can draw from a broader range of semiotic resources. Yet the potentials of using multiple modes and new digital media to provide greater access to multiliteracies cannot be assumed. I draw on a case study of a multilingual language learner, Paweni, a Thai immigrant, describing how she and her peers negotiated cultural and linguistic difference. These encounters occur during multiliteracies lessons involving both print and digital texts. I theorise a “dialectic of access” to explain the reciprocal interaction between the agency of learners, modes, and media. I apply Giddens’ structuration theory to take into account the social structures – domination, signification, and legitimation – that played an important role in this dialectic of access.

Narrative and multimodality in English language arts curricula : a tale of two nations

In this policy column within this special edition on "The Arts in Language Arts", we critique the current place of multimodality and narratives in research and curriculum policy. This is a vital issue of significance for literacy educators, researchers, and policy makers because the narrative texts that circulate in our everyday lives are multimodal, tied to the ever-broadening range of narratives forms in digital sites of display. Here, we critically evaluate the place of multimodality and narratives in the language arts or English curriculum policies of two nations, the USA and Australia. In particular, we highlight the silence on multimodality within the Common Core State Standards, USA, and the contrasting centrality of multimodality in the National Curriculum: English, Australia.

A case study of teaching English and multimodality with ICTs: Constraints and possibilities

Current Australian policies and curricular frameworks demand that teachers and students use technology creatively and meaningfully in classrooms to develop students into 21C technological citizens. English teachers and students also have to learn new metalanguage around visual grammar since multimodal tasks often combine creative with critical General Capabilities (GC) with that of the of ICTs and literacy in the Australian Curriculum: English (AC:E). Both teachers and learners come to these tasks with varying degrees of techno-literacy, skills and access to technologies. This paper reports on case-study research following a technology based collaborative professional development (PD) program between a university Lecturer facilitator and English Teachers in a secondary Catholic school. The study found that the possibilities for creative and critical engagement are rich, but there are real grounded constraints such as lack of time, impeding teachers’ ability to master and teach new technologies in classrooms. Furthermore, pedagogical approaches are affected by technical skill levels and school infrastructure concerns which can militate against effective use of ICTs in school settings. The research project was funded by the Brisbane Catholic Education Office and focused on how teachers can be supported in these endeavours in educational contexts as they prepare students of English to be creative global citizens who use technology creatively.

Re-envisioning literacy instruction with adolescents: multiliteracies, multimodality and new technologies

Engaging students' lifeworlds and the concerns of their communities in globalised, semiotic and information societies is imperative in New Times. As youth continue to exhibit their proficiency with new literacies emerging from Internet communication technologies (leTs), education-particularly curriculum and instruction-remains largely focused around monomodal, print-only literacy practices, often ignoring students' hybrid multiple voices. This paper reports on two curricular interruptions to the progressive reading and writing workshop that acknowledged adolescents' engagement with digital technologies and their new multimodalliteracy practices in a year eight public classroom within a small urban academy of technology.

Re-envisioning teacher education in the new media age: multiliteracies, multimodality and internet communication technologies

Multiliteracies pedagogy and research (New London Group, 1996) addresses the range of literacies needed by diverse students to effectively negotiate the increasing multimodality of texts, both inside and outside of schools. Yet, few university teachers understand how youth are able to express themselves, their experiences and lives, in new, empowering and perception-shifting ways as designers in the 21st century. Several theorists (Bruce, 2000; Lemke, 1998; Luke, 2000; Bolter, 1998; Glister, 1997) argue literacy education must be reconceptualised to recognize the importance of teaching and supporting multimedia literacy in a world where internet communication technologies (ICTs) incorporate all semiotic resources. Expression through multiple media and more recently hypermedia—is common to youth—but has often been demonized by historically logocentric approaches to teaching and assessment by privileging print, over all other forms of expression (Albright & Walsh, 2003; Lemke, 1998; McCloud, 1993). As digital media becomes more pervasive in a post-typographic world, tertiary education will need to engage with its representational resources for acquiring traditional school literacy and knowledge. This paper reports on initiatives in Multiliteracies instruction for both pre-service and in-service teachers to more adequately attend to the multisemiotic landscapes of students’ changing worlds in New Times (Hall, 1996).

Multimodality pedagogies : a multiliteracies approach

This paper draws on outcomes of a case study which explored changes in teachers' literacy pedagogies as a result of their participation in a purpose-driven teacher professional learning project. The teachers sought to develop classroom responses which were cognisant of multimodal shifts resulting from an increasingly digitised, networked communications environment. Recognising the powerful influence of the teacher on student outcomes, the study sought to investigate teacher learning as a means for influencing print-based literacy pedagogies to incorporate multimodality literacy practices. Four teachers engaged in participatory action research, researching their literacy pedagogies in light of the New London Group's multiliteracies theory (1996; 2000). Schemas derived from multiliteracies theory acted as stimuli for expanding teachers' multimodality pedagogies, consequently addressing disjunctures between multimodal and print-based literacies. Patterns in teachers' pedagogical choices are illustrated through the analytical use of the 'multimodal schema'.

Mechanisms for multimodality : taking fiction to another dimension

We present methods for automatically constructing representations of fiction books in a range of modalities: audibly, graphically and as 3D virtual environments. The correspondence between the sequential ordering of events against the order of events presented in the text is used to correctly resolve the dynamic interactions for each representation. Synthesised audio created from the fiction text is used to calibrate the base time-line against which the other forms of media are correctly aligned. The audio stream is based on speech synthesis using the text of the book, and is enhanced using distinct voices for the different characters in a book. Sound effects are included automatically. The graphical representation represents the text (as subtitles), identifies active characters and provides visual feedback of the content of the story. Dynamic virtual environments conform to the constraints implied by the story, and are used as a source of further visual content. These representations are all aligned to a common time-line, and combined using sequencing facilities to provide a multimodal version of the original text.

Locating the semiotic power of multimodality

This article reports research that attempts to characterize what is powerful about digital multimodal texts. Building from recent theoretical work on understanding the workings and implications of multimodal communication, the authors call for a continuing empirical investigation into the roles that digital multimodal texts play in real-world contexts, and they offer one example of how such investigations might be approached. Drawing on data from the practice of multimedia digital storytelling, specifically a piece titled “Lyfe-N-Rhyme,” created by Oakland, California, artist Randy Young (accessible at http://www.oaklanddusty.org/videos.php), the authors detail the method and results of a fine-grained multimodal analysis, revealing semiotic relationships between and among different, copresent modes. It is in these relationships, the authors argue, that the expressive power of multimodality resides.