Historical timelines : analyzing multimodal text design

The recent focus on literacy in Social Studies has been on linguistic design, particularly that related to the grammar of written and spoken text. When students are expected to produce complex hybridized genres such as timelines, a focus on the teaching and learning of linguistic design is necessary but not sufficient to complete the task. Theorizations of new literacies identify five interrelated meaning making designs for text deconstruction and reproduction: linguistic, spatial, visual, gestural, and audio design. Honing in on the complexity of timelines, this paper casts a lens on the linguistic, visual, spatial, and gestural designs of three pairs of primary school aged Social Studies learners. Drawing on a functional metalanguage, we analyze the linguistic, visual, spatial, and gestural designs of their work. We also offer suggestions of their effect, and from there consider the importance of explicit instruction in text design choices for this Social Studies task. We conclude the analysis by suggesting the foci of explicit instruction for future lessons.

Doing new things with texts : multimodality and Mao’s Last Dancer

This paper describes a senior, multimodal task developed by Shauna O’Connor and the English staff at Brigidine College after consultation in the form of media workshops with Anita Jetnikoff. Gunther Kress (2006) suggested recently that due to the affordances of media platforms such as Web 2.0, “we need to be doing new things with texts”. The year 11 unit’s Finding a Voice parent text was the memoir, Mao’s last Dancer. The summative assessment task morphed over time from an ‘identity portrait’, into ‘a multimodal, first person narrative’.

Reading in the Australian curriculum English : describing the effects of structure and organisation on multimodal texts

The recently introduced Australian Curriculum: English Version 3.0 (Australian Curriculum, Assessment and Reporting Authority [ACARA], 2012) requires students to ‘read’ multimodal text and describe the effects of structure and organisation. We begin this article by tracing the variable understandings of what reading multimodal text might entail through the Framing Paper (National Curriculum Board, 2008), the Framing Paper Consultation Report (National Curriculum Board, 2009a), the Shaping Paper (National Curriculum Board, 2009b) and Version 3.0 of the Australian Curriculum English (ACARA, 2012). Our findings show that the theoretical and descriptive framework for doing so is implicit. Drawing together multiple but internally coherent theories from the field of semiotics, we suggest one way to work towards three Year 5 learning outcomes from the reading/writing mode. The affordances of assembling a broad but explicit technical metalanguage for an informed reading of the integrated design elements of multimodal texts are noted.

Reterritorializing multimodal design in the classroom through a socially mediated Indigenous heritage

National or International Significance Flows of cultural heritage in textual practices are vital to sustaining Indigenous communities - a national and international priority (Commonwealth of Australia, 2011). Indigenous heritage, whether passed on by oral tradition or ubiquitous social media, can be seen as a "conversation between the past and the future" (Fairclough, 2012, p. xv). Indigenous heritage involves appropriating memories within a cultural flow to pass on a spiritual legacy. This presentation reports ethnographic research of social media practices in a small independent Aboriginal school in Southeast Queensland, Australia that is resided over by the Yuggera elders and an Aboriginal principal. Quality of Research The purpose was to rupture existing notions of white literacies in schools, and to deterritorialize the uses of digital media by dominant cultures in the public sphere. Examples of learning experiences included the following: i. Integrating Indigenous language and knowledge into media text production; ii. Classroom visits from Indigenous elders; and iii. Publishing oral histories through digital scrapbooking. The program aligned with the Australian National Curriculum English (ACARA, 2014), which mandates the teaching of multimodal text creation. Data sources included a class set of digital scrapbooks collaboratively created in a preparatory-one primary classroom. The digital scrapbooks combined digitally encoded words, images of material artifacts, and digital music files. A key feature of the writing and digital design task was to retell and digitally display and archive a cultural narrative of significance to the Indigenous Australian community and its memories and material traces of the past for the future. Data analysis of the students' digital stories involved the application of key themes of negotiated, material, and digitally mediated forms of heritage practice. It drew on Australian Indigenous research by Keddie et al. (2013) to guard against the homogenizing of culture that can arise from a focus on a static view of culture. The interpretation of findings located Indigenous appropriation of social media within broader racialized politics that enables Indigenous literacy to be understood as a dynamic, negotiated, and transgenerational flows of practice. It demonstrates that Indigenous children's use of media production reflects "shifting and negotiated identities" in response to changing media environments that can function to sustain Indigenous cultural heritages (Appadurai, 1696, p. xv). Impact on practice, policy or theory The findings are important for teachers at a time when Aboriginal and Torres Strait Islander Histories and Cultures is a cross-curricular policy priority in the Australian Curriculum (ACARA, 2014). The findings show how curriculum policies can be applied to classroom practice in ways that are epistemologically consistent with Indigenous ways of knowing and being. Theoretically, it demonstrates how the children's experiences of culture are layered over time, as successive generations inherit, interweave, and hear others' cultural stories or maps. Practically, recommendations are provided for an approach to appropriating social media in schools that explicitly attends to the dynamic nature of Indigenous practices, negotiated through intercultural constructions and flows, and opening space for a critical anti-racist approach to multimodal text production. Timeliness The research is timely in the context of the accessibility and role of digital and multimodal forms of communication, including for Aboriginal and Torres Strait Islander communities.

Scaffolding multimodal literacies: Learning in and out of the classroom

This chapter presents data produced by a research project that looked at pedagogy for print and digital literacies in a high poverty, high diversity primary school. The student population included refugee, immigrant and Aboriginal and Torres Strait Islander young people. In an environment in which schools, such as the study site, are under pressure to narrow the curriculum to ‘the basics’, the project sought to support teachers as they worked to create a rich curriculum for all students. The chapter will focus on pedagogy in an after-school media club. The aim of the club, which ran weekly for several years, was to build students’ media literacy skills. The data suggest that established ways of scaffolding linguistic texts cannot be simply transferred to multimodal text production. The chapter will also address implications from the research outcomes for other teachers working with At Risk EAL students.

Standing brave in the face of rapid curriculum change : EAL/D teachers speak about critical literacy and its place in senior English teaching

Critical literacy (CL) has been the subject of much debate in the Australian public and education arenas since 2002. Recently, this debate has dissipated as literacy education agendas and attendant policies shift to embrace more hybrid models and approaches to the teaching of senior English. This paper/presentation reports on the views expressed by four teachers of senior English about critical literacy and it’s relevance to students who are from culturally and linguistically diverse backgrounds who are learning English while undertaking senior studies in high school. Teachers’ understandings of critical literacy are important, esp. given the emphasis on Critical and Creative Thinking and Literacy as two of the General Capabilities underpinning the Australian national curriculum. Using critical discourse analysis, data from four specialist ESL teachers in two different schools were analysed for the ways in which these teachers construct critical literacy. While all four teachers indicated significant commitment to critical literacy as an approach to English language teaching, the understandings they articulated varied from providing forms of access to powerful genres, to rationalist approaches to interrogating text, to a type of ‘critical-aesthetic’ analysis of text construction. Implications are also discussed.

Cultural flows in an Aboriginal school : deterritorializing textual production through a socially mediated Indigenous heritage

Flows of cultural heritage in textual practices are vital to sustaining Indigenous communities. Indigenous heritage, whether passed on by oral tradition or ubiquitous social media, can be seen as a “conversation between the past and the future” (Fairclough, 2012, xv). Indigenous heritage involves appropriating memories within a cultural flow to pass on a spiritual legacy. This presentation reports ethnographic research of social media practices in a small independent Aboriginal school in Southeast Queensland, Australia that is resided over by the Yugambeh elders and an Aboriginal principal. The purpose was to rupture existing notions of white literacies in schools, and to deterritorialize the uses of digital media by dominant cultures in the public sphere. Examples of learning experiences included the following: i. Integrating Indigenous language and knowledge into media text production; ii. Using conversations with Indigenous elders and material artifacts as an entry point for storytelling; iii. Dadirri – spiritual listening in the yarning circle to develop storytelling (Ungunmerr-Baumann, 2002); and iv. Writing and publicly sharing oral histories through digital scrapbooking shared via social media. The program aligned with the Australian National Curriculum English (ACARA, 2012), which mandates the teaching of multimodal text creation. Data sources included a class set of digital scrapbooks collaboratively created in a multi-age primary classroom. The digital scrapbooks combined digitally encoded words, images of material artifacts, and digital music files. A key feature of the writing and digital design task was to retell and digitally display and archive a cultural narrative of significance to the Indigenous Australian community and its memories and material traces of the past for the future. Data analysis of the students’ digital stories involved the application of key themes of negotiated, material, and digitally mediated forms of heritage practice. It drew on Australian Indigenous research by Keddie et al. (2013) to guard against the homogenizing of culture that can arise from a focus on a static view of culture. The interpretation of findings located Indigenous appropriation of social media within broader racialized politics that enables Indigenous literacy to be understood as a dynamic, negotiated, and transgenerational flows of practice. The findings demonstrate that Indigenous children’s use of media production reflects “shifting and negotiated identities” in response to changing media environments that can function to sustain Indigenous cultural heritages (Appadurai, 1696, xv). It demonstrated how the children’s experiences of culture are layered over time, as successive generations inherit, interweave, and hear others’ cultural stories or maps. It also demonstrated how the children’s production of narratives through multimedia can provide a platform for the flow and reconstruction of performative collective memories and “lived traces of a common past” (Giaccardi, 2012). It disrupts notions of cultural reductionism and racial incommensurability that fix and homogenize Indigenous practices within and against a dominant White norm. Recommendations are provided for an approach to appropriating social media in schools that explicitly attends to the dynamic nature of Indigenous practices, negotiated through intercultural constructions and flows, and opening space for a critical anti-racist approach to multimodal text production.

Multiliteracies pedagogy : creating claymations with adolescent, post-beginner English language learners

In addressing literacy in high school education, it is important to foreground the particular issues faced by growing numbers of English Language Learners (ELLs). In our increasingly culturally and linguistically diverse classrooms, this is a matter for all literacy teachers, as well as ELL specialists. In Australia, teachers of ELLs are experimenting with Multiliteracies pedagogy which provides rich opportunities to explore language learning experiences and outcomes that stretch beyond exercises in reproduction in written and oral modes only. This paper documents the practice of a high school teacher who uses a claymation project, producing a movie by stop-motion filming of clay figures, with a class of low-level English literacy learners. Drawing on observations of three particular students, the paper outlines a number of possibilities of this approach for English language learners. These include increased individual agency; enhanced engagement through collaboration; and the opportunity to explore various elements of multimodal text design.

Doing Digital Composition on the Social Web: Knowledge Processes in Literacy Learning

The power to influence others in ever-expanding social networks in the new knowledge economy is tied to capabilities with digital media production. This chapter draws on research in elementary classrooms to examine the repertoires of cross-disciplinary knowledge that literacy learners need to produce innovative digital media via the “social web”. It focuses on the knowledge processes that occurred when elementary students engaged in multimodal text production with new digital media. It draws on Kalantzis and Cope’s (2008) heuristic for theorizing “Knowledge Processes” in the Learning by Design approach to pedagogy. Learners demonstrate eight “Knowledge Processes” across different subject domains, skills areas, and sensibilities. Drawing data from media-based lessons across several classroom and schools, this chapter examines what kinds of knowledge students utilize when they produce digital, multimodal texts in the classroom. The Learning by Design framework is used as an analytic tool to theorize how students learn when they engaged in a specific domain of learning – digital media production.

Compreensão de manchetes sob a perspectiva da mesclagem e da metáfora conceptual

Nesta dissertação, investiga-se o processo de construção do significado de manchetes jornalísticas. Parte-se do pressuposto que a Metáfora Conceptual, proposta por Lakoff e Johnson (2002[1980]) e a Mesclagem, proposta por Fauconnier e Turner (2002), são as operações cognitivas complexas imbricadas no processo de compreensão e de construção de textos. A metáfora consiste em um importante recurso que estrutura o pensamento, as experiências e as ações humanas e a mesclagem, um mecanismo que permite significar eventos e experiências, aproximando realidades diversas, (des)comprimindo conhecimentos e rotinas cognitivas ativadas na conceptualização. Nesse sentido, este trabalho traz a lume a forma como o processo de construção de significado integra informações armazenadas em na mente, intercambiando domínios estáveis e ativando espaços mentais que se comungam para a culminância de estruturas emergentes. Para tanto, elucidamos as evidências de que metáforas e mesclagens podem explicar os sentidos produzidos pelas manchetes publicadas nos jornais Meia-Hora de Notícias, O Dia e O Globo. As manchetes foram coletadas no período de 18 de abril a 14 de setembro de 2011. Reunido o corpus, foi iniciado o cotejamento das manchetes à luz das referidas teorias. Realizou-se, em seguida, uma pesquisa com alunos do Ensino Médio de um colégio da rede pública estadual, a fim de confrontar as ponderações da análise com a compreensão empreendida pelos estudantes. Os resultados da análise e da mensuração das respostas dos alunos deram conta do papel da mesclagem na compreensão das manchetes analisadas, como um processo cognitivo, imaginativo e criativo, manifestado no uso da língua, de modo a promover a construção do significado. Foi possível também descrever o papel da metáfora nas mesclas postuladas para explicação do sentido das manchetes, na medida em que conceptualizações metafóricas fundamentam espaços mentais de algumas redes de integração postuladas para análise das manchetes

手持通信设备的多通道文本输入研究

Recently，Handheld Communication Devices is developing very fast, extending in users and spreading in application fields, and has an promising future. This study investigated the acceptance of the multimodal text entry method and the behavioral characteristics when using it. Based on the general information process model of a bimodal system and the human factor studies about the multimodal map system, the present study mainly focused on the hand-speech bimodal text entry method. For acceptance, the study investigated the subjective perception of the accuracy of speech recognition by Wizard of Oz (WOz) experiment and a questionnaire. Results showed that there was a linear relationship between the speech recognition accuracy and the subjective accuracy. Furthermore, as the familiarity increasing, the difference between the acceptable accuracy and the subjective accuracy gradually decreased. In addition, the similarity of meaning between the outcome of speech recognition and the correct sentences was an important referential criterion. The second study investigated three aspects of the bimodal text entry method, including input, error recovery and modal shifts. The first experiment aimed to find the behavioral characteristics of user when doing error recovery task. Results indicated that participants preferred to correct the error by handwriting, which had no relationship with the input modality. The second experiment aimed to discover the behavioral characteristics of users when doing text entry in various types of text. Results showed that users preferred to speech input in both words and sentences conditions, which was highly consistent among individuals, while no significant difference was found between handwriting and speech input in the character condition. Participants used more direct strategy than jumping strategy to deal with mixed text, especially for the Chinese-English mixed type. The third experiment examined the cognitive load in the different modal shifts, results suggesting that there were significant differences between different shifts. Moreover, relevant little time was needed in the Shift from speech input to hand input. Based on the main findings, implications were discussed as follows: Firstly, when evaluating a speech recognition system, attention should be paid to the fact that the speech recognition accuracy was not equal to the subjective accuracy. Secondly, in order to make a speech input system more acceptable, a good method is to train and supply the feedback for the accuracy in training, which improving the familiarity and sensitivity to the system. Thirdly, both the universal and individual behavioral patterns were taken into consideration to improve the error recovery method. Fourthly, easing the study and the use of speech input, the operations of speech input should be simpler. Fifthly, more convenient text input method for non-Chinese text entry should be provided. Finally, the shifting time between hand input and speech input provides an important parameter for the design of automatic-evoked speech recognition system.

Argument structures in Chinese university students’ argumentative writing: a contrastive study

Situated within a Systemic Functional Linguistics genre paradigm, this study adopted a function-based linguistic approach to examine the argument structures in English writing produced by Chinese university students of English as foreign language (EFL). Their English writing was contrasted with three other sets of argumentative essays in order to explore differences and similarities in the use of argument structures. The four sets of essays were produced by three groups of university students: native English- and Chinese-speaking university students and Chinese university EFL students. Participants’ interviews and questionnaire responses were also collected. The study found that most native English-speaking participants used an analytical arguing strategy, while most Chinese-speaking university participants preferred a hortatory argument structure both in their English and Chinese writing. It was also found that Chinese participants’ English writing was influenced by both English and Chinese.

Real english and english lite : what texts should we teach in the english classroom? (1) or English lite and thick lit : what is the debate about?

Why is it that Prime Minister John Howard wants to micro-manage English curricula? Why does how teachers teach English and Literature regularly make it to the front and editorial pages of the national dailies? The author attempts to critique that phenomenon, to explain her state of mind - that of being both alert and alarmed. The latest round of the debate began with Tony Thompson's article, 'English Lite is a tragedy for students', in 'The Age' on 12 September 2005. He was concerned that VCE English might be reduced to a single print text and he was alarmed about the watering-down of curriculum driven by 'postmodern notions'. The author is at odds with many of Thompson's views and discusses her stance on various aspects of his propositions. Issues examined include Thompson's argument that no multimodal text yields as much significance as a piece of genuine literature; that students are not being 'stretched' far enough; the false dichotomy between aesthetic/formalist manoeuvres on the one hand and postmodern ones on the other; how texts make meaning to students as consumers and the rationale for the use of pop culture texts to connect with students.

The interaction of discipline and culture in academic writing

Work in contrastive rhetoric has often sought to examine the impact of culturally-based writing conventions on text production and has outlined cultural differences in texts in different languages. At the same time. the study of specialised languages has often claimed a degree of uniformity in text construction both at the level of culture and at the level of the discipline. It appears however that approaches which consider just culture or just discipline miss part of the picture. This paper argues that considerations of discipline and culture are. complex and interrelated and that this complexity and interrelationship can be seen at several different levels in specialised academic texts.

Challenges of multimedia self-presentation : taking, and mistaking, the show on the road

One privilege enjoyed by new-media authors is the opportunity to realize representations of Self that are rich textual worlds in themselves and also to engage the wider world, with a voice, a smile, imagery, and sound. Still, closer investigation of multimedia composition practices reveals levels of complexity with which the verbal virtuoso is unconcerned. This article argues that while technology-afforded multimedia tools make it comparatively easy to author a vivid text, it is a multiplicatively more complicated matter to vividly realize and publicize an authorial intention. Based on analysis of the digital story creation process of a youth named “Steven,” the authors attempt to demonstrate the operation of two forces upon which the successful multimodal realization of the author's intention may hinge: “fixity” and “fluidity.” The authors show how, within the process of digital self-representation, these forces can intersect to influence multimodal meaning making, and an author's life, in consequential ways.