Place for video games : a theoretical and pedagogical framework for multiliteracies learning in English studies

Students are now involved in a vastly different textual landscape than many English scholars, one that relies on the “reading” and interpretation of multiple channels of simultaneous information. As a response to these new kinds of literate practices, my dissertation adds to the growing body of research on multimodal literacies, narratology in new media, and rhetoric through an examination of the place of video games in English teaching and research. I describe in this dissertation a hybridized theoretical basis for incorporating video games in English classrooms. This framework for textual analysis includes elements from narrative theory in literary study, rhetorical theory, and literacy theory, and when combined to account for the multiple modalities and complexities of gaming, can provide new insights about those theories and practices across all kinds of media, whether in written texts, films, or video games. In creating this framework, I hope to encourage students to view texts from a meta-level perspective, encompassing textual construction, use, and interpretation. In order to foster meta-level learning in an English course, I use specific theoretical frameworks from the fields of literary studies, narratology, film theory, aural theory, reader-response criticism, game studies, and multiliteracies theory to analyze a particular video game: World of Goo. These theoretical frameworks inform pedagogical practices used in the classroom for textual analysis of multiple media. Examining a video game from these perspectives, I use analytical methods from each, including close reading, explication, textual analysis, and individual elements of multiliteracies theory and pedagogy. In undertaking an in-depth analysis of World of Goo, I demonstrate the possibilities for classroom instruction with a complex blend of theories and pedagogies in English courses. This blend of theories and practices is meant to foster literacy learning across media, helping students develop metaknowledge of their own literate practices in multiple modes. Finally, I outline a design for a multiliteracies course that would allow English scholars to use video games along with other texts to interrogate texts as systems of information. In doing so, students can hopefully view and transform systems in their own lives as audiences, citizens, and workers.

New media reading strategy

This dissertation addresses the need for a strategy that will help readers new to new media texts interpret such texts. While scholars in multimodal and new media theory posit rubrics that offer ways to understand how designers use the materialities and media found in overtly designed, new media texts (see, e.g,, Wysocki, 2004a), these strategies do not account for how readers have to make meaning from those texts. In this dissertation, I discuss how these theories, such as Lev Manovich’s (2001) five principles for determining the new media potential of texts and Gunther Kress and Theo van Leeuwen’s (2001) four strata of designing multimodal texts, are inadequate to the job of helping readers understand new media from a rhetorical perspective. I also explore how literary theory, specifically Wolfgang Iser’s (1978) description of acts of interpretation, can help audiences understand why readers are often unable to interpret the multiple, unexpected modes of communication used in new media texts. Rhetorical theory, explored in a discussion of Sonja Foss’s (2004) units of analysis, is helpful in bringing the reader into a situated context with a new media text, although these units of analysis, like Iser’s process, suggests that a reader has some prior experience interpreting a text-as-artifact. Because of this assumption of knowledge put forth by all of the theories explored within, I argue that none alone is useful to help readers engage with and interpret new media texts. However, I argue that a heuristic which combines elements from each of these theories, as well as additional ones, is more useful for readers who are new to interpreting the multiple modes of communication that are often used in unconventional ways in new media texts. I describe that heuristic in the final chapter and discuss how it can be useful to a range of texts besides those labelled new media.