MULTIMODAL PERFORMANCE AND RELIABILITY ANALYSIS OF THE PIERRE AUGER OBSERVATORY NORTH SITE

The Pierre Auger Cosmic Ray Observatory North site employs a large array of surface detector stations (tanks) to detect the secondary particle showers generated by ultra-high energy cosmic rays. Due to the rare nature of ultra-high energy cosmic rays, it is important to have a high reliability on tank communications, ensuring no valuable data is lost. The Auger North site employs a peer-to-peer paradigm, the Wireless Architecture for Hard Real-Time Embedded Networks (WAHREN), designed specifically for highly reliable message delivery over fixed networks, under hard real-time deadlines. The WAHREN design included two retransmission protocols, Micro- and Macro- retransmission. To fully understand how each retransmission protocol increased the reliability of communications, this analysis evaluated the system without using either retransmission protocol (Case-0), both Micro- and Macro-retransmission individually (Micro and Macro), and Micro- and Macro-retransmission combined. This thesis used a multimodal modeling methodology to prove that a performance and reliability analysis of WAHREN was possible, and provided the results of the analysis. A multimodal approach was necessary because these processes were driven by different mathematical models. The results from this analysis can be used as a framework for making design decisions for the Auger North communication system.

A PHENOMENOLOGY OF MIMETIC LEARNING AND MULTIMODAL COGNITION: INTEGRATING EXPERIENTIAL KNOWLEDGE INTO PROGRAMS IN RHETORIC, COMPOSITION, AND TECHNICAL COMMUNICATION

My dissertation emphasizes a cognitive account of multimodality that explicitly integrates experiential knowledge work into the rhetorical pedagogy that informs so many composition and technical communication programs. In these disciplines, multimodality is widely conceived in terms of what Gunther Kress calls “socialsemiotic” modes of communication shaped primarily by culture. In the cognitive and neurolinguistic theories of Vittorio Gallese and George Lakoff, however, multimodality is described as a key characteristic of our bodies’ sensory-motor systems which link perception to action and action to meaning, grounding all communicative acts in knowledge shaped through body-engaged experience. I argue that this “situated” account of cognition – which closely approximates Maurice Merleau-Ponty’s phenomenology of perception, a major framework for my study – has pedagogical precedence in the mimetic pedagogy that informed ancient Sophistic rhetorical training, and I reveal that training’s multimodal dimensions through a phenomenological exegesis of the concept mimesis. Plato’s denigration of the mimetic tradition and his elevation of conceptual contemplation through reason, out of which developed the classic Cartesian separation of mind from body, resulted in a general degradation of experiential knowledge in Western education. But with the recent introduction into college classrooms of digital technologies and multimedia communication tools, renewed emphasis is being placed on the “hands-on” nature of inventive and productive praxis, necessitating a revision of methods of instruction and assessment that have traditionally privileged the acquisition of conceptual over experiential knowledge. The model of multimodality I construct from Merleau-Ponty’s phenomenology, ancient Sophistic rhetorical pedagogy, and current neuroscientific accounts of situated cognition insists on recognizing the significant role knowledges we acquire experientially play in our reading and writing, speaking and listening, discerning and designing practices.

"Army of One" to "Army Strong" : visual media and U.S. Army recruitment during Bush"s "War on Terror"

From Bush’s September 20, 2001 “War on Terror” speech to Congress to President-Elect Barack Obama’s acceptance speech on November 4, 2008, the U.S. Army produced visual recruitment material that addressed the concerns of falling enlistment numbers—due to the prolonged and difficult war in Iraq—with quickly-evolving and compelling rhetorical appeals: from the introduction of an “Army of One” (2001) to “Army Strong” (2006); from messages focused on education and individual identity to high-energy adventure and simulated combat scenarios, distributed through everything from printed posters and music videos to first-person tactical-shooter video games. These highly polished, professional visual appeals introduced to the American public during a time of an unpopular war fought by volunteers provide rich subject matter for research and analysis. This dissertation takes a multidisciplinary approach to the visual media utilized as part of the Army’s recruitment efforts during the War on Terror, focusing on American myths—as defined by Barthes—and how these myths are both revealed and reinforced through design across media platforms. Placing each selection in its historical context, this dissertation analyzes how printed materials changed as the War on Terror continued. It examines the television ad that introduced “Army Strong” to the American public, considering how the combination of moving image, text, and music structure the message and the way we receive it. This dissertation also analyzes the video game America’s Army, focusing on how the interaction of the human player and the computer-generated player combine to enhance the persuasive qualities of the recruitment message. Each chapter discusses how the design of the particular medium facilitates engagement/interactivity of the viewer. The conclusion considers what recruitment material produced during this time period suggests about the persuasive strategies of different media and how they create distinct relationships with their spectators. It also addresses how theoretical frameworks and critical concepts used by a variety of disciplines can be combined to analyze recruitment media utilizing a Selber inspired three literacy framework (functional, critical, rhetorical) and how this framework can contribute to the multimodal classroom by allowing instructors and students to do a comparative analysis of multiple forms of visual media with similar content.

Place for video games : a theoretical and pedagogical framework for multiliteracies learning in English studies

Students are now involved in a vastly different textual landscape than many English scholars, one that relies on the “reading” and interpretation of multiple channels of simultaneous information. As a response to these new kinds of literate practices, my dissertation adds to the growing body of research on multimodal literacies, narratology in new media, and rhetoric through an examination of the place of video games in English teaching and research. I describe in this dissertation a hybridized theoretical basis for incorporating video games in English classrooms. This framework for textual analysis includes elements from narrative theory in literary study, rhetorical theory, and literacy theory, and when combined to account for the multiple modalities and complexities of gaming, can provide new insights about those theories and practices across all kinds of media, whether in written texts, films, or video games. In creating this framework, I hope to encourage students to view texts from a meta-level perspective, encompassing textual construction, use, and interpretation. In order to foster meta-level learning in an English course, I use specific theoretical frameworks from the fields of literary studies, narratology, film theory, aural theory, reader-response criticism, game studies, and multiliteracies theory to analyze a particular video game: World of Goo. These theoretical frameworks inform pedagogical practices used in the classroom for textual analysis of multiple media. Examining a video game from these perspectives, I use analytical methods from each, including close reading, explication, textual analysis, and individual elements of multiliteracies theory and pedagogy. In undertaking an in-depth analysis of World of Goo, I demonstrate the possibilities for classroom instruction with a complex blend of theories and pedagogies in English courses. This blend of theories and practices is meant to foster literacy learning across media, helping students develop metaknowledge of their own literate practices in multiple modes. Finally, I outline a design for a multiliteracies course that would allow English scholars to use video games along with other texts to interrogate texts as systems of information. In doing so, students can hopefully view and transform systems in their own lives as audiences, citizens, and workers.

New media reading strategy

This dissertation addresses the need for a strategy that will help readers new to new media texts interpret such texts. While scholars in multimodal and new media theory posit rubrics that offer ways to understand how designers use the materialities and media found in overtly designed, new media texts (see, e.g,, Wysocki, 2004a), these strategies do not account for how readers have to make meaning from those texts. In this dissertation, I discuss how these theories, such as Lev Manovich’s (2001) five principles for determining the new media potential of texts and Gunther Kress and Theo van Leeuwen’s (2001) four strata of designing multimodal texts, are inadequate to the job of helping readers understand new media from a rhetorical perspective. I also explore how literary theory, specifically Wolfgang Iser’s (1978) description of acts of interpretation, can help audiences understand why readers are often unable to interpret the multiple, unexpected modes of communication used in new media texts. Rhetorical theory, explored in a discussion of Sonja Foss’s (2004) units of analysis, is helpful in bringing the reader into a situated context with a new media text, although these units of analysis, like Iser’s process, suggests that a reader has some prior experience interpreting a text-as-artifact. Because of this assumption of knowledge put forth by all of the theories explored within, I argue that none alone is useful to help readers engage with and interpret new media texts. However, I argue that a heuristic which combines elements from each of these theories, as well as additional ones, is more useful for readers who are new to interpreting the multiple modes of communication that are often used in unconventional ways in new media texts. I describe that heuristic in the final chapter and discuss how it can be useful to a range of texts besides those labelled new media.

ENVISIONING QUEER THROUGH DIGITAL MEDIA: DEVELOPING A COMMUNITY-BASED WORKSHOP IN MEDIA ANALYSIS FOR LGBTQIA+ YOUTH

This project consists of a proposed curriculum for a semester-long, community-based workshop for LGBTQIA+ (lesbian, gay, bisexual, trans*, queer or questioning, intersex, asexual or ally, "+" indicating other identifications that deviate from heterosexual) youth ages 16-18. The workshop focuses on an exploration of LGBTQIA+ identity and community through discussion and collaborative rhetorical analysis of visual and social media. Informed by queer theory and history, studies on youth work, and visual media studies and incorporating rhetorical criticism as well as liberatory pedagogy and community literacy practices, the participation-based design of the workshop seeks to involve participants in selection of media texts, active analytical viewership, and multimodal response. The workshop is designed to engage participants in reflection on questions of individual and collective responsibility and agency as members and allies of various communities. The goal of the workshop is to strengthen participants' abilities to analyze the complex ways in which television, film, and social media influence their own and others’ perceptions of issues surrounding queer identities. As part of the reflective process, participants are challenged to consider how they can in turn actively and collaboratively respond to and potentially help to shape these perceptions. My project report details the theoretical framework, pedagogical rationale, methods of text selection and critical analysis, and guidelines for conduct that inform and structure the workshop.