Clinton Multimodal (U. S. 30 Mississippi River Bridge) Study, 2003

The purpose of this memorandum is to document the benefit-cost analysis of the river crossing concept alternatives described in the "Concept Alternatives Technical Memo." Benefit-cost studies are designed to measure, in dollars, the potential positive or negative impacts of large-scale construction projects. The concept alternatives analyzed include improvements to the Union Pacific Railroad (UPRR) River Crossing and the U.S. Highway 30 (U.S. 30) River Crossing.

Dyslexi och inkludering : Förutsättningar för en god läs- och skrivundervisning

Litteraturstudiens syfte är att undersöka hur elever med dyslexi i årskurs F-3 kan inkluderas utifrån en klassrumsdimension i läs- och skrivundervisningen.  Med studien vill vi söka svar på hur lärare kan genomföra en inkluderad läs- och skrivundervisning samt hur den fördelaktigt kan se ut för elever med dyslexi. Litteraturstudien utgår från ett inkluderingsperspektiv som har begränsats till en klassrumsdimension på grund av begreppets bredd. Därför har vi valt att fokusera på hur inkludering diskuteras i förhållande till klassrumssituationen. Genom informationssökningen hittades 13 vetenskapliga litteraturer som berör studiens ämne och som använts i resultatet. För att välja litteratur med relevant information till studiens syfte och frågeställningar utgick vi från fyra olika aspekter för att sedan kunna presentera ett resultat. Studiens resultat visar att elever med dyslexi har svårigheter med automatiserad avkodning samt rättskrivning för att det finns en brist i deras fonologiska system. För att inkludera elever med dyslexi i läs- och skrivundervisningen krävs ett varierat arbetssätt med tillgång till extra stöd i klassrummet som exempelvis specialpedagoger kan ge. Elever med dyslexi ska inte ses som problembärare i undervisningen. Istället ska undervisningen anpassas så att varje elevs förutsättningar och behov tillgodoses vilket möjliggör för att alla elever kan få samma chans till utveckling. Sammanlagt visar resultatet att tidiga insatser bör sättas in för att elever med dyslexi ska ha chans att utvecklas. Undervisningen ska även individanpassas för att möjliggöra ett inkluderande arbetssätt. Med inkludering som utgångspunkt finns goda förutsättningar för att skapa en skola för alla vilket grundskolans läroplan fastslår att alla skolor i Sverige ska vara. 

La explotación de las artes en la promoción de la Marca Finlandia: análisis crítico del discurso multimodal

En este trabajo de fin de máster se investiga qué impacto tuvo la Marca Finlandia en el uso de las artes finlandesas en Focus – economía y tecnología, una revista publicada por el Ministerio de Asuntos Exteriores de Finlandia durante los años más profundos de la crisis económica 2008-2013. En 2008 el Ministro de Asuntos Exteriores de entonces, Alexander Stubb, designó una delegación para desarrollar la marca país de Finlandia, fruto de un proceso del que se presentó en 2010 un documento llamado Tehtävä Suomelle! (¡Misión para Finlandia!), cuyo objetivo fue concretar el diseño y las funciones de la Marca Finlandia. Este trabajo se enfoca en la utilización del arte y de artistas finlandeses en el material creado para apoyar la promoción de la imagen del país y, en última instancia, su competividad económica. Para tener en cuenta el contexto del material objeto de estudio, presentamos el concepto de la marca país y distintos planteamientos teóricos para su realización. Siendo una estrategia estatal polémica, recorremos los puntos de crítica más importantes sobre esta práctica promocional. También nos familiarizamos con la historia de la promoción nacional antes de introducir el presente proyecto, la Marca Finlandia, y sus objetivos. En la parte teórica se presentan los conceptos relevantes para el estudio: el discurso y su análisis crítico, enfatizando su capacidad ideológica para mantener y crear relaciones del poder muy a menudo desiguales. Ya que nuestro material de estudio empírico está compuesto de publicaciones físicas con dimensiones textuales, visuales y hápticas, nuestro método de investigación es observar críticamente estas relaciones desde la perspectiva multimodal. En la parte empírica del trabajo analizamos la composición de la comunicación multimodal del material imprimido, producido por el Ministerio de Asuntos Exteriores de Finlandia y sus socios de cooperación. Las revistas anuales Focus– Economía y tecnología se enfocan en noticias y artículos sobre los sectores de la economía y tecnología, pero también incluyen contenido sobre el diseño, la música, la moda, la arquitectura y la danza finlandeses. En nuestro análisis recorremos los campos verbales y visuales utilizados en las revistas para investigar de qué manera se presentaban las artes finlandesas en la operación de Marca Finlandia. Detectamos representaciones textuales, resaltaciones visuales y la combinación de ambos, lo que servía a las metas preterminadas y la imagen requerida por la delegación diseñadora de la marca país. Las revistas compartían el discurso en común que corría paralelo con los objetivos de la Marca Finlandia, que a su vez se puede ver como parte del discurso hegemónico neoliberal en general.

Interaction techniques with novel multimodal feedback for addressing gesture-sensing systems

Users need to be able to address in-air gesture systems, which means finding where to perform gestures and how to direct them towards the intended system. This is necessary for input to be sensed correctly and without unintentionally affecting other systems. This thesis investigates novel interaction techniques which allow users to address gesture systems properly, helping them find where and how to gesture. It also investigates audio, tactile and interactive light displays for multimodal gesture feedback; these can be used by gesture systems with limited output capabilities (like mobile phones and small household controls), allowing the interaction techniques to be used by a variety of device types. It investigates tactile and interactive light displays in greater detail, as these are not as well understood as audio displays. Experiments 1 and 2 explored tactile feedback for gesture systems, comparing an ultrasound haptic display to wearable tactile displays at different body locations and investigating feedback designs. These experiments found that tactile feedback improves the user experience of gesturing by reassuring users that their movements are being sensed. Experiment 3 investigated interactive light displays for gesture systems, finding this novel display type effective for giving feedback and presenting information. It also found that interactive light feedback is enhanced by audio and tactile feedback. These feedback modalities were then used alongside audio feedback in two interaction techniques for addressing gesture systems: sensor strength feedback and rhythmic gestures. Sensor strength feedback is multimodal feedback that tells users how well they can be sensed, encouraging them to find where to gesture through active exploration. Experiment 4 found that they can do this with 51mm accuracy, with combinations of audio and interactive light feedback leading to the best performance. Rhythmic gestures are continuously repeated gesture movements which can be used to direct input. Experiment 5 investigated the usability of this technique, finding that users can match rhythmic gestures well and with ease. Finally, these interaction techniques were combined, resulting in a new single interaction for addressing gesture systems. Using this interaction, users could direct their input with rhythmic gestures while using the sensor strength feedback to find a good location for addressing the system. Experiment 6 studied the effectiveness and usability of this technique, as well as the design space for combining the two types of feedback. It found that this interaction was successful, with users matching 99.9% of rhythmic gestures, with 80mm accuracy from target points. The findings show that gesture systems could successfully use this interaction technique to allow users to address them. Novel design recommendations for using rhythmic gestures and sensor strength feedback were created, informed by the experiment findings.

This Is a Gorgeous-looking Movie”: Multimodal Interplay between Commentary and Subject Materials in Movie Review Entertainment

The present thesis is a study of movie review entertainment (MRE) which is a contemporary Internet-based genre of texts. MRE are movie reviews in video form which are published online, usually as episodes of an MRE web show. Characteristic to MRE is combining humor and honest opinions in varying degrees as well as the use of subject materials, i.e. clips of the movies, as a part of the review. The study approached MRE from a linguistic perspective aiming to discover 1) whether MRE is primarily text- or image-based and what the primary functions of the modes are, 2) how a reviewer linguistically combines subject footage to her/his commentary?, 3) whether there is any internal variation in MRE regarding the aforementioned questions, and 4) how suitable the selected models and theories are in the analysis of this type of contemporary multimodal data. To answer the aforementioned questions, the multimodal system of image—text relations by Martinec and Salway (2005) in combination with categories of cohesion by Halliday and Hasan (1976) were applied to four full MRE videos which were transcribed in their entirety for the study. The primary data represent varying types of MRE: a current movie review, an analytic essay, a riff review, and a humorous essay. The results demonstrated that image vs. text prioritization can vary between reviews and also within a review. The current movie review and the two essays were primarily commentary-focused whereas the riff review was significantly more dependent on the use of imagery as the clips are a major source of humor which is a prominent value in that type of a review. In addition to humor, clips are used to exemplify the commentary. A reviewer also relates new information to the imagery as well as uses two modes to present the information in a review. Linguistically, the most frequent case was that the reviewer names participants and processes lexically in the commentary. Grammatical relations (reference items such as pronouns and adverbs and conjunctive items in the riff review) were also encountered. There was internal variation to a considerable degree. The methods chosen were deemed appropriate to answer the research questions. Further study could go beyond linguistics to include, for instance, genre and media studies.

El papel de la gestualidad en la estructuraci?n multimodal del discurso [recurso electr?nico]

Durante los ?ltimos a?os el an?lisis del discurso oral ha tomado un lugar importante en los estudios de la ling??stica y sobretodo en investigaciones enfocadas en el discurso en el aula. Su naturaleza en el habla permite obtener un gran abanico de elementos por analizar que marca la diferencia con el an?lisis del discurso escrito. Por otro lado, en la comunicaci?n oral el hablante est? pendiente de lo que dice con las palabras, pero no controla de la misma manera los gestos. Aspectos como la expresi?n del rostro, la orientaci?n corporal, la direcci?n de la mirada, etc., enfatizan lo que se quiere expresar en el discurso verbal. As?, los enunciados son bimodales ya que utilizan tanto la modalidad auditivo-vocal como la viso-gestual. Sin embargo, este estudio caracteriza este tipo de comunicaci?n on l t rm no ?mult mo l? o l o qu n l s urso or l l orpus que se analiza hay un canal extra de comunicaci?n como lo es el uso del tablero. Esta exploraci?n le da valor a los gestos en el ?mbito pedag?gico, pues el lenguaje no verbal puede reforzar o sustituir la expresi?n verbal y puede llegar a tener una gran injerencia en la construcci?n del sentido que los alumnos elaboran en torno a la comunicaci?n transmitida por el profesor. Teniendo en cuenta que la lecci?n es una unidad textual, esta investigaci?n busca observar y analizar c?mo los gestos contribuyen a la estructuraci?n del discurso en el aula, es decir, cu?l ser?a la marcaci?n multimodal de la estructura de la lecci?n. Se exploran dos temas centrales: el an?lisis del discurso en el aula y la gestualidad que acompa?a al habla. Para ello se utiliz? el modelo de an?lisis del discurso oral de Sinclair y Coulthard (1992) que tiene como elementos principales la lecci?n, las transacciones y los intercambios, y el modelo de an?lisis de gesticulaciones de McNeill (1998, 2005) que propone cinco dimensiones de gesticulaciones: gestos r?tmicos, gestos de?cticos, gestos ic?nicos, gestos metaf?ricos y gestos cohesivos.Se busc? determinar el papel de los gestos como marcadores o reforzadores de la estructura del discurso oral de una clase de Matem?ticas en ingl?s, dada por un docente nativo para quinto grado en un contexto educativo biling?e. Se hizo una grabaci?n de esa clase de 45 minutos, se procedi? a transcribirla en un formato de dos columnas: Profesor (con los enunciados del profesor) y Estudiantes (con las intervenciones de los estudiantes). Se observ? que el estudio del discurso oral en el aula se enriquece cuando se le a?aden elementos de an?lisis gestual en el mismo. Esta investigaci?n invita a indagar m?s sobre el papel de estos dos componentes de la interacci?n (discurso oral y gestualidad) tanto en el aula como en otras situaciones comunicativas

La imagen en el discurso multimodal cortazariano, una poética en movimiento

The selection and proposed cortazarian image in multimodal speech, a poetic moving as a doctoral thesis title, is the result of a process that forms several progressive stages. more than satisfy our curiosity and literary artistic concerns, the questions multiply increases our desire to bring more creative Cortazarian the colossus, that not only ruins a way of making literature , but in its revolutionary labyrinth gives a turn of the screw to the already tangled world of artistic writing , breaking in 1967 with the first of four hybrids books, La vuelta al día en ochenta mundos through which converts the traditional plastic unitextual and unimodal space in a palempsesto inexhaustible generator senses and meanings. Far from appeasing the wrath of conservative critics, caused by his narrative masterpiece, Hopscotch (1963), sparked the debate to denounce the regression of the classic molds of writing, proposing the imagination as the setting for creative freedom, it is not as arbitrary and nonsense, but as a process of higher state of consciousness in which it operates an underlying logic. Hence, our objective is to crawl into the underworld and plastics other multisígnicas border spaces, fleeting and ephemeral alliances that relate not just as complementary and similar texts which may be the same speech and can transmit the same, but quite the contrary, the oft-repeated notion of analogy is the first victim, fortunately, this kind of creative-artistic operations that raise the creative act to a sublime state capable of converting the inexhaustible multitextuales constellations in different ways: opposition, confrontation, invasion, dialogue, shadow, duplication, theft, etc. However this multiple transgression pushed to the limit by Julio Cortazar and his friend Julio Silva through four books proposed for analysis often does not translate into jobs and research in literature departments of the universities of the world, nor the critics are echoes the striking abundance and clarity of expression multimodal phenomenon as is the case with other works of Cortazar unimodal type, which makes it impassable fences mysterious worlds...

MULTIMODAL PERFORMANCE AND RELIABILITY ANALYSIS OF THE PIERRE AUGER OBSERVATORY NORTH SITE

The Pierre Auger Cosmic Ray Observatory North site employs a large array of surface detector stations (tanks) to detect the secondary particle showers generated by ultra-high energy cosmic rays. Due to the rare nature of ultra-high energy cosmic rays, it is important to have a high reliability on tank communications, ensuring no valuable data is lost. The Auger North site employs a peer-to-peer paradigm, the Wireless Architecture for Hard Real-Time Embedded Networks (WAHREN), designed specifically for highly reliable message delivery over fixed networks, under hard real-time deadlines. The WAHREN design included two retransmission protocols, Micro- and Macro- retransmission. To fully understand how each retransmission protocol increased the reliability of communications, this analysis evaluated the system without using either retransmission protocol (Case-0), both Micro- and Macro-retransmission individually (Micro and Macro), and Micro- and Macro-retransmission combined. This thesis used a multimodal modeling methodology to prove that a performance and reliability analysis of WAHREN was possible, and provided the results of the analysis. A multimodal approach was necessary because these processes were driven by different mathematical models. The results from this analysis can be used as a framework for making design decisions for the Auger North communication system.

A PHENOMENOLOGY OF MIMETIC LEARNING AND MULTIMODAL COGNITION: INTEGRATING EXPERIENTIAL KNOWLEDGE INTO PROGRAMS IN RHETORIC, COMPOSITION, AND TECHNICAL COMMUNICATION

My dissertation emphasizes a cognitive account of multimodality that explicitly integrates experiential knowledge work into the rhetorical pedagogy that informs so many composition and technical communication programs. In these disciplines, multimodality is widely conceived in terms of what Gunther Kress calls “socialsemiotic” modes of communication shaped primarily by culture. In the cognitive and neurolinguistic theories of Vittorio Gallese and George Lakoff, however, multimodality is described as a key characteristic of our bodies’ sensory-motor systems which link perception to action and action to meaning, grounding all communicative acts in knowledge shaped through body-engaged experience. I argue that this “situated” account of cognition – which closely approximates Maurice Merleau-Ponty’s phenomenology of perception, a major framework for my study – has pedagogical precedence in the mimetic pedagogy that informed ancient Sophistic rhetorical training, and I reveal that training’s multimodal dimensions through a phenomenological exegesis of the concept mimesis. Plato’s denigration of the mimetic tradition and his elevation of conceptual contemplation through reason, out of which developed the classic Cartesian separation of mind from body, resulted in a general degradation of experiential knowledge in Western education. But with the recent introduction into college classrooms of digital technologies and multimedia communication tools, renewed emphasis is being placed on the “hands-on” nature of inventive and productive praxis, necessitating a revision of methods of instruction and assessment that have traditionally privileged the acquisition of conceptual over experiential knowledge. The model of multimodality I construct from Merleau-Ponty’s phenomenology, ancient Sophistic rhetorical pedagogy, and current neuroscientific accounts of situated cognition insists on recognizing the significant role knowledges we acquire experientially play in our reading and writing, speaking and listening, discerning and designing practices.

Effects of modality, urgency and situation on responses to multimodal warnings for drivers

Signifying road-related events with warnings can be highly beneficial, especially when imminent attention is needed. This thesis describes how modality, urgency and situation can influence driver responses to multimodal displays used as warnings. These displays utilise all combinations of audio, visual and tactile modalities, reflecting different urgency levels. In this way, a new rich set of cues is designed, conveying information multimodally, to enhance reactions during driving, which is a highly visual task. The importance of the signified events to driving is reflected in the warnings, and safety-critical or non-critical situations are communicated through the cues. Novel warning designs are considered, using both abstract displays, with no semantic association to the signified event, and language-based ones, using speech. These two cue designs are compared, to discover their strengths and weaknesses as car alerts. The situations in which the new cues are delivered are varied, by simulating both critical and non-critical events and both manual and autonomous car scenarios. A novel set of guidelines for using multimodal driver displays is finally provided, considering the modalities utilised, the urgency signified, and the situation simulated.

Efeitos de um programa de exercício multimodal em pessoas idosas institucionalizadas

Objetivo: Investigar os efeitos de um programa de exercício multimodal sobre o funcionamento cognitivo e aptidão física funcional em pessoas idosas institucionalizadas. Método: Os participantes foram selecionados por conveniência entre os utentes de duas instituições de apoio a pessoas idosas. O grupo inicial foi constituído por um total de 21 pessoas de ambos os sexos (77-92 anos). Inicialmente, foi garantido um “período de controlo” de 4 semanas, em que os participantes mantiveram as suas atividades de vida quotidianas normais. Posteriormente, todos os idosos integraram um programa de exercício multimodal durante 8 semanas. Para estudar os efeitos da intervenção foram recolhidos dados em 3 momentos distintos: previamente ao período de controlo, após o período de controlo e no final do programa de intervenção. Foram efetuados testes físicos/motores, cognitivos e de dupla-tarefa (motor-cognitivo). Durante as sessões de exercício, alternaram-se períodos constituídos por tarefas motoras com períodos em que as tarefas motoras implicavam uma mobilização simultânea de recursos cognitivos. Resultados: A análise estatística dos dados recolhidos nos três momentos de avaliação, revelou efeitos positivos da intervenção ao nível da atenção, tempo de reação, força muscular, agilidade e capacidade cardiorrespiratória. Nos testes realizados em dupla-tarefa, foram encontradas melhorias no teste timed up and go, mas não se verificaram melhorias no teste de tempo de reação. A análise estatística dos dados recolhidos nos três momentos de avaliação, revelou efeitos positivos (p<0.05). da intervenção ao nível da atenção, tempo de reação, força muscular, agilidade e capacidade cardiorrespiratória. Nos testes realizados em dupla-tarefa, foram encontradas melhorias no teste timed up and go (p<0.05), mas não se verificaram melhorias no teste de tempo de reação. Conclusões: Um programa de exercícios multimodal induz melhorias no funcionamento cognitivo e motor de pessoas idosas institucionalizadas. É aconselhada a divulgação deste tipo de intervenção para pessoas idosas institucionalizadas; Effects of a Multimodal Exercise Program for Elderly Institutionalized Abstract: Objective: To investigate wthe effects of a multimodal exercise program on cognitive functioning and physical fitness of institutionalized elderly. Method: Participants were selected by convenience among two nursing home residents. Twenty-one people (77-92 years old) of both genders participated. During the first 4 weeks (control period), participants were not engaged in the exercise program and continue with their normal daily life activities. After the control period, the group was engaged in a multimodal exercise program for 8 weeks (2 times per week). To study the effects of a multimodal exercise program, data were collected at three different times: prior to the control period, after the control period, and at the end of the intervention. Several motor tests (physical fitness), cognitive tests and dual-tasks (motor-cognitive) were performed. The exercise sessions alternated between periods of motor taks and periods with motor plus cognitive tasks performed simultaneously. Results: The analysis of the data collected in the three moments of evaluation, show positive effects of the exercise program in cognitive dimensions (information processing speed and attention) and functional physical fitness components (muscle resistance, cardiorespiratory fitness and dynamic balance). In tests carried out in dual-task conditions, the exercise program promoted improvements in the timed up and go test (with mental calculations). Statistical analysis of the data collected at the three evaluation moments revealed positive effects (p <0.05). Of attention intervention, reaction time, muscle strength, agility and cardiorespiratory capacity. In the double-task tests, improvements were found in the timed up and go test (p <0.05), but there were no improvements in the reaction time test. Conclusions: The results of this study indicate that a multimodal exercise program can improve cognitive functioning and physical fitness in institutionalized older people. Thus, this type of intervention should be promoted among nursing home residents.

2D-3D Face Recognition Based on PCA and Feature Modelling

Hybrid face recognition, using image (2D) and structural (3D) information, has explored the fusion of Nearest Neighbour classifiers. This paper examines the effectiveness of feature modelling for each individual modality, 2D and 3D. Furthermore, it is demonstrated that the fusion of feature modelling techniques for the 2D and 3D modalities yields performance improvements over the individual classifiers. By fusing the feature modelling classifiers for each modality with equal weights the average Equal Error Rate improves from 12.60% for the 2D classifier and 12.10% for the 3D classifier to 7.38% for the Hybrid 2D+3D clasiffier.

here/there/then/now

here/there/then/now was a practice-led research project that brought together 10 independent artists in dance, music, theatre and visual/media arts to create a site-specific program within the walls of the Brisbane Powerhouse. The purpose was to explore how to best conceive flexible performance platforms, theatricalise site-specific work and engage new audiences through forms of promenade experience that could provide open choices on how and where to view it. The sold out season of 6 performances, which took place 14-19 May 2002, presented three discrete performance installations set in intimate parts of the building, each with their own aesthetic and communicative intention, culminating in a fourth in-theatre installation, where memories of the first three coalesced and were reinterrogated. Each site thereby investigated meaning-making via the moving body and its critical relationship with space and objects, in a dramatic re-contextualisation of traditional solo dance forms, now re-articulated through interdisciplinary practices. The benefit of this approach was the creation of a layered and multimodal experience that could be both shared and subsequently critiqued by performers and audience alike.