High-Level Modeling of Multimodal Interaction Techniques Using NiMMiT

The past few years, multimodal interaction has been gaining importance in virtual environments. Although multimodality renders interacting with an environment more natural and intuitive, the development cycle of such an application is often long and expensive. In our overall field of research, we investigate how modelbased design can facilitate the development process by designing environments through the use of highlevel diagrams. In this scope, we present ‘NiMMiT’, a graphical notation for expressing and evaluating multimodal user interaction; we elaborate on the NiMMiT primitives and demonstrate its use by means of a comprehensive example.

The Concept of Developmental-Tasks and its Significance for Education and Social Work

The term "developmental-task" was introduced by Robert Havighurst in the 1950's. According to R. Harvighurst, the term refers to tasks which arise in a social context during an individual lifetime. Since the 1950's the concept of developmental-tasks has become an important theoretical approach in educational science and in theories of growth and development - but not in social work and social pedagogy. In the following article I aim to show that this approach is very important to theory and practice of social pedagogy and social work.

ProFormA: An XML-based exchange format for programming tasks

Unterstützungssysteme für die Programmierausbildung sind weit verbreitet, doch gängige Standards für den Austausch von allgemeinen (Lern-) Inhalten und Tests erfüllen nicht die speziellen Anforderungen von Programmieraufgaben wie z. B. den Umgang mit komplexen Einreichungen aus mehreren Dateien oder die Kombination verschiedener (automatischer) Bewertungsverfahren. Dadurch können Aufgaben nicht zwischen Systemen ausgetauscht werden, was aufgrund des hohen Aufwands für die Entwicklung guter Aufgaben jedoch wünschenswert wäre. In diesem Beitrag wird ein erweiterbares XML-basiertes Format zum Austausch von Programmieraufgaben vorgestellt, das bereits von mehreren Systemen prototypisch genutzt wird. Die Spezifikation des Austauschformats ist online verfügbar [PFMA].

Learning in Virtual Worlds: Research and Applications

Three-dimensional (3D) immersive virtual worlds have been touted as being capable of facilitating highly interactive, engaging, multimodal learning experiences. Much of the evidence gathered to support these claims has been anecdotal but the potential that these environments hold to solve traditional problems in online and technology-mediated education—primarily learner isolation and student disengagement—has resulted in considerable investments in virtual world platforms like Second Life, OpenSimulator, and Open Wonderland by both professors and institutions. To justify this ongoing and sustained investment, institutions and proponents of simulated learning environments must assemble a robust body of evidence that illustrates the most effective use of this powerful learning tool. In this authoritative collection, a team of international experts outline the emerging trends and developments in the use of 3D virtual worlds for teaching and learning. They explore aspects of learner interaction with virtual worlds, such as user wayfinding in Second Life, communication modes and perceived presence, and accessibility issues for elderly or disabled learners. They also examine advanced technologies that hold potential for the enhancement of learner immersion and discuss best practices in the design and implementation of virtual world-based learning interventions and tasks. By evaluating and documenting different methods, approaches, and strategies, the contributors to Learning in Virtual Worlds offer important information and insight to both scholars and practitioners in the field. AU Press is an open access publisher and the book is available for free in PDF format as well as for purchase on our website: http://bit.ly/1W4yTRA

Learning software-maintenance tasks in offshoring projects: a cognitive-load perspective

Individual learning is central to the success of the transition phase in software mainte-nance offshoring projects. However, little is known on how learning activities, such as on-the-job training and formal presentations, are effectively combined during the tran-sition phase. In this study, we present and test propositions derived from cognitive load theory. The results of a multiple-case study suggest that learning effectiveness was highest when learning tasks such as authentic maintenance requests were used. Con-sistent with cognitive load theory, learning tasks were most effective when they imposed moderate cognitive load. Our data indicate that cognitive load was influenced by the expertise of the onsite coordinator, by intrinsic task complexity, by the degree of specifi-cation of tasks, and by supportive information. Cultural and semantic distances may in-fluence learning by inhibiting supportive information, specification, and the assignment of learning tasks.

Event-related potential P300 microstate topography during visual one- and two-dimensional tasks in chronic schizophrenics

Reports on left-lateralized abnormalities of component P300 of event-related brain potentials (ERP) in schizophrenics typically did not vary task difficulties. We collected 16-channel ERP in 13 chronic, medicated schizophrenics (25±4.9 years) and 13 matched controls in a visual P300 paradigm with targets defined by one or two stimulus dimensions (C1: color; C2: color and tilt); subjects key-pressed to targets. The mean target-ERP map landscapes were assessed numerically by the locations of the positive and negative map-area centroids. The centroids' time-space trajectories were searched for the P300 microstate landscape defined by the positive centroid posterior of the negative centroid. At P300 microstate centre latencies in C1, patients' maps tended to a right shift of the positive centroid (p<0.10); in C2 the anterior centroid was more posterior (p<0.07) and the posterior (positive) centroid more anterior (p<0.03), but without leftright difference. Duration of P300 microstate in C2 was shorter in patients (232 vs 347 ms;p<0.03) and the latency of maximal strength of P300 microstate increased significantly in patients (C1: 459 vs 376 ms; C2: 585 vs 525 ms). In summary only the one-dimensional task C1 supported left-sided abnormalities; the two-dimensional task C2 produced abnormal P300 microstate map landscapes in schizophrenics, but no abnormal lateralization. Thus, information processing involved clearly aberrant neural populations in schizophrenics, different when processing one and two stimulus dimensions. The lack of lateralization in the two-dimensional task supported the view that left-temporal abnormality in schizophrenics is only one of several task-dependent aberrations.

Learning Software-Maintenance Tasks in the Transition Phase of Offshore Outsourcing Projects: Two Learning-Theoretical Perspectives

The increasing practice of offshore outsourcing software maintenance has posed the challenge of effectively transferring knowledge to individual software engineers of the vendor. In this theoretical paper, we discuss the implications of two learning theories, the model of work-based learning (MWBL) and cognitive load theory (CLT), for knowledge transfer during the transition phase. Taken together, the theories suggest that learning mechanisms need to be aligned with the type of knowledge (tacit versus explicit), task characteristics (complexity and recurrence), and the recipients’ expertise. The MWBL proposes that learning mechanisms need to include conceptual and practical activities based on the relative importance of explicit and tacit knowledge. CLT explains how effective portfolios of learning mechanisms change over time. While jobshadowing, completion tasks, and supportive information may prevail at the outset of transition, they may be replaced by the work on conventional tasks towards the end of transition.

Deleterious effects of roving on learned tasks

In typical perceptual learning experiments, one stimulus type (e.g., a bisection stimulus offset either to the left or right) is presented per trial. In roving, two different stimulus types (e.g., a 30′ and a 20′ wide bisection stimulus) are randomly interleaved from trial to trial. Roving can impair both perceptual learning and task sensitivity. Here, we investigate the relationship between the two. Using a bisection task, we found no effect of roving before training. We next trained subjects and they improved. A roving condition applied after training impaired sensitivity.

Illegitimate tasks associated with higher cortisol levels among male employees when subjective health is relatively low: an intra-individual analysis

Objectives Illegitimate tasks refer to tasks that do not conform to what can appropriately be expected from an employee. Violating role expectations, they constitute “identity-stressors”, as one’s professional role tends to become part of one’s identity. The current study investigated the impact of illegitimate tasks on salivary cortisol. We analyzed data on an intra-individual level, that is, by examining fluctuations in illegitimate tasks and cortisol within individuals. Furthermore, we investigated the moderating role of perceived health, expecting that illegitimate tasks evoke stronger reactions when perceived health is relatively poor. Methods Illegitimate tasks, salivary cortisol, and perceived health were assessed in each of three waves (time lag: 6 months) in a sample of 104 male employees. Data were analyzed by multilevel analysis using group mean centering. Results Controlling for social stressors, work interruptions, and emotional stability, the experience of more illegitimate tasks was associated with increased cortisol release if personal health resources were low compared to one’s mean value of perceived health. Results cannot be explained by inter-individual differences. Conclusions This is the first study showing that illegitimate tasks predict a biological indicator of stress, thus confirming and extending previous research on illegitimate tasks. The moderating role of perceived health confirms its importance as a personal resource, implying augmented vulnerability when perceived health is below its usual value. It is plausible to assume that increased stress reactions due to relatively poor health may further weaken available personal resources. Both avoiding illegitimate tasks and restoring personal health seem to be crucial.

Language and executive functioning: Children’s benefit from induced verbal strategies in different tasks

The interplay of language and cognition in children’s development has been subject to research for a long time. The present study followed up on recently reported deleterious effects of articulatory suppression on children’s executive functioning (Fatzer & Roebers, 2012), aiming to provide more empirical evidence on the differential influence of language on executive functioning. In the present study, verbal strategies were induced in three executive functioning tasks. The tasks were linked to the three central executive functioning dimensions of updating (Complex Span task), shifting (Cognitive Flexibility task) and inhibition (Flanker task). It was expected that the effects of the verbal strategy instruction would counter the results of articulatory suppression and thus be strong in the Complex Span task, weak but present in the Cognitive Flexibility task and small or nonexistent in the Flanker task. N = 117 children participated in the study, with n = 39 four-year-olds, n = 38 six-year-olds, and n = 40 nine-year-olds. As expected, results revealed a benefit from induced verbal strategies in the Complex Span and the Cognitive Flexibility task, but not in the Flanker task. The positive effect of strategy instruction declined with increasing age, pointing to more frequent spontaneous and self-initiated use of verbal strategies over the course of development. The effect of strategy instruction in the Cognitive Flexibility task was unexpectedly strong in the light of the only small detrimental effect of articulatory suppression in the preceding study. Implications for language’s involvement in the different executive functioning dimensions and for practice are discussed.

Hierarchical segmentation-assisted multimodal registration for MR brain images

Information theory-based metric such as mutual information (MI) is widely used as similarity measurement for multimodal registration. Nevertheless, this metric may lead to matching ambiguity for non-rigid registration. Moreover, maximization of MI alone does not necessarily produce an optimal solution. In this paper, we propose a segmentation-assisted similarity metric based on point-wise mutual information (PMI). This similarity metric, termed SPMI, enhances the registration accuracy by considering tissue classification probabilities as prior information, which is generated from an expectation maximization (EM) algorithm. Diffeomorphic demons is then adopted as the registration model and is optimized in a hierarchical framework (H-SPMI) based on different levels of anatomical structure as prior knowledge. The proposed method is evaluated using Brainweb synthetic data and clinical fMRI images. Both qualitative and quantitative assessment were performed as well as a sensitivity analysis to the segmentation error. Compared to the pure intensity-based approaches which only maximize mutual information, we show that the proposed algorithm provides significantly better accuracy on both synthetic and clinical data.

Multimodal viral communication: a social semiotic analysis of the popular Spanish "Ola ke ase" meme

Multimodality – the interdependence of semiotic resources in text – is an existential element of today’s media. The term multimodality attends systematically to the social interpretation of a wide range of communicational forms used in meaning making. A primary focus of social- semiotic multimodal analysis is on mapping how modal resources are used by people in a given social context. In November 2012 the “Ola ke ase” catchphrase, which is a play on “Hola ¿qué hace?”, appeared for the first time in Spain and immediately has been adopted as a Twitter hashtag and an image macro series. Its viral spread on social networks has been tremendous, being a trending topic in various Spanish-speaking countries. The objective of analysis is how language and image work together in the “Ola ke ase” meme. The interplay between text and image in one of the original memes and some of its variations is quantitatively analysed applying a social-semiotic approach. Results demonstrate how the “Ola ke ase” meme functions through its multimodal character and the non-standard orthography. The spread of uncountable variations of the meme shows the social process that goes on in the meaning making of the semiotic elements.