Multi-method, multi-theoretical, multi-level research in the learning sciences

We examine methodologies and methods that apply to multi-level research in the learning sciences. In so doing we describe how multiple theoretical frameworks informs the use of different methods that apply to social levels involving space-time relationships that are not accessible consciously as social life is enacted. Most of the methods involve analyses of video and audio files. Within a framework of interpretive research we present a methodology of event-oriented social science, which employs video ethnography, narrative, conversation analysis, prosody analysis, and facial expression analysis. We illustrate multi-method research in an examination of the role of emotions in teaching and learning. Conversation and prosody analyses augment facial expression analysis and ethnography. We conclude with an exploration of ways in which multi-level studies can be complemented with neural level analyses.

Entrepreneur optimism and the new venture creation process

By integrating two theoretical approaches to entrepreneurship research, the psychology of the entrepreneur and the entrepreneurship process, this paper proposes a new conceptual model examining entrepreneur behaviour and emotion across the new venture development process. Existing macro level research on the new venture creation process recognises the entrepreneur as a central agent in the process yet generally avoids, at each stage of the process, an examination of the micro level psychological experiences of the individual entrepreneur. Similarly, behavioural research examining entrepreneur individual differences has neglected to systematically explore the emotion and behaviour of the entrepreneur across the cycle of the new venture creation process. We propose a conceptual framework that integrates the exploitation phase of the new venture creation process with the psychological capital element of optimism and behaviour of the individual entrepreneur. Propositions for future research to facilitate deeper insight into the impact of entrepreneur behaviour and emotion on the new venture creation process and ultimately the success or failure of the new venture are offered.

Chaos and creativity of play : designing emotional engagement in public spaces

How do we create strong urban narratives? How do we create affection for our cities? Play, an essential part of any species' biological existence and development, can often be perceived as chaotic and derogatory to social and spatial order. Play is also often perceived as a creative force which generates social and spatial value. This paper looks at the design approaches to both chaotic and creative perceptions of publics at play in urban space. Commonly, Urban and Architectural Design constitutes reactive management of perceived chaos, which derogatorily effects our sensory and emotional engagement with space. Alternatively, Urban and Architectural Design can appeal to the creativity of play, by encouraging unsolicited novelty that is vital to strong experiential narratives in the city and iterating environments that encourage the emergence of physical, emotional and cultural invention. These perceptions of chaos and creativity affect the design methodology of professional practice. Tested through the exciting vehicle of Parkour as urban narrative, the constraints and opportunities of both approaches are presented.

Emotions, crime and justice [Onati International Series in Law and Society, Number 1]

The return of emotions to debates about crime and criminal justice has been a striking development of recent decades across many jurisdictions. This has been registered in the return of shame to justice procedures, a heightened focus on victims and their emotional needs, fear of crime as a major preoccupation of citizens and politicians, and highly emotionalised public discourses on crime and justice. But how can we best make sense of these developments? Do we need to create "emotionally intelligent" justice systems, or are we messing recklessly with the rational foundations of liberal criminal justice? This volume brings together leading criminologists and sociologists from across the world in a much needed conversation about how to re-calibrate reason and emotion in crime and justice today. The contributions range from the micro-analysis of emotions in violent encounters to the paradoxes and tensions that arise from the emotionalisation of criminal justice in the public sphere. They explore the emotional labour of workers in police and penal institutions, the justice experiences of victims and offenders, and the role of vengeance, forgiveness and regret in the aftermath of violence and conflict resolution. The result is a set of original essays which offer a fresh and timely perspective on problems of crime and justice in contemporary liberal democracies.

Towards spontaneous facial expression recognition in real-world video

Facial expression is an important channel of human social communication. Facial expression recognition (FER) aims to perceive and understand emotional states of humans based on information in the face. Building robust and high performance FER systems that can work in real-world video is still a challenging task, due to the various unpredictable facial variations and complicated exterior environmental conditions, as well as the difficulty of choosing a suitable type of feature descriptor for extracting discriminative facial information. Facial variations caused by factors such as pose, age, gender, race and occlusion, can exert profound influence on the robustness, while a suitable feature descriptor largely determines the performance. Most present attention on FER has been paid to addressing variations in pose and illumination. No approach has been reported on handling face localization errors and relatively few on overcoming facial occlusions, although the significant impact of these two variations on the performance has been proved and highlighted in many previous studies. Many texture and geometric features have been previously proposed for FER. However, few comparison studies have been conducted to explore the performance differences between different features and examine the performance improvement arisen from fusion of texture and geometry, especially on data with spontaneous emotions. The majority of existing approaches are evaluated on databases with posed or induced facial expressions collected in laboratory environments, whereas little attention has been paid on recognizing naturalistic facial expressions on real-world data. This thesis investigates techniques for building robust and high performance FER systems based on a number of established feature sets. It comprises of contributions towards three main objectives: (1) Robustness to face localization errors and facial occlusions. An approach is proposed to handle face localization errors and facial occlusions using Gabor based templates. Template extraction algorithms are designed to collect a pool of local template features and template matching is then performed to covert these templates into distances, which are robust to localization errors and occlusions. (2) Improvement of performance through feature comparison, selection and fusion. A comparative framework is presented to compare the performance between different features and different feature selection algorithms, and examine the performance improvement arising from fusion of texture and geometry. The framework is evaluated for both discrete and dimensional expression recognition on spontaneous data. (3) Evaluation of performance in the context of real-world applications. A system is selected and applied into discriminating posed versus spontaneous expressions and recognizing naturalistic facial expressions. A database is collected from real-world recordings and is used to explore feature differences between standard database images and real-world images, as well as between real-world images and real-world video frames. The performance evaluations are based on the JAFFE, CK, Feedtum, NVIE, Semaine and self-collected QUT databases. The results demonstrate high robustness of the proposed approach to the simulated localization errors and occlusions. Texture and geometry have different contributions to the performance of discrete and dimensional expression recognition, as well as posed versus spontaneous emotion discrimination. These investigations provide useful insights into enhancing robustness and achieving high performance of FER systems, and putting them into real-world applications.

Just give me the facts? literalism versus symbolism in B2B advertising

For decades the prevailing idea in B2B marketing has been that buyers are motivated by product/service specifications. Sellers are put on approved supplier lists, invited to respond to RFPs, and are selected on the basis of superior products, at the right price, delivered on time. The history of B2B advertising is filled with the advice “provide product specifications” and your advertising will be noticed, lead to sales inquiries, and eventually result in higher sales. Advertising filled with abstractions might work in the B2C market, but the B2B marketplace is about being literal. What we know about advertising — and particularly the message component of advertising — is based on a combination of experience, unproven ideas and a bit of social science. Over the years, advertising guidelines produced by the predecessors of BMA (National Industrial Advertising Association, Association of Industrial Advertising, and the Business/Professional Advertising Association) stressed emphasizing product features and tangible benefits. The major publishers of B2B magazines, e.g., McGraw-Hill, Penton Publishing, et al. had similar recommendations. Also, B2B marketing books recommend advertising that focuses on specific product features (Kotler and Pfoertsch, 2006; Lamons, 2005). In more recent times, abstraction in advertising messages has penetrated the B2B marketplace. Even though such advertising legends as David Ogilvy (1963, 1985) frequently recommended advertising based on hard-core information, we’ve seen the growing use of emotional appeals, including humor, fear, parental affection, etc. Beyond the use of emotion, marketers attempt to build a stronger connection between their brands and buyers through the use of abstraction and symbolism. Below are two examples of B2B advertisements — Figure 1A is high in literalism and Figure 1B is high in symbolism. Which approach — a “left-brain” (literal) or “right brain” (symbolic) is more effective in B2B advertising? Are the advertising message creation guidelines from the history of B2B advertising accurate? Are the foundations of B2B message creation (experience and unproven ideas) sound?

A potential HIV epidemic among male street laborers in urban Vietnam

Background: Mass migration to Asian cities is a defining phenomenon of the present age, as hundreds of millions of people move from rural areas or between cities in search of economic prosperity. Although many do prosper, large numbers of people experience significant social disadvantage. This is especially the case among poorly educated, migrant unskilled unregistered male laborers who do much of the manual work throughout the cities. These men are at significant risk for many health problems, including HIV infection. However, to date there has been little research in developing countries to explain the determinants of this risk, and thereby to suggest feasible preventive strategies. Objectives and Methodology: Using combined qualitative and quantitative methods, the aim of this study was to explore the social contexts that affect health vulnerabilities and to develop conceptual models to predict risk behaviors for HIV [illicit drug use, unsafe sex, and non-testing for HIV] among male street laborers in Hanoi, Vietnam. Qualitative Research: Sixteen qualitative interviews revealed a complex variety of life experiences, beliefs and knowledge deficits that render these mostly poor and minimally educated men vulnerable to health problems including HIV infection. This study formed a conceptual model of numerous stressors related to migrants’ life experiences in urban space, including physical, financial and social factors. A wide range of coping strategies were adopted to deal with stressors – including problem-focused coping (PFC) and emotion-focused coping (EFC), pro-social and anti-social, active and passive. These men reported difficulty in coping with stressors because they had weak social networks and lacked support from formal systems. A second conceptual model emerged that highlighted equivalent influences of individual psychological factors, social integration, social barriers, and accessibility regarding drug use and sexual risk behavior. Psychological dimensions such as tedium, distress, fatalism and revenge, were important. There were strong effects of collective decision-making and fear of social isolation on shaping risk behaviors. These exploratory qualitative interviews helped to develop a culturally appropriate instrument for the quantitative survey and informed theoretical models of the factors that affect risk behaviors for HIV infection. Quantitative Research: The Information-Motivation-Behavioral Skills (IMB) model was adopted as the theoretical framework for a large-scale survey. It was modified to suit the contexts of these Vietnamese men. By doing a social mapping technique, 450 male street laborers were interviewed in Hanoi, Vietnam. The survey revealed that the risk of acquiring and transmitting HIV was high among these men. One in every 12 men reported homosexual or bisexual behavior. These men on average had 3 partners within the preceding year, and condom use was inconsistent. One third had had sex with commercial sex workers (CSW) and only 30% of them reported condom use; 17% used illicit drugs sometimes, with 66.7% of them frequently sharing injecting equipment with peers. Despite the risks, only 19.8% of men had been tested for HIV during the previous 12 months. These men have limited HIV knowledge and only moderate motivation and perceived behavioral skills for protective behavior. Although rural-to-urban migration was not associated with sexual risk behavior, three elements of the IMB model and depression associated with the process of mobility were significant determinants of sexual behavior. A modified model that incorporated IMB elements and psychosocial stress was found to be a better fit than the original IMB model alone in predicting protected sex behavior among the men. Men who were less psychologically and socially stressed, better informed and motivated for HIV prevention were more likely to demonstrate behavioral skills, and in turn were more likely to engage in safer sexual behavior. With regard to drug use, although the conventional model accounted for slightly less variance than the modified IMB model, data were of better fit for the conventional model. Multivariate analyses revealed that men who originated from urban areas, those who were homo- or bi-sexually identified and had better knowledge and skills for HIV prevention were more likely to access HIV testing, while men who had more sexual partners and those who did not use a condom for sex with CSW were least likely to take a test. The modified IMB model provided a better fit than the conventional model, as it explained a greater variance in HIV testing. Conclusions and Implications: This research helps to highlight a potential hidden HIV epidemic among street male, unskilled, unregistered laborers. This group has multiple vulnerabilities to HIV infection through both their partners and peers. However, most do not know their HIV status and have limited knowledge about preventing infection. This is the first application of a modified IMB model of risk behaviors for HIV such as drug use, condom use, and uptake of HIV testing to research with male street laborers in urban settings. The study demonstrated that while the extended IMB model had better fit than the conventional version in explaining the behaviors of safe sex and HIV testing, it was not so for drug use. The results provide interesting directions for future research and suggest ways to effectively design intervention strategies. The findings should shed light on culturally appropriate HIV preventive education and support programs for these men. As Vietnam has much in common with other developing countries in Southeast Asia, this research provides evidence for policy and practice that may be useful for public health systems in similar countries.

Stress and addiction : contribution of the corticotropin releasing factor (CRF) system in neuroplasticity

Corticotropin releasing factor (CRF) has been shown to induce various behavioral changes related to adaptation to stress. Dysregulation of the CRF system at any point can lead to a variety of psychiatric disorders, including substance use disorders (SUDs). CRF has been associated with stress-induced drug reinforcement. Extensive literature has identified CRF to play an important role in the molecular mechanisms that lead to an increase in susceptibility that precipitates relapse to SUDs. The CRF system has a heterogeneous role in SUDs. It enhances the acute effects of drugs of abuse and is also responsible for the potentiation of drug-induced neuroplasticity evoked during the withdrawal period. We present in this review the brain regions and circuitries where CRF is expressed and may participate in stress-induced drug abuse. Finally, we attempt to evaluate the role of modulating the CRF system as a possible therapeutic strategy for treating the dysregulation of emotional behaviors that result from the acute positive reinforcement of substances of abuse as well as the negative reinforcement produced by withdrawal.

Positive emotional experiences with portable interactive products

Positive emotions are central to human life and have implications to the overall quality of people's life (Fredrickson, 1998). This paper reports on positive experiences with two types of portable interactive devices (PIDs), specifically media/entertainment and medical/health devices. The study is based on a six-month longitudinal study exploring people's emotional experience and how PIDs mediate these experiences in everyday contexts. Previous findings by the authors (Gomez, Popovic & Blackler, 2011) presented four categories of activities including Feature, Functional, Mediation and Auxiliary activities and their relationship to emotional experience. The paper presents emotional experiences with specific activities reported with a focus on positive emotions. It concludes with a discussion of the findings on positive experiences and the implications for the future design of PIDs.

Do drivers respond emotionally and behaviourally differently to an intentionally anger provoking driving situation than to an ambiguous, but potentially provocative, one? Results of a self-report survey.

Aggressive driving is considered an important road-safety concern for drivers in highly motorised countries. However, understanding of the causes and maintenance factors fundamental to aggressive driving is limited. In keeping with theoretical advances from general aggression research such as the General Aggression Model (GAM), research has begun to examine the emotional and cognitive antecedents of aggressive driving in order to better understand the underlying processes motivating aggressive driving. Early findings in the driving area have suggested that greater levels of aggression are elicited in response to an intentionally aggressive on-road event. In contrast, general aggression research suggests that greater levels of aggression are elicited in response to an ambiguous event. The current study examined emotional and cognitive responses to two hypothetical driving scenarios with differing levels of aggressive intent (intentional versus ambiguous). There was also an interest in whether factors influencing responses were different for hostile aggression (that is, where the action is intended to harm the other) versus instrumental aggression (that is, where the action is motivated by an intention to remove an impediment or attain a goal). Results were that significantly stronger negative emotion and negative attributions, as well as greater levels of threat were reported in response to the scenario which was designed to appear intentional in nature. In addition, participants were more likely to endorse an aggressive behavioural response to a situation that appeared deliberately aggressive than to one where the intention was ambiguous. Analyses to determine if greater levels of negative emotions and cognitions are able to predict aggressive responses provided different patterns of results for instrumental aggression from those for hostile aggression. Specifically, for instrumental aggression, negative emotions and negative attributions were significant predictors for both the intentional and the ambiguous scenarios. In addition, perceived threat was also a significant predictor where the other driver’s intent was clearly aggressive. However, lower rather than higher, levels of perceived threat were associated with greater endorsement of an aggressive response. For hostile aggressive behavioural responses, trait aggression was the strongest predictor for both situations. Overall the results suggest that in the driving context, instrumental aggression is likely to be a much more common response than hostile aggression. Moreover, aggressive responses are more likely in situations where another driver’s behaviour is clearly intentional rather than ambiguous. The results also support the conclusion that there may be different underlying mechanisms motivating an instrumental aggressive response to those motivating a hostile one. In addition, understanding the emotions and cognitions underlying aggressive driving responses may be helpful in predicting and intervening to reduce driving aggression. The finding that drivers appear to regard tailgating as an instrumental response is of concern since this behaviour has the potential to result in crashes.

The Empty City (playreading)

This 45 minute non-verbal intermedial performance for children was adapted from the picture book I authored of the same name. The process involved writing and re-writing text and music with the result being a new draft of both script and soundtrack. Part of the judging process for the award the script was nominated for involved a playreading, which offered a particular challenge to the researcher in terms of composition and playwriting. How can a script and soundtrack for a non-verbal, intermedial work adapt and innovate the within the formal and practical constraints of the traditional ‘playreading’? This project’s emphasis on nestling intermediality within ostensibly traditional theatrical constraints and processes draws on concepts of musicalisation, identified by Varopolou. (in Lehmann 2006:91) Certain ‘musical moments’ in the piece echoed Ross Brown’s (2010) acoustemological concepts of sonification of everyday life, and the process involved dynamic curation of ‘music under’ for emotional effect, avoiding cinematic clichés and reaching for connections between music and emotion characterized by scholars such as Juslin and Sloboda (2001) The resulting performance was a hybrid of playreading and slideshow, supported by an original soundtrack of ‘music under’ (pre-recorded, but ‘DJ’ed’ live) as well as text-driven moments where music and sound were foregrounded. Research contribution This iteration of The Empty City shows that the tradition of the playreading can be a playful space where even the multiple layers of an intermedial performance text can be represented. The Empty City was a finalist in the 2012-13 Queensland Premier’s Drama Award. A ticketed public playreading of the script was held in the Queensland Theatre Company’s Bille Brown Studio on the 28th of July 2012 alongside the other finalists.

Emotional arousal of beginning physics teachers during extended experimental investigations

Teachers often have difficulty implementing inquiry-based activities, leading to the arousal of negative emotions. In this multicase study of beginning physics teachers in Australia, we were interested in the extent to which their expectations were realized and how their classroom experiences while implementing extended experimental investigations (EEIs) produced emotional states that mediated their teaching practices. Against rhetoric of fear expressed by their senior colleagues, three of the four teachers were surprised by the positive outcomes from their supervision of EEIs for the first time. Two of these teachers experienced high intensity positive emotions in response to their students’ success. When student actions / outcomes did not meet their teachers’ expectations, frustration, anger, and disappointment were experienced by the teachers, as predicted by a sociological theory of human emotions (Turner, 2007). Over the course of the EEI projects, the teachers’ practices changed along with their emotional states and their students’ achievements. We account for similarities and differences in the teachers’ emotional experiences in terms of context, prior experience, and expectations. The findings from this study provide insights into effective supervision practices that can be used to inform new and experienced teachers alike.

Extending the explanatory utility of the EPPM beyond fear-based persuasion

In the 20 years since its inception, the EPPM has attracted much empirical support. Currently, and unsurprisingly given that is a model of fear-based persuasion, the EPPM’s explanatory utility has been based only upon fear-based messages. However, an argument is put forth herein, which draws upon existing evidence, that the EPPM may be an efficacious framework for explaining the persuasive process and outcomes of emotion-based messages more broadly when such messages are addressing serious health topics. For the current study, four different types of emotional appeals were purposefully devised and included a fear, an annoyance/agitation, a pride, and a humour-based message. All messages addressed the serious health issue of road safety, and in particular the risky behaviour of speeding. Participants (N = 551) were exposed to only one of the four messages and subsequently provided responses within a survey. A series of 2 (threat: low, high) x 2 (efficacy: low, high) analysis of variance was conducted for each of the appeals based on the EPPM’s message outcomes of acceptance and rejection. Support was found for the EPPM with a number of main effects of threat and efficacy emerging, reflecting that, irrespective of emotional appeal type, high levels of threat and efficacy enhanced message outcomes via maximising acceptance and minimising rejection. Theoretically, the findings provide support for the explanatory utility of the EPPM for emotion-based health messages more broadly. In an applied sense, the findings highlight the value of adopting the EPPM as a framework when devising and evaluating emotion-based health messages for serious health topics.

Social cars : sensing, gathering, sharing and conveying social cues to road users

Intelligent Transport Systems (ITS) resembles the infrastructure for ubiquitous computing in the car. It encompasses a) all kinds of sensing technologies within vehicles as well as road infrastructure, b) wireless communication protocols for the sensed information to be exchanged between vehicles (V2V) and between vehicles and infrastructure (V2I), and c) appropriate intelligent algorithms and computational technologies that process these real-time streams of information. As such, ITS can be considered a game changer. It provides the fundamental basis of new, innovative concepts and applications, similar to the Internet itself. The information sensed or gathered within or around the vehicle has led to a variety of context-aware in-vehicular technologies within the car. A simple example is the Anti-lock Breaking System (ABS), which releases the breaks when sensors detect that the wheels are locked. We refer to this type of context awareness as vehicle/technology awareness. V2V and V2I communication, often summarized as V2X, enables the exchange and sharing of sensed information amongst cars. As a result, the vehicle/technology awareness horizon of each individual car is expanded beyond its observable surrounding, paving the way to technologically enhance such already advanced systems. In this chapter, we draw attention to those application areas of sensing and V2X technologies, where the human (driver), the human’s behavior and hence the psychological perspective plays a more pivotal role. The focal points of our project are illustrated in Figure 1: In all areas, the vehicle first (1) gathers or senses information about the driver. Rather than to limit the use of such information towards vehicle/technology awareness, we see great potential for applications in which this sensed information is then (2) fed back to the driver for an increased self-awareness. In addition, by using V2V technologies, it can also be (3) passed to surrounding drivers for an increased social awareness, or (4), pushed even further, into the cloud, where it is collected and visualized for an increased, collective urban awareness within the urban community at large, which includes all city dwellers.