The evaluation of qualitative methods selection in the field of design and emotion

The aim of this paper is to aid researchers in selecting appropriate qualitative methods in order to develop and improve future studies in the field of emotional design. These include observations, think-aloud protocols, questionnaires, diaries and interviews. Based on the authors’ experiences, it is proposed that the methods under review can be successfully used for collecting data on emotional responses to evaluate user product relationships. This paper reviews the methods; discusses the suitability, advantages and challenges in relation to design and emotion studies. Furthermore, the paper outlines the potential impact of technology on the application of these methods, discusses the implications of these methods for emotion research and concludes with recommendations for future work in this area.

Workplace emotion : fear and anger

This original screen drama functioned as the stimulus in an audience response experiment, undertaken as part of research into workplace emotion. Commissioned and scripted by researchers at the University of Queensland and Griffith University, the film portrays the same narrative (a workplace conflict) twice, but played differently each time. The first version is intended to evince in viewers a fear response, and the second, an anger response. In preparing and rehearsing their performance choices, the actors utilised established taxonomies of fear and anger, in order to produce the optimum stimulus for conducting the experiment.

Does emotion modulate the blink reflex in human conditioning? Startle potentiation during pleasant and unpleasant cues in the picture-picture paradigm

Emotional processes modulate the size of the eyeblink startle reflex in a picture-viewing paradigm, but it is unclear whether emotional processes are responsible for blink modulation in human conditioning. Experiment 1 involved an aversive differential conditioning phase followed by an extinction phase in which acoustic startle probes were presented during CS+, CS-, and intertrial intervals. Valence ratings and affective priming showed the CS+ was unpleasant postacquisition. Blink startle magnitude was larger during CS+ than during CS-. Experiment 2 used the same design in two groups trained with pleasant or unpleasant pictorial USs. Ratings and affective priming indicated that the CS+ had become pleasant or unpleasant in the respective group. Regardless of CS valence, blink startle was larger during CS+ than CS- in both groups. Thus, startle was not modulated by CS valence.

Associations between young children's emotion attributions and prediction of outcome in differing social situations

Associations between young children's attributions of emotion at different points in a story, and with regard to their own prediction about the story's outcome, were investigated using two hypothetical scenarios of social and emotional challenge (social entry and negative event). First grade children (N = 250) showed an understanding that emotions are tied to situational cues by varying the emotions they attributed both between and within scenarios. Furthermore, emotions attributed to the main protagonist at the beginning of the scenarios were differentially associated with children's prediction of a positive or negative outcome and with the valence of the emotion attributed at the end of the scenario. Gender differences in responses to some items were also found. © 2010 The British Psychological Society.

Teaching design and emotion in the foundation year : an industrial design approach

This paper showcases two design tools; the ‘storyboard’ and ‘a day in the life’ demonstrated to design students in their foundational year (first year) of study. By employing these tools during the design process the aim was to provoke students to consider and design for emotional experiences for potential users. The assessment asked students to design an MP3 player using these tools. This is demonstrated through a student project that successfully used the tools and method introduced. The teaching theory, project context, student outcome as well as challenges faced by students using this approach are discussed. The paper concludes with implications for teaching emotion theory at an undergraduate level and potential future directions.

Can emotion provide a new approach to business model innovation?

Companies require new strategies to drive growth and survival, as the fast pace of change has created the need for greater business flexibility. Therefore, industry leaders are looking to business innovation as a principle source of differentiation and competitive advantage. However, most companies rely heavily on either technology or products to provide business innovation, yet competitors can easily and rapidly surpass these forms of innovation. Business model innovation expands beyond innovation in isolated areas, such as product innovation, to create strategies that incorporate many business avenues to work together to create and deliver value to its customers. Existing literature highlights that a business model’s central role is ‘customer value’. However, the emotional underpinnings of customer value within a business model are not well understood. The integration of customer emotion into business model design and value chain can be viewed as a way to innovate beyond just products, services and processes. This paper investigates the emotional avenues within business strategy and operations, business model innovation and customer engagement. Three propositions are outlined and explored as future research. The significance of this research is to provide companies with a new approach to innovation through a deeper understanding and integration of their customers’ emotions.

Using emotion to diversify document rankings

The aim of this paper is to investigate the role of emotion features in diversifying document rankings to improve the effectiveness of Information Retrieval (IR) systems. For this purpose, two approaches are proposed to consider emotion features for diversification, and they are empirically tested on the TREC 678 Interactive Track collection. The results show that emotion features are capable of enhancing retrieval effectiveness.

Automatic inference of driving task demand from visual cues of emotion and attention

Sensing the mental, physical and emotional demand of a driving task is of primary importance in road safety research and for effectively designing in-vehicle information systems (IVIS). Particularly, the need of cars capable of sensing and reacting to the emotional state of the driver has been repeatedly advocated in the literature. Algorithms and sensors to identify patterns of human behavior, such as gestures, speech, eye gaze and facial expression, are becoming available by using low cost hardware: This paper presents a new system which uses surrogate measures such as facial expression (emotion) and head pose and movements (intention) to infer task difficulty in a driving situation. 11 drivers were recruited and observed in a simulated driving task that involved several pre-programmed events aimed at eliciting emotive reactions, such as being stuck behind slower vehicles, intersections and roundabouts, and potentially dangerous situations. The resulting system, combining face expressions and head pose classification, is capable of recognizing dangerous events (such as crashes and near misses) and stressful situations (e.g. intersections and way giving) that occur during the simulated drive.

Methods for sociological inquiry on emotion in educational settings

Sociological approaches to inquiry on emotion in educational settings are growing. Despite a long tradition of research and theory in disciplines such as psychology and sociology, the methods and approaches for naturalistic investigation of emotion are in a developmental phase in educational settings. In this article, recent empirical studies on emotion in educational contexts are canvassed. The discussion focuses on the use of multiple methods within research conducted in high school and university classrooms highlighting recent methodological progress. The methods discussed include facial expression analysis, verbal and non-verbal conduct, and self-report methods. Analyses drawn from different studies, informed by perspectives from microsociology, highlight the strengths and limitations of any one method. The power and limitations of multi-method approaches is discussed.

Wearable neuroimaging and emotion : investigating emotional responses to architectural environments with functional near-infrared spectroscopy (fNIRS)

Supported by contemporary theories of architectural aesthetics and neuro-aesthetics this paper presents a case for the use of portable fNIRS imaging in the assessment of emotional responses to spatial environments experienced by both blind and sighted. The aim of the paper is to outline the implications of fNIRS for spatial research and practice within the field of architecture, thereby suggesting a potential taxonomy of particular formations of space and affect. Empirical neurological study of affect and spatial experience from an architectural design perspective remains in many instances unchartered. Clinical research using the portable non-invasive neuro-imaging device, functional near infrared spectroscopy (fNIRS) is proving convincing in its ability to detect emotional responses to visual, spatio-auditory and task based stimuli, providing a firm basis to potentially track cortical activity in the appraisal of architectural environments. Additionally, recent neurological studies have sought to explore the manifold sensory abilities of the visually impaired to better understand spatial perception in general. Key studies reveal that early blind participants perform as well as sighted due to higher auditory and somato-sensory spatial acuity. For instance, face vision enables the visually impaired to detect environments through skin pressure, enabling at times an instantaneous impression of the layout of an unfamiliar environment. Studies also report pleasant and unpleasant emotional responses such as ‘weightedness’ or ‘claustrophobia’ within certain interior environments, revealing a deeper perceptual sensitivity then would be expected. We conclude with justification that comparative fNIRS studies between the sighted and blind concerning spatial experience have the potential to provide greater understanding of emotional responses to architectural environments.

Facial emotion modulates the neural mechanisms responsible for short interval time perception

Emotionally arousing events can distort our sense of time. We used mixed block/event-related fMRI design to establish the neural basis for this effect. Nineteen participants were asked to judge whether angry, happy and neutral facial expressions that varied in duration (from 400 to 1,600 ms) were closer in duration to either a short or long duration they learnt previously. Time was overestimated for both angry and happy expressions compared to neutral expressions. For faces presented for 700 ms, facial emotion modulated activity in regions of the timing network Wiener et al. (NeuroImage 49(2):1728–1740, 2010) namely the right supplementary motor area (SMA) and the junction of the right inferior frontal gyrus and anterior insula (IFG/AI). Reaction times were slowest when faces were displayed for 700 ms indicating increased decision making difficulty. Taken together with existing electrophysiological evidence Ng et al. (Neuroscience, doi: 10.3389/fnint.2011.00077, 2011), the effects are consistent with the idea that facial emotion moderates temporal decision making and that the right SMA and right IFG/AI are key neural structures responsible for this effect.

Emotion recognition of static and dynamic faces in autism spectrum disorder

There is substantial evidence for facial emotion recognition (FER) deficits in autism spectrum disorder (ASD). The extent of this impairment, however, remains unclear, and there is some suggestion that clinical groups might benefit from the use of dynamic rather than static images. High-functioning individuals with ASD (n = 36) and typically developing controls (n = 36) completed a computerised FER task involving static and dynamic expressions of the six basic emotions. The ASD group showed poorer overall performance in identifying anger and disgust and were disadvantaged by dynamic (relative to static) stimuli when presented with sad expressions. Among both groups, however, dynamic stimuli appeared to improve recognition of anger. This research provides further evidence of specific impairment in the recognition of negative emotions in ASD, but argues against any broad advantages associated with the use of dynamic displays.