Perception and Automatic Recognition of Laughter from Whole-Body Motion: Continuous and Categorical Perspectives

Despite its importance in social interactions, laughter remains little studied in affective computing. Intelligent virtual agents are often blind to users’ laughter and unable to produce convincing laughter themselves. Respiratory, auditory, and facial laughter signals have been investigated but laughter-related body movements have received less attention. The aim of this study is threefold. First, to probe human laughter perception by analyzing patterns of categorisations of natural laughter animated on a minimal avatar. Results reveal that a low dimensional space can describe perception of laughter “types”. Second, to investigate observers’ perception of laughter (hilarious, social, awkward, fake, and non-laughter) based on animated avatars generated from natural and acted motion-capture data. Significant differences in torso and limb movements are found between animations perceived as laughter and those perceived as non-laughter. Hilarious laughter also differs from social laughter. Different body movement features were indicative of laughter in sitting and standing avatar postures. Third, to investigate automatic recognition of laughter to the same level of certainty as observers’ perceptions. Results show recognition rates of the Random Forest model approach human rating levels. Classification comparisons and feature importance analyses indicate an improvement in recognition of social laughter when localized features and nonlinear models are used.

Successful balance training is associated with improved multisensory function in fall-prone older adults

Balance maintenance relies on a complex interplay between many different sensory modalities. Although optimal multisensory processing is thought to decline with ageing, inefficient integration is particularly associated with falls in older adults. We investigated whether improved balance control, following a novel balance training intervention, was associated with more efficient multisensory integration in older adults, particularly those who have fallen in the past. Specifically, 76 healthy and fall-prone older adults were allocated to either a balance training programme conducted over 5 weeks or to a passive control condition. Balance training involved a VR display in which the on-screen position of a target object was controlled by shifts in postural balance on a Wii balance board. Susceptibility to the sound-induced flash illusion, before and after the intervention (or control condition), was used as a measure of multisensory function. Whilst balance and postural control improved for all participants assigned to the Intervention group, improved functional balance was correlated with more efficient multisensory processing in the fall-prone older adults only. Our findings add to growing evidence suggesting important links between balance control and multisensory interactions in the ageing brain and have implications for the development of interventions designed to reduce the risk of falls.

Human Perception of Laughter from Context-free Whole Body Motion Dynamic Stimuli

Laughter is a ubiquitous social signal in human interactions yet it remains understudied from a scientific point of view. The need to understand laughter and its role in human interactions has become more pressing as the ability to create conversational agents capable of interacting with humans has come closer to a reality. This paper reports on three aspects of the human perception of laughter when context has been removed and only the body information from the laughter episode remains. We report on ability to categorise the laugh type and the sex of the laugher; the relationship between personality factors with laughter categorisation and perception; and finally the importance of intensity in the perception and categorisation of laughter.

Understanding perception and action in sport:How can virtual reality technology help?

Although technology can facilitate improvements in performance by allowing us to understand, monitor and evaluate performance, improvements must ultimately come from within the athlete. The first part of this article will focus on understanding how perception and action relate to performance from two different theoretical viewpoints. The first will be predominantly a cognitive or indirect approach that suggests that expertise and decision-making processes are mediated by athletes accruing large knowledge bases that are built up through practice and experience. The second, and alternative approach, will advocate a more 'direct' solution, where the athlete learns to 'tune' into the relevant information that is embedded in their relationship with the surrounding environment and unfolding action. The second part of the article will attempt to show how emerging virtual reality technology is revealing new evidence that helps us understand elite performance. Possibilities of how new types of training could be developed from this technology will also be discussed. © 2014 Crown Copyright.

New methods for studying perception and action coupling

To study perception and action, Gibson advocated that “the laboratory must be like life” (Gibson, 1979, p. 3). In other words, the interactive relationship between an organism and his/her envi- ronment must be maintained so that the behavior observed in an experimental context mirrors, as closely as possible, the behavior observed in a realistic sport setting. The concept of repre- sentative design introduced by Brunswik in 1956 emphasized the need to have experimental tasks that allow the player to pick up perceptual information that specifies a property of the environment-actor system (Araújo et al., 2005; see also Chapter 24). In this chapter we will provide a brief overview of the methodologies used to study perception and action in sport and present, in some detail, the opportunities new methodologies such as immersive, interactive vir- tual reality can offer researchers in sport expertise.

Testing the channel-based model of duration perception

The channel-based model of duration perception postulates the existence of neural mechanisms that respond selectively to a narrow range of stimulus durations centred on their preferred duration (Heron et al Proceedings of the Royal Society B 279 690–698). In principle the channel-based model could
explain recent reports of adaptation-induced, visual duration compression effects (Johnston et al Current Biology 16 472–479; Curran and Benton Cognition 122 252–257); from this perspective duration compression is a consequence of the adapting stimuli being presented for a longer duration than the test stimuli. In the current experiment observers adapted to a sequence of moving random dot patterns at the same retinal position, each 340ms in duration and separated by a variable (500–1000ms) interval. Following adaptation observers judged the duration of a 600ms test stimulus at the same location. The test stimulus moved in the same, or opposite, direction as the adaptor. Contrary to the channel-based
model’s prediction, test stimulus duration appeared compressed, rather than expanded, when it moved in the same direction as the adaptor. That test stimulus duration was not distorted when moving in the opposite direction further suggests that visual timing mechanisms are influenced by additional neural processing associated with the stimulus being timed.

Change in psychological distress in longer-term oesophageal cancer carers: are clusters of illness perception change a useful determinant?

Objective: This study provides a longitudinal assessment of distress in longer-term oesophageal cancer carers, while examining illness perception schema as a possible determinant of change in distress over time.
Methods: Oesophageal cancer carers (n=171), 48-months post-diagnosis, were assessed at baseline and 12-months later with the Illness Perception Questionnaire-Revised, Cancer Coping Questionnaire, Hospital Anxiety and Depression Scale and Concerns About Recurrence Scale.
Results: Findings report deterioration from normal to probable anxiety in 35.7% of carers and probable depression in 28.7% carers over time. Fear of recurrence remained stable. Changes in control, consequence and cause beliefs were identified as key determinants of a change in psychological morbidity.
Conclusions: Illness beliefs appear to be valuable targets for psychological intervention to improve wellbeing among carers of people with oesophageal cancer.

Health care professionals’ experience, understanding and perception of need of advanced cancer patients with cachexia and their families: The benefits of a dedicated clinic.

Background: Cachexia has been defined as an on-going loss of skeletal muscle mass that cannot be fully reversed by conventional nutritional support. It can be found in up to 80% of patients with advanced cancer and has profound psycho-social consequences for patients and their families. There is a paucity of studies examining the role and experience of healthcare professionals in relation to cachexia and existing studies suggest that professional staff have limited understanding and do not intervene effectively.
Aim: To identify barriers and facilitators to good practice in cachexia care in order to inform future developments in service provision.
Design: An exploratory qualitative study was conducted employing semi-structured interviews with a range of healthcare professionals recruited purposefully from an Australian hospital. Interviews were conducted in private rooms within the hospital.
Setting/participants: A range of healthcare professionals responsible for cancer care were recruited from a large Australian teaching hospital.
Results: Interviews were conducted with 8 healthcare professionals responsible for delivering cancer care. Four themes were identified: formal and informal education, knowledge and understanding, truth telling in cachexia and palliative care, and, a multi-disciplinary approach. Findings show how improved knowledge and understanding across a staff body can lead to improved staff confidence and a willingness to address cancer cachexia and its consequences with patients and their families.
Conclusion: Comparison with previous studies illustrates the importance of improving knowledge and understanding about cachexia and how this can contribute to staff having the skills and experience necessary to address cachexia and provide an improved care experience for patients and carers.

Adapting to time: duration channels do not mediate human time perception

Accurately encoding the duration and temporal order of events is essential for survival and important to everyday activities, from holding conversations to driving in fast flowing traffic. Although there is a growing body of evidence that the timing of brief events (< 1s) is encoded by modality-specific mechanisms, it is not clear how such mechanisms register event duration. One approach gaining traction is a channel-based model; this envisages narrowly-tuned, overlapping timing mechanisms that respond preferentially to different durations. The channel-based model predicts that adapting to a given event duration will result in overestimating and underestimating the duration of longer and shorter events, respectively. We tested the model by having observers judge the duration of a brief (600ms) visual test stimulus following adaptation to longer (860ms) and shorter (340ms) stimulus durations. The channel-based model predicts perceived duration compression of the test stimulus in the former condition and perceived duration expansion in the latter condition. Duration compression occurred in both conditions, suggesting that the channel-based model does not adequately account for perceived duration of visual events.

Grounding human vocabulary in robot perception through interaction

This thesis addresses the problem of word learning in computational agents. The motivation behind this work lies in the need to support language-based communication between service robots and their human users, as well as grounded reasoning using symbols relevant for the assigned tasks. The research focuses on the problem of grounding human vocabulary in robotic agent’s sensori-motor perception. Words have to be grounded in bodily experiences, which emphasizes the role of appropriate embodiments. On the other hand, language is a cultural product created and acquired through social interactions. This emphasizes the role of society as a source of linguistic input. Taking these aspects into account, an experimental scenario is set up where a human instructor teaches a robotic agent the names of the objects present in a visually shared environment. The agent grounds the names of these objects in visual perception. Word learning is an open-ended problem. Therefore, the learning architecture of the agent will have to be able to acquire words and categories in an openended manner. In this work, four learning architectures were designed that can be used by robotic agents for long-term and open-ended word and category acquisition. The learning methods used in these architectures are designed for incrementally scaling-up to larger sets of words and categories. A novel experimental evaluation methodology, that takes into account the openended nature of word learning, is proposed and applied. This methodology is based on the realization that a robot’s vocabulary will be limited by its discriminatory capacity which, in turn, depends on its sensors and perceptual capabilities. An extensive set of systematic experiments, in multiple experimental settings, was carried out to thoroughly evaluate the described learning approaches. The results indicate that all approaches were able to incrementally acquire new words and categories. Although some of the approaches could not scale-up to larger vocabularies, one approach was shown to learn up to 293 categories, with potential for learning many more.