The perception of emotion from body movement in point-light displays of interpersonal dialogue

We examined whether it is possible to identify the emotional content of behaviour from point-light displays where pairs of actors are engaged in interpersonal communication. These actors displayed a series of emotions, which included sadness, anger, joy, disgust, fear, and romantic love. In experiment 1, subjects viewed brief clips of these point-light displays presented the right way up and upside down. In experiment 2, the importance of the interaction between the two figures in the recognition of emotion was examined. Subjects were shown upright versions of (i) the original pairs (dyads), (ii) a single actor (monad), and (iii) a dyad comprising a single actor and his/her mirror image (reflected dyad). In each experiment, the subjects rated the emotional content of the displays by moving a slider along a horizontal scale. All of the emotions received a rating for every clip. In experiment 1, when the displays were upright, the correct emotions were identified in each case except disgust; but, when the displays were inverted, performance was significantly diminished for some ernotions. In experiment 2, the recognition of love and joy was impaired by the absence of the acting partner, and the recognition of sadness, joy, and fear was impaired in the non-veridical (mirror image) displays. These findings both support and extend previous research by showing that biological motion is sufficient for the perception of emotion, although inversion affects performance. Moreover, emotion perception from biological motion can be affected by the veridical or non-veridical social context within the displays.

Video-based quantification of body movement during social interaction indicates the severity of negative symptoms in patients with schizophrenia

In schizophrenia, nonverbal behavior, including body movement, is of theoretical and clinical importance. Although reduced nonverbal expressiveness is a major component of the negative symptoms encountered in schizophrenia, few studies have objectively assessed body movement during social interaction. In the present study, 378 brief, videotaped role-play scenes involving 27 stabilized outpatients diagnosed with paranoid-type schizophrenia were analyzed using Motion Energy Analysis (MEA). This method enables the objective measuring of body movement in conjunction with ordinary video recordings. Correlations between movement parameters (percentage of time in movement, movement speed) and symptom ratings from independent PANSS interviews were calculated. Movement parameters proved to be highly reliable. In keeping with predictions, reduced movement and movement speed correlated with negative symptoms. Accordingly, in patients who exhibited noticeable movement for less than 20% of the observation time, prominent negative symptoms were highly probable. As a control measure, the percentage of movement exhibited by the patients during role-play scenes was compared to that of their normal interactants. Patients with negative symptoms differed from normal interactants by showing significantly reduced head and body movement. Two specific positive symptoms were possibly related to movement parameters: suspiciousness tended to correlate with reduced head movement, and the expression of unusual thought content tended to relate to increased movement. Overall, a close and theoretically meaningful association between the objective movement parameters and the symptom profiles was found. MEA appears to be an objective, reliable and valid method for quantifying nonverbal behavior, an aspect which may furnish new insights into the processes related to reduced expressiveness in schizophrenia.

EPA-1380 – Coordinated body-movement reflects psychotherapy outcome

Social interaction is a core aspect of human life that affects individuals’ physical and mental health. Social interaction usually leads to mutual engagement in diverse areas of mental, emotional, physiological and physical activity involving both interacting persons and subsequently impacting the outcome of interactions. A common approach to the analysis of social interaction is the study of the verbal content transmitted between sender and receiver. However, additional important processes and dynamics are occurring in other domains too, for example in the area of nonverbal behaviour: In a series of studies, we have looked at nonverbal synchrony – the coordination of two persons’ movement patterns – and it‘s association with relationship quality and with the outcome of interactions. Using a computer-based algorithm (Motion Energy Analysis, MEA: Ramseyer & Tschacher, 2011), which automatically quantifies a person‘s body-movement, we were able to objectively calculate nonverbal synchrony in a large number of dyads interacting in various settings. In a first step, we showed that the phenomenon of nonverbal synchrony exists at a level that is significantly higher than expected by chance. In a second step, we ascertained that across different settings – including patient-therapist dyads and healthy dyads – more synchronized movement was associated with better relationship quality and better interactional outcomes. The quality of a relationship is thus embodied by the synchronized movement patterns emerging between partners. Our studies suggest that embodied cognition is a valuable approach to research in social interaction, providing important clues for an improved understanding of interaction dynamics.

Video-based quantification of body movement indicates negative symptoms: a replication

Objective: In schizophrenia, abnormalities in nonverbal behaviors have always been considered as highly relevant. However, due to methodological limitations, nonverbal behavior was rarely quantified objectively. Recent methodological advances now allow a quantification of body movement from ordinary video recordings. We showed that patients’ objectively measured amount of movement in social role-play interactions was closely associated with their symptom profiles (Kupper, Ramseyer, Hoffmann, & Tschacher, Schizophrenia Research 2010). In the present study, a replication of these results in the context of semi-standardized PANSS (Positive and Negative Syndrome Scale) interviews was intended. Methods: 17 patients with schizophrenia were analyzed during the initial 15-min sequence of a videotaped PANSS interview using Motion Energy Analysis (MEA). The amount of patients’ movement was then correlated with their PANSS symptom scores. Results: Sizeable and significant correlations between negative symptoms and reduced movements (r = -.68, p<0.01) and reduced movement speed (r = -.80, p<0.001) were found. Moreover, cognitive symptoms were related to reduced movement speed (r = -.70, p<.01). Conclusion: Negative symptoms were reliably indicated by patients’ nonverbal behavior in psychopathology interviews. Hence, the main result of our earlier study, examining patients’ nonverbal behavior in role play tests, was replicated for the less structured interactions in psychopathological interviews. Results could encourage the use of MEA in a wide range of videotaped social interactions of patients with schizophrenia and other psychiatric disorders.

Force sensing for measuring human body movement

The research developed in this thesis explores the sensing and inference of human movement in a dynamic way, as opposed to conventional measurement systems, that are only concerned with discrete evaluations of stimuli in sequential time. Typically, conventional approaches are used to infer the dynamic movement of the body; such as vision and motion tracking devices, with either a human diagnosis or complex image processing algorithm to classify the movement. This research is therefore the first of its kind to attempt and provide a movement classifying algorithm through the use of minimal sensing points, with the application for this novel system, to classify human movement during a golf swing. There are two main categories of force sensing. Firstly, array-type systems consisting of many sensing elements, and are the most commonly researched and commercially available. Secondly, reduced force sensing element systems (RFSES) also known as distributive systems have only been recently exploited in the academic world. The fundamental difference between these systems is that array systems handle the data captured from each sensor as unique outputs and suffer the effects of resolution. The effect of resolution, is the error in the load position measurement between sensing elements, as the output is quantized in terms of position. This can be compared to a reduced sensor element system that maximises that data received through the coupling of data from a distribution of sensing points to describe the output in discrete time. Also this can be extended to a coupling of transients in the time domain to describe an activity or dynamic movement. It is the RFSES that is to be examined and exploited in the commercial sector due to its advantages over array-based approaches such as reduced design, computational complexity and cost.

Towards an Ecological Pedagogy: Body Movement for Ecological Consciousness

This paper examines the moving body as a vehicle for raising ecological consciousness. Due to the modern over-preoccupation with the pursuit of rational aims, human interactions with the surrounding environment increasingly lack conscious awareness. Consequently, in the modern world people tend to lack an ecological consciousness. Nevertheless, the human body is a rich reservoir of ecological significance. From birth, humans are woven into tremendous interconnection with the world. However, humans thrive when their sensitivity to the physical world exists in harmony with their ability to pursue their rational aims. It is the combination of these characteristics that enables humans to survive in capricious surroundings and prosper in a wide array of contexts. Today, the human species faces an unprecedented crisis that threatens to collapse the reciprocality of the ecological bonds bolstering the prosperity of all worldly beings. This paper proposes that it is no longer a rational strategy for people to remain inattentive to their embodied ecological resonance, and that the moving body is an adequate pedagogical site for raising ecological consciousness. Ritualized body movements derived from Chinese traditional cultivation systems such as Taijiquan could orient practitioners to reestablish a perceptual intimacy with the larger cosmic world, thereby raising their ecological consciousness.

Determination of a Total Body Model of Efficiency Applied to a Rowing Movement in Humans

Efficiency represents the ratio of work done to energy expended. In human movement, it is desirable to maximise the work done or minimise the energy expenditure. Whilst research has examined the efficiency of human movement for the lower and upper body, there is a paucity of research which considers the efficiency of a total body movement. Rowing is a movement which encompasses all parts of the body to generate locomotion and is a useful modality to measure total body efficiency. It was the aim of this research to develop a total body model of efficiency and explore how skill level of participants and assumptions of the modelling process affected the efficiency estimates Three studies were used to develop and evaluate the efficiency model. Firstly, the efficiency of ten healthy males was established using rowing, cycling and arm cranking. The model included internal work from motion capture and efficiency estimates were comparable to published literature, indicating the suitability of the model to estimate efficiency. Secondly, the model was developed to include a multi-segmented trunk and twelve novice and twelve skilled participants were assessed for efficiency. Whilst the efficiency estimates were similar to published results, novice participants were assessed as more efficient. Issues such as the unique physiology of trained rowers and a lack of energy transfers in the model were considered contributing factors. Finally the model was redeveloped to account for energy transfers, where skilled participants had higher efficiency at large workloads. This work presents a novel model for estimating efficiency during a rowing motion. The specific inclusion of energy transfers expands previous knowledge of internal work and efficiency, demonstrating a need to include energy transfers in the assessment of efficiency of a total body action.

STATIC IMAGES WITH DIFFERENT INDUCED INTENSITIES OF HUMAN BODY MOVEMENTS AFFECT SUBJECTIVE TIME

Modulation of subjective time was examined using static images eliciting perceptions of different intensities of body movement. Undergraduate students were exposed to photographs of dancer sculptures in different dance positions for 36 sec. and asked to estimate the exposure duration. Lower movement intensities were related to shorter estimated durations. Mean durations for images of unmoving dancers were underestimated and for dancers taking a ballet step were overestimated. Temporal estimations were also related to the order of presentation of the stimuli, which suggested that subjective time estimations were influenced by the experimental context. Subjective time is related not only to the visual perception of moving images, but also of elicited perceptions of movement in static images, suggesting an embodiment effect on subjective time estimation.

An examination of movement kinematics in young people with high-functioning autism and Asperger's disorder: Further evidence for a motor planning deficit

This paper examines upper-body movement kinematics in individuals with high-functioning autism (HFA) and Asperger's disorder (AD). In general, the results indicate that HFA is more consistently associated with impaired motoric preparation/initiation than AD. The data further suggest that this quantitative difference in motor impairment is not necessarily underpinned by greater executive dysfunction vulnerability in autism relative to AD. Quantitative motoric dissociation between autism and AD may have down-stream effects on later stages of movement resulting in qualitative differences between these disorder groups, e.g. motor clumsiness in AD versus abnormal posturing in autism. It will be important for future research to map the developmental trajectory of motor abnormalities in these disorder groups.

The Body Action and Posture Coding System (BAP): Development and Reliability

Several methods are available for coding body movement in nonverbal behavior research, but there is no consensus on a reliable coding system that can be used for the study of emotion expression. Adopting an integrative approach, we developed a new method, the Body Action and Posture (BAP) coding system, for the time-aligned micro description of body movement on an anatomical level (different articulations of body parts), a form level (direction and orientation of movement), and a functional level (communicative and self-regulatory functions). We applied the system to a new corpus of acted emotion portrayals, examined its comprehensiveness and demonstrated intercoder reliability at three levels: a) occurrence, b) temporal precision and c) segmentation. We discuss issues for further validation and propose some research applications.

Pattern recognition of sleep in rodents using piezoelectric signals generated by gross body movements.

Current research on sleep using experimental animals is limited by the expense and time-consuming nature of traditional EEG/EMG recordings. We present here an alternative, noninvasive approach utilizing piezoelectric films configured as highly sensitive motion detectors. These film strips attached to the floor of the rodent cage produce an electrical output in direct proportion to the distortion of the material. During sleep, movement associated with breathing is the predominant gross body movement and, thus, output from the piezoelectric transducer provided an accurate respiratory trace during sleep. During wake, respiratory movements are masked by other motor activities. An automatic pattern recognition system was developed to identify periods of sleep and wake using the piezoelectric generated signal. Due to the complex and highly variable waveforms that result from subtle postural adjustments in the animals, traditional signal analysis techniques were not sufficient for accurate classification of sleep versus wake. Therefore, a novel pattern recognition algorithm was developed that successfully distinguished sleep from wake in approximately 95% of all epochs. This algorithm may have general utility for a variety of signals in biomedical and engineering applications. This automated system for monitoring sleep is noninvasive, inexpensive, and may be useful for large-scale sleep studies including genetic approaches towards understanding sleep and sleep disorders, and the rapid screening of the efficacy of sleep or wake promoting drugs.