The Body Action and Posture Coding System (BAP): Development and Reliability

Several methods are available for coding body movement in nonverbal behavior research, but there is no consensus on a reliable coding system that can be used for the study of emotion expression. Adopting an integrative approach, we developed a new method, the Body Action and Posture (BAP) coding system, for the time-aligned micro description of body movement on an anatomical level (different articulations of body parts), a form level (direction and orientation of movement), and a functional level (communicative and self-regulatory functions). We applied the system to a new corpus of acted emotion portrayals, examined its comprehensiveness and demonstrated intercoder reliability at three levels: a) occurrence, b) temporal precision and c) segmentation. We discuss issues for further validation and propose some research applications.

The perception of emotion from body movement in point-light displays of interpersonal dialogue

We examined whether it is possible to identify the emotional content of behaviour from point-light displays where pairs of actors are engaged in interpersonal communication. These actors displayed a series of emotions, which included sadness, anger, joy, disgust, fear, and romantic love. In experiment 1, subjects viewed brief clips of these point-light displays presented the right way up and upside down. In experiment 2, the importance of the interaction between the two figures in the recognition of emotion was examined. Subjects were shown upright versions of (i) the original pairs (dyads), (ii) a single actor (monad), and (iii) a dyad comprising a single actor and his/her mirror image (reflected dyad). In each experiment, the subjects rated the emotional content of the displays by moving a slider along a horizontal scale. All of the emotions received a rating for every clip. In experiment 1, when the displays were upright, the correct emotions were identified in each case except disgust; but, when the displays were inverted, performance was significantly diminished for some ernotions. In experiment 2, the recognition of love and joy was impaired by the absence of the acting partner, and the recognition of sadness, joy, and fear was impaired in the non-veridical (mirror image) displays. These findings both support and extend previous research by showing that biological motion is sufficient for the perception of emotion, although inversion affects performance. Moreover, emotion perception from biological motion can be affected by the veridical or non-veridical social context within the displays.

Video-based quantification of body movement during social interaction indicates the severity of negative symptoms in patients with schizophrenia

In schizophrenia, nonverbal behavior, including body movement, is of theoretical and clinical importance. Although reduced nonverbal expressiveness is a major component of the negative symptoms encountered in schizophrenia, few studies have objectively assessed body movement during social interaction. In the present study, 378 brief, videotaped role-play scenes involving 27 stabilized outpatients diagnosed with paranoid-type schizophrenia were analyzed using Motion Energy Analysis (MEA). This method enables the objective measuring of body movement in conjunction with ordinary video recordings. Correlations between movement parameters (percentage of time in movement, movement speed) and symptom ratings from independent PANSS interviews were calculated. Movement parameters proved to be highly reliable. In keeping with predictions, reduced movement and movement speed correlated with negative symptoms. Accordingly, in patients who exhibited noticeable movement for less than 20% of the observation time, prominent negative symptoms were highly probable. As a control measure, the percentage of movement exhibited by the patients during role-play scenes was compared to that of their normal interactants. Patients with negative symptoms differed from normal interactants by showing significantly reduced head and body movement. Two specific positive symptoms were possibly related to movement parameters: suspiciousness tended to correlate with reduced head movement, and the expression of unusual thought content tended to relate to increased movement. Overall, a close and theoretically meaningful association between the objective movement parameters and the symptom profiles was found. MEA appears to be an objective, reliable and valid method for quantifying nonverbal behavior, an aspect which may furnish new insights into the processes related to reduced expressiveness in schizophrenia.

Fast Fractal Coding Method for the Detection of Microcalcification in Mammograms

The presence of microcalcifications in mammograms can be considered as an early indication of breast cancer. A fastfractal block coding method to model the mammograms fordetecting the presence of microcalcifications is presented in this paper. The conventional fractal image coding method takes enormous amount of time during the fractal block encoding.procedure. In the proposed method, the image is divided intoshade and non shade blocks based on the dynamic range, andonly non shade blocks are encoded using the fractal encodingtechnique. Since the number of image blocks is considerablyreduced in the matching domain search pool, a saving of97.996% of the encoding time is obtained as compared to theconventional fractal coding method, for modeling mammograms.The above developed mammograms are used for detectingmicrocalcifications and a diagnostic efficiency of 85.7% isobtained for the 28 mammograms used.

Vertebral body stenting: a new method for vertebral augmentation versus kyphoplasty

Vertebroplasty and kyphoplasty are well-established minimally invasive treatment options for compression fractures of osteoporotic vertebral bodies. Possible procedural disadvantages, however, include incomplete fracture reduction or a significant loss of reduction after balloon tamp deflation, prior to cement injection. A new procedure called "vertebral body stenting" (VBS) was tested in vitro and compared to kyphoplasty. VBS uses a specially designed catheter-mounted stent which can be implanted and expanded inside the vertebral body. As much as 24 fresh frozen human cadaveric vertebral bodies (T11-L5) were utilized. After creating typical compression fractures, the vertebral bodies were reduced by kyphoplasty (n = 12) or by VBS (n = 12) and then stabilized with PMMA bone cement. Each step of the procedure was performed under fluoroscopic control and analysed quantitatively. Finally, static and dynamic biomechanical tests were performed. A complete initial reduction of the fractured vertebral body height was achieved by both systems. There was a significant loss of reduction after balloon deflation in kyphoplasty compared to VBS, and a significant total height gain by VBS (mean +/- SD in %, p < 0.05, demonstrated by: anterior height loss after deflation in relation to preoperative height [kyphoplasty: 11.7 +/- 6.2; VBS: 3.7 +/- 3.8], and total anterior height gain [kyphoplasty: 8.0 +/- 9.4; VBS: 13.3 +/- 7.6]). Biomechanical tests showed no significant stiffness and failure load differences between systems. VBS is an innovative technique which allows for the possibly complete reduction of vertebral compression fractures and helps maintain the restored height by means of a stent. The height loss after balloon deflation is significantly decreased by using VBS compared to kyphoplasty, thus offering a new promising option for vertebral augmentation.

EPA-1380 – Coordinated body-movement reflects psychotherapy outcome

Social interaction is a core aspect of human life that affects individuals’ physical and mental health. Social interaction usually leads to mutual engagement in diverse areas of mental, emotional, physiological and physical activity involving both interacting persons and subsequently impacting the outcome of interactions. A common approach to the analysis of social interaction is the study of the verbal content transmitted between sender and receiver. However, additional important processes and dynamics are occurring in other domains too, for example in the area of nonverbal behaviour: In a series of studies, we have looked at nonverbal synchrony – the coordination of two persons’ movement patterns – and it‘s association with relationship quality and with the outcome of interactions. Using a computer-based algorithm (Motion Energy Analysis, MEA: Ramseyer & Tschacher, 2011), which automatically quantifies a person‘s body-movement, we were able to objectively calculate nonverbal synchrony in a large number of dyads interacting in various settings. In a first step, we showed that the phenomenon of nonverbal synchrony exists at a level that is significantly higher than expected by chance. In a second step, we ascertained that across different settings – including patient-therapist dyads and healthy dyads – more synchronized movement was associated with better relationship quality and better interactional outcomes. The quality of a relationship is thus embodied by the synchronized movement patterns emerging between partners. Our studies suggest that embodied cognition is a valuable approach to research in social interaction, providing important clues for an improved understanding of interaction dynamics.

Video-based quantification of body movement indicates negative symptoms: a replication

Objective: In schizophrenia, abnormalities in nonverbal behaviors have always been considered as highly relevant. However, due to methodological limitations, nonverbal behavior was rarely quantified objectively. Recent methodological advances now allow a quantification of body movement from ordinary video recordings. We showed that patients’ objectively measured amount of movement in social role-play interactions was closely associated with their symptom profiles (Kupper, Ramseyer, Hoffmann, & Tschacher, Schizophrenia Research 2010). In the present study, a replication of these results in the context of semi-standardized PANSS (Positive and Negative Syndrome Scale) interviews was intended. Methods: 17 patients with schizophrenia were analyzed during the initial 15-min sequence of a videotaped PANSS interview using Motion Energy Analysis (MEA). The amount of patients’ movement was then correlated with their PANSS symptom scores. Results: Sizeable and significant correlations between negative symptoms and reduced movements (r = -.68, p<0.01) and reduced movement speed (r = -.80, p<0.001) were found. Moreover, cognitive symptoms were related to reduced movement speed (r = -.70, p<.01). Conclusion: Negative symptoms were reliably indicated by patients’ nonverbal behavior in psychopathology interviews. Hence, the main result of our earlier study, examining patients’ nonverbal behavior in role play tests, was replicated for the less structured interactions in psychopathological interviews. Results could encourage the use of MEA in a wide range of videotaped social interactions of patients with schizophrenia and other psychiatric disorders.

Force sensing for measuring human body movement

The research developed in this thesis explores the sensing and inference of human movement in a dynamic way, as opposed to conventional measurement systems, that are only concerned with discrete evaluations of stimuli in sequential time. Typically, conventional approaches are used to infer the dynamic movement of the body; such as vision and motion tracking devices, with either a human diagnosis or complex image processing algorithm to classify the movement. This research is therefore the first of its kind to attempt and provide a movement classifying algorithm through the use of minimal sensing points, with the application for this novel system, to classify human movement during a golf swing. There are two main categories of force sensing. Firstly, array-type systems consisting of many sensing elements, and are the most commonly researched and commercially available. Secondly, reduced force sensing element systems (RFSES) also known as distributive systems have only been recently exploited in the academic world. The fundamental difference between these systems is that array systems handle the data captured from each sensor as unique outputs and suffer the effects of resolution. The effect of resolution, is the error in the load position measurement between sensing elements, as the output is quantized in terms of position. This can be compared to a reduced sensor element system that maximises that data received through the coupling of data from a distribution of sensing points to describe the output in discrete time. Also this can be extended to a coupling of transients in the time domain to describe an activity or dynamic movement. It is the RFSES that is to be examined and exploited in the commercial sector due to its advantages over array-based approaches such as reduced design, computational complexity and cost.

Towards an Ecological Pedagogy: Body Movement for Ecological Consciousness

This paper examines the moving body as a vehicle for raising ecological consciousness. Due to the modern over-preoccupation with the pursuit of rational aims, human interactions with the surrounding environment increasingly lack conscious awareness. Consequently, in the modern world people tend to lack an ecological consciousness. Nevertheless, the human body is a rich reservoir of ecological significance. From birth, humans are woven into tremendous interconnection with the world. However, humans thrive when their sensitivity to the physical world exists in harmony with their ability to pursue their rational aims. It is the combination of these characteristics that enables humans to survive in capricious surroundings and prosper in a wide array of contexts. Today, the human species faces an unprecedented crisis that threatens to collapse the reciprocality of the ecological bonds bolstering the prosperity of all worldly beings. This paper proposes that it is no longer a rational strategy for people to remain inattentive to their embodied ecological resonance, and that the moving body is an adequate pedagogical site for raising ecological consciousness. Ritualized body movements derived from Chinese traditional cultivation systems such as Taijiquan could orient practitioners to reestablish a perceptual intimacy with the larger cosmic world, thereby raising their ecological consciousness.

Emotion expression in body action and posture

Emotion communication research strongly focuses on the face and voice as expressive modalities, leaving the rest of the body relatively understudied. Contrary to the early assumption that body movement only indicates emotional intensity, recent studies show that body movement and posture also convey emotion specific information. However, a deeper understanding of the underlying mechanisms is hampered by a lack of production studies informed by a theoretical framework. In this research we adopted the Body Action and Posture (BAP) coding system to examine the types and patterns of body movement that are employed by 10 professional actors to portray a set of 12 emotions. We investigated to what extent these expression patterns support explicit or implicit predictions from basic emotion theory, bi-dimensional theory, and componential appraisal theory. The overall results showed partial support for the different theoretical approaches. They revealed that several patterns of body movement systematically occur in portrayals of specific emotions, allowing emotion differentiation. While a few emotions were prototypically encoded by one particular pattern, most emotions were variably expressed by multiple patterns, many of which can be explained as reflecting functional components of emotion such as modes of appraisal and action readiness. It is concluded that further work in this largely underdeveloped area should be guided by an appropriate theoretical framework to allow a more systematic design of experiments and clear hypothesis testing.

Corps et âme en mouvement. Expression et signification du mouvement dans la peinture de vases en Grèce ancienne (VIe-IVe s. av. J.-C.). Ivresse, possession divine et mort.

Thèse réalisée en cotutelle avec l'université de Franche-Comté, école doctorale Langage, espace, temps et société.