Talking bodies: nonverbal behavior in the assessment of depression severity

BACKGROUND: Evaluations of clinical depression are traditionally based on verbal information. Nonverbal expressive behavior, however, being associated with a person's reflexive responses, may reveal negative emotional or social processes that are not under complete control of the patients. However, investigations of nonverbal behavior in the evaluation of depressed patients are still scarce. This study examines the nonverbal behaviors of a group of Brazilian patients, associating their nonverbal behavior with severity of depression. METHODS: Forty depressed patients were evaluated at baseline (T0) and after a two-week transcranial direct current stimulation treatment (T1), according to rating scales and through a 21-category Ethogram for assessment of the frequency of nonverbal behaviors displayed during an interview. RESULTS: Behaviors that were related to negative feelings and social disinterest decreased with corresponding clinical improvement and were associated with increased severity of symptoms at T0 and greater negative affect and dissatisfaction at T1. Pro-social behaviors were associated with milder symptoms at T0 and increased after treatment. Facial, head and hand expressive movements stood out as important indicators because of their associations with severity of depression. LIMITATIONS: Duration of behaviors was not assessed and there was not a healthy control group with which to compare the findings. CONCLUSIONS: These results support the usefulness of nonverbal behavior as an evaluation technique in the assessment of clinical depression.

Attachment insecurity as a filter in the decoding and encoding of nonverbal behavior in close relationships

In this article, I have focused my comments on the possible associations between the cognitions related to different attachment styles, and the impact that those cognitions are likely to have on nonverbal encoding and decoding. I see attachment insecurity as acting as a filter, distorting both encoding and decoding processes. In terms of decoding, an insecure individual may appraise the situation as more threatening than it actually is, may see the attachment figure as more or less available than he or she actually is, and may make an inappropriate decision about the viability or desirability of seeking proximity to the attachment figure. Attachment insecurity is also likely to inhibit the distressed individual from expressing their distress in a way that is understood by the attachment figure and that increases the likelihood that the attachment figure will engage in supportive behavior.

Explicit vs implicit affiliation motives predict different social behavior in sports competition

Objectives The present study investigated the predictive value of the explicit and implicit affiliation motive for social behavior in sport competitions. From an information processing perspective, an explicit motive is linked to verbal cues and respondent behavior. The implicit motive in turn is linked to nonverbal stimuli and operant behavior (McClelland, Koestner, & Weinberger, 1989; Schultheiss, 2008). Both respondent affiliative behavior (e.g., verbal interactions with teammates) and operant nonverbal social behavior (e.g., pleasant to opponents) can be observed in racquet sports team competitions. Design & Methods Fifty-two male racquet sportsmen completed the Personality Research Form (explicit affiliation motive) and the Operant Motive Test (implicit affiliation motive). Motive measures were used to predict social behavior during competitions using multiple regression analyses. To this aim real competitive matches were videotaped and analyzed. Results Results show that the explicit affiliation motive is associated with time spent in verbal team contact. The implicit affiliation motive, by contrast, is linked to pleasant nonverbal behavior shown toward opponents. Conclusions Findings suggest that implicit and explicit affiliation motives predict different kinds of social behavior in sports competition respectively. Indirect motive measures may be of additional predictive value for different behavior in real sports settings.

Nonverbal synchrony in social interactions of patients with schizophrenia indicates socio-communicative deficits

Background Disordered interpersonal communication can be a serious problem in schizophrenia. Recent advances in computer-based measures allow reliable and objective quantification of nonverbal behavior. Research using these novel measures has shown that objective amounts of body and head movement in patients with schizophrenia during social interactions are closely related to the symptom profiles of these patients. In addition to and above mere amounts of movement, the degree of synchrony, or imitation, between patients and normal interactants may be indicative of core deficits underlying various problems in domains related to interpersonal communication, such as symptoms, social competence, and social functioning. Methods Nonverbal synchrony was assessed objectively using Motion Energy Analysis (MEA) in 378 brief, videotaped role-play scenes involving 27 stabilized outpatients diagnosed with paranoid-type schizophrenia. Results Low nonverbal synchrony was indicative of symptoms, low social competence, impaired social functioning, and low self-evaluation of competence. These relationships remained largely significant when correcting for the amounts of patients‘ movement. When patients showed reduced imitation of their interactants’ movements, negative symptoms were likely to be prominent. Conversely, positive symptoms were more prominent in patients when their interaction partners’ imitation of their movements was reduced. Conclusions Nonverbal synchrony can be an objective and sensitive indicator of the severity of patients’ problems. Furthermore, quantitative analysis of nonverbal synchrony may provide novel insights into specific relationships between symptoms, cognition, and core communicative problems in schizophrenia.

The SEMAINE Database: Annotated Multimodal Records of Emotionally Colored Conversations between a Person and a Limited Agent

SEMAINE has created a large audiovisual database as a part of an iterative approach to building Sensitive Artificial Listener (SAL) agents that can engage a person in a sustained, emotionally colored conversation. Data used to build the agents came from interactions between users and an operator simulating a SAL agent, in different configurations: Solid SAL (designed so that operators displayed an appropriate nonverbal behavior) and Semi-automatic SAL (designed so that users' experience approximated interacting with a machine). We then recorded user interactions with the developed system, Automatic SAL, comparing the most communicatively competent version to versions with reduced nonverbal skills. High quality recording was provided by five high-resolution, high-framerate cameras, and four microphones, recorded synchronously. Recordings total 150 participants, for a total of 959 conversations with individual SAL characters, lasting approximately 5 minutes each. Solid SAL recordings are transcribed and extensively annotated: 6-8 raters per clip traced five affective dimensions and 27 associated categories. Other scenarios are labeled on the same pattern, but less fully. Additional information includes FACS annotation on selected extracts, identification of laughs, nods, and shakes, and measures of user engagement with the automatic system. The material is available through a web-accessible database. © 2010-2012 IEEE.

La synergologie, une lecture pseudoscientifique du langage corporel

L’objectif du présent article est d’évaluer si la synergologie fait partie du domaine de la science ou si elle n’est qu’une pseudoscience du décodage du non-verbal. Le texte comprend cinq parties. Dans la première partie, nous décrivons des éléments importants de la démarche scientifique. Dans les deuxième et troisième parties, nous présentons brièvement la synergologie et nous vérifions si celle-ci respecte les critères de la science. La quatrième partie fait état d’une mise en demeure adressée à Patrick Lagacé et à La Presse pour une série de textes qui présentait une vision très critique de cette approche. Enfin, l’utilisation d’arguments non pertinents d’un point de vue scientifique, une tentative inappropriée de donner de la crédibilité à la synergologie par une mise en demeure et un recours injustifié à l’argument éthique nous amènent à conclure que la synergologie est une pseudoscience du décodage du non-verbal.

FACSGen: a tool to synthesize emotional facial expressions through systematic manipulation of facial action units

To investigate the perception of emotional facial expressions, researchers rely on shared sets of photos or videos, most often generated by actor portrayals. The drawback of such standardized material is a lack of flexibility and controllability, as it does not allow the systematic parametric manipulation of specific features of facial expressions on the one hand, and of more general properties of the facial identity (age, ethnicity, gender) on the other. To remedy this problem, we developed FACSGen: a novel tool that allows the creation of realistic synthetic 3D facial stimuli, both static and dynamic, based on the Facial Action Coding System. FACSGen provides researchers with total control over facial action units, and corresponding informational cues in 3D synthetic faces. We present four studies validating both the software and the general methodology of systematically generating controlled facial expression patterns for stimulus presentation.

Adult attachment orientation and implicit behavioral mimicry

We investigated whether adult attachment orientation predicted the extent to which individuals engaged in implicit behavioral mimicry of a confederate presented by video. Results demonstrated that following an attachment threat prime: (1) those low in attachment anxiety and high in attachment avoidance showed less mimicry of face-rubbing gestures than individuals low in both attachment avoidance and attachment anxiety; (2) those high in attachment anxiety and low in attachment avoidance showed less mimicry of face-rubbing gestures than individuals low in both attachment avoidance and attachment anxiety. Importantly, attachment orientation did not predict baseline levels of face-rubbing gesturing; demonstrating that attachment orientation had an effect on mimicry rather than overall behavior expression. Attachment anxiety was positively related to attraction to the confederate such that those higher in attachment anxiety rated the confederate as more attractive. The findings are discussed with reference to both the mimicry and attachment literatures.

Linguistic relativity in SLA: towards a new research programme

The purpose of the current article is to support the investigation of linguistic relativity in second language acquisition and sketch methodological and theoretical prerequisites toward developing the domain into a full research program. We identify and discuss three theoretical-methodological components that we believe are needed to succeed in this enterprise. First, we highlight the importance of using nonverbal methods to study linguistic relativity effects in second language (L2) speakers. The use of nonverbal tasks is necessary in order to avoid the circularity that arises when inferences about nonverbal behavior are made on the basis of verbal evidence alone. Second, we identify and delineate the likely cognitive mechanisms underpinning cognitive restructuring in L2 speakers by introducing the theoretical framework of associative learning. By doing so, we demonstrate that the extent and nature of cognitive restructuring in L2 speakers is essentially a function of variation in individual learners’ trajectories. Third, we offer an in-depth discussion of the factors (e.g., L2 proficiency and L2 use) that characterize those trajectories, anchoring them to the framework of associative learning, and reinterpreting their relative strength in predicting L2 speaker cognition

Efeitos de modelagem do comportamento verbal e de instruções sobre o comportamento de encaixar peças

Pesquisas têm demonstrado diferenças nos efeitos dos comportamentos verbais modelado e instruído sobre o comportamento verbal e não-verbal. Este estudo investigou efeitos da modelagem do comportamento verbal e das instruções sobre o comportamento verbal (falar sobre encaixar peças) e o não-verbal (encaixar peças azuis e vermelhas, grandes e pequenas e quadradas e circulares) de 10 crianças, entre 8 e 9 anos de idade. A coleta de dados foi realizada em duas condições com cinco participantes. Condição 1: modelagem do comportamento verbal. Condição 2: apresentação de instruções para o comportamento não-verbal. Quando ocorreu a modelagem do comportamento verbal foram observadas mudanças correspondentes no comportamento não-verbal. As instruções produziram imediata adesão do comportamento não-verbal e, na seqüência, o desempenho foi alterado. Esses dados reafirmam a importância de ampliar o conhecimento dos efeitos da modelagem do comportamento verbal e das instruções sobre o comportamento de crianças em jogos como o utilizado nesta pesquisa.

Treino de correspondência: efeitos sobre a postura sentada em escolares

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Efeitos de dois tipos de pergunta sobre os comportamentos verbal e não-verbal

O presente estudo procurou avaliar se a sinalização da mudança nas contingências programadas pela apresentação de pergunta tornaria o seguimento de regras mais provável de mudar acompanhando a mudança nas contingências. Doze estudantes universitários foram expostos a um procedimento de escolha segundo o modelo. A tarefa era apontar para três estímulos de comparação, em seqüência, na presença de um estímulo modelo. A emissão das seqüências corretas produzia pontos trocáveis por dinheiro. As respostas eram reforçadas em esquema de reforçamento contínuo. Os participantes foram distribuídos em quatro condições experimentais, cada uma composta por quatro sessões. A Sessão 1 era a linha de base. As contingências programadas na Sessão 2 eram alteradas na Sessão 3 e mantidas inalteradas na Sessão 4. Nas Condições 1 e 2 o comportamento não-verbal era estabelecido por reforço diferencial e nas Condições 3 e 4 era estabelecido por regra. Duas perguntas eram feitas: a pergunta Tipo 1 consistia em solicitar ao participante que descrevesse o comportamento que produzia reforço; e a pergunta Tipo 2 consistia em pedir ao participante para avaliar a possibilidade de haver ou não mais de um comportamento que produzia reforço na situação experimental. A pergunta Tipo 1 era apresentada a cada três tentativas ao longo das Sessões 2, 3 e 4 de todas as condições; enquanto que a pergunta Tipo 2 era apresentada no início da Sessão 3 das Condições 1 e 3 e no início da Sessão 4 das Condições 2 e 4. As verbalizações dos participantes não eram reforçadas diferencialmente. Os resultados mostraram que dois dos três participantes da Condição 1 e os três da Condição 2 mudaram seus desempenhos verbais e não-verbais quando houve mudança nas contingências. Na Condição 3, os três participantes mudaram seus desempenhos quando houve mudança nas contingências e na Condição 4 dois dos três fizeram o mesmo. Sugere-se que a pergunta Tipo 2, em conjunção com a pergunta Tipo 1, contribuiu para a ocorrência de desempenhos verbais e não-verbais sensíveis às mudanças nas contingências quando o comportamento nãoverbal foi estabelecido por regra. Os resultados têm implicações para o esclarecimento do papel de perguntas na sensibilidade dos comportamentos verbais e não-verbais às mudanças nas contingências.

Video-based quantification of body movement during social interaction indicates the severity of negative symptoms in patients with schizophrenia

In schizophrenia, nonverbal behavior, including body movement, is of theoretical and clinical importance. Although reduced nonverbal expressiveness is a major component of the negative symptoms encountered in schizophrenia, few studies have objectively assessed body movement during social interaction. In the present study, 378 brief, videotaped role-play scenes involving 27 stabilized outpatients diagnosed with paranoid-type schizophrenia were analyzed using Motion Energy Analysis (MEA). This method enables the objective measuring of body movement in conjunction with ordinary video recordings. Correlations between movement parameters (percentage of time in movement, movement speed) and symptom ratings from independent PANSS interviews were calculated. Movement parameters proved to be highly reliable. In keeping with predictions, reduced movement and movement speed correlated with negative symptoms. Accordingly, in patients who exhibited noticeable movement for less than 20% of the observation time, prominent negative symptoms were highly probable. As a control measure, the percentage of movement exhibited by the patients during role-play scenes was compared to that of their normal interactants. Patients with negative symptoms differed from normal interactants by showing significantly reduced head and body movement. Two specific positive symptoms were possibly related to movement parameters: suspiciousness tended to correlate with reduced head movement, and the expression of unusual thought content tended to relate to increased movement. Overall, a close and theoretically meaningful association between the objective movement parameters and the symptom profiles was found. MEA appears to be an objective, reliable and valid method for quantifying nonverbal behavior, an aspect which may furnish new insights into the processes related to reduced expressiveness in schizophrenia.

Measurement and meaning of head movements in everyday face-to-face communicative interaction

Methodological approaches in which data on nonverbal behavior are collected usually involve interpretive methods in which raters must identify a set of defined categories of behavior. However, present knowledge about the qualitative aspects of head movement behavior calls for recording detailed transcriptions of behavior. These records are a prerequisite for investigating the function and meaning of head movement patterns. A method for directly collecting data on head movement behavior is introduced. Using small ultrasonic transducers, which are attached to various parts of an index person's body (head and shoulders), a microcomputer defines receiver-transducers distances. Three-dimensional positions are calculated by triangulation. These data are used for further calculations concerning the angular orientation of the head and the direction, size, and speed of head movements (in rotational, lateral, and sagittal dimensions).