Non-Verbal Categories. Analysis of an Galician Oral Narrative

Based on the concept of the triple basic structure of human communication by Poyatos (1994a, 1994b) and on the analytical and theoretical implications that derive from this, the present paper conceives the human communication as an indivisible whole in which verbal communication can not be separated from body behavior. This paper analyzes nonverbal categories used in oral communication. The corpus consists of an oral narration in Galician from which we highlighted certain kinemes (minimum units of body movement with meaning) by using the model proposed by Bouvet (2001), in order to explain the non-verbal categories with examples taken from said recordings.

Sense development through non verbal signs: early infancy and clinical psychoterapy

This thesis will describe the development of a relationship which is not necessarily verbal, but which generates communication, creates sense and meaning between human beings and produces “becomings” in the body that feels, perceives and physically transforms itself. This leads to a biosemiotic understanding of both the seen and unseen figure.

The use of non-verbal repair strategies by children with autism

This study examined possible links between the occurrence of prosodic changes to vocalizations and gestures and the use of problem behaviors by children with autism when attempting to repair communication breakdowns. The repair strategies of six children with autism aged 2-5 years and with fewer than 10 words or signs were analyzed. Mother-child dyads were videotaped at home interacting in naturally occurring contexts. Videotapes were analyzed and coded for communication breakdowns and repair attempts made by the child. Repairs were further analyzed according to the type of repair strategy used, changes in prosidy, and whether the repair mode involved problematic or non-problematic behavior. In most situations, this group of children attempted to repair breakdowns in communication that occurred while interacting with their mothers. Most children used both nonproblematic and problematic behaviors and were less likely to use augmentations as a repair strategy than repetitions and substitutions. Some repetitions and some augmentations involved the use of gestures or vocalizations with increased emphasis or prosidy. Possible links between repair strategies involving increased prosidy and the use of problem behaviors are discussed together with the implications and significance of these finding in relation to early intervention for children with significant communication impairments. (C) 2004 Elsevier Ltd. All rights reserved.

Non-verbal signalling in digital discourse:the case of letter repetition

This study focuses on the interactional functions of non-standard spelling, in particular letter repetition, used in text-based computer-mediated communication as a means of non-verbal signalling. The aim of this paper is to assess the current state of non-verbal cue research in computer-mediated discourse and demonstrate the need for a more comprehensive and methodologically rigorous exploration of written non-verbal signalling. The study proposes a contextual and usage-centered view of written paralanguage. Through illustrative, close linguistic analyses the study proves that previous approaches to non-standard spelling based on their relation to the spoken word might not account for the complexities of this CMC cue, and in order to further our understanding of their interactional functions it is more fruitful to describe the role they play during the contextualisation of the verbal messages. The interactional sociolinguistic approach taken in the analysis demonstrates the range of interactional functions letter repetition can achieve, including contribution to the inscription of socio-emotional information into writing, to the evoking of auditory cues or to a display of informality through using a relaxed writing style.

Learning Data-Driven Models of Non-Verbal Behaviors for Building Rapport Using an Intelligent Virtual Agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness. Evidence-based patient-centered Brief Motivational Interviewing (BMI) interven- tions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary. Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems. To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14].

Learning data-driven models of non-verbal behaviors for building rapport using an intelligent virtual agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness.^ Evidence-based patient-centered Brief Motivational Interviewing (BMI) interventions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary.^ Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems.^ To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14].^

Sistema de animação de personagens virtuais para comunicação não verbal

O principal objectivo da animação de personagens virtuais é o de contar uma história através da utilização de personagens virtuais emocionalmente expressivos. Os personagens têm personalidades distintas, e transmitem as suas emoções e processos de pensamento através dos seus comportamentos (comunicação não verbal). As suas acções muitas das vezes constituem a geração de movimentos corporais complexos. Existem diversas questões a considerar quando se anima uma entidade complexa, tais como, a posição das zonas móveis e as suas velocidades. Os personagens virtuais são um exemplo de entidades complexas e estão entre os elementos mais utilizados em animação computacional. O foco desta dissertação consistiu na criação de uma proposta de sistema de animação de personagens virtuais, cujos movimentos e expressões faciais são capazes de transmitir emoções e estados de espírito. Os movimentos primários, ou seja os movimentos que definem o comportamento dos personagens, são provenientes da captura de movimentos humanos (Motion Capture). As animações secundárias, tais como as expressões faciais, são criadas em Autodesk Maya recorrendo à técnica BlendShapes. Os dados obtidos pela captura de movimentos, são organizados numa biblioteca de comportamentos através de um grafo de movimentos, conhecido por Move Tree. Esta estrutura permite o controlo em tempo real dos personagens através da gestão do estado dos personagens. O sistema possibilita também a transição eficaz entre movimentos semelhantes e entre diferentes velocidades de locomoção, minimizando o efeito de arrastamento de pés conhecido como footskate. Torna-se assim possível definir um trajecto que o personagem poderá seguir com movimentos suaves. Estão também disponíveis os resultados obtidos nas sessões de avaliação realizadas, que visaram a determinação da qualidade das transições entre animações. Propõem-se ainda o melhoramento do sistema através da implementação da construção automática do grafo de movimentos.

Mediate evaluation of replicating a Training Program in Nonverbal Communication in Gerontology

OBJECTIVE Replicating the training program in non-verbal communication based on the theoretical framework of interpersonal communication; non-verbal coding, valuing the aging aspects in the perspective of active aging, checking its current relevance through the content assimilation index after 90 days (mediate) of its application. METHOD A descriptive and exploratory field study was conducted in three hospitals under direct administration of the state of São Paulo that caters exclusively to Unified Health System (SUS) patients. The training lasted 12 hours divided in three meetings, applied to 102 health professionals. RESULTS Revealed very satisfactory and satisfactory mediate content assimilation index in 82.9%. CONCLUSION The program replication proved to be relevant and updated the setting of hospital services, while remaining efficient for healthcare professionals.

Non-verbal behavioural patterns in trilogue play transitions and family alliances

This case study focuses on non-verbal behaviour in father-mother-infant triads. Analyses were done on transitional moments during which the partners exchanged an active role for a participant-observer role, or vice versa. Transitions are known to be crucial moments for revealing familial transactional mechanisms. Our sample was comprised of six non-clinical families, characterized by different types of functional or problematic alliances (which is the degree of coordination between the partners). Our methodology included micro-analysis of body and gaze formations, facial expressions, and so on. Data were analysed using the research package 'THEME' for the detection of hidden patterns. Different types of non-verbal patterns were found, which may be prototypes corresponding to the different types of alliance. The patterns of the families with high alliances had a more elaborate construction and were more efficient for the concluding of transitions than the patterns of families with low alliances, which were either elementary or laborious. (PsycINFO Database Record (c) 2006 APA, all rights reserved) (journal abstract)