Non-Verbal Categories. Analysis of an Galician Oral Narrative

Based on the concept of the triple basic structure of human communication by Poyatos (1994a, 1994b) and on the analytical and theoretical implications that derive from this, the present paper conceives the human communication as an indivisible whole in which verbal communication can not be separated from body behavior. This paper analyzes nonverbal categories used in oral communication. The corpus consists of an oral narration in Galician from which we highlighted certain kinemes (minimum units of body movement with meaning) by using the model proposed by Bouvet (2001), in order to explain the non-verbal categories with examples taken from said recordings.

Colours as Non-Verbal Signs on Packages

Colour is an essential aspect of our daily life, and still, it is a neglected issue within marketing research. The main reason for studying colours is to understand the impact of colours on consumer behaviour, and thus, colours should be studied when it comes to branding, advertising, packages, interiors, and the clothes of the employees, for example. This was an exploratory study about the impact of colours on packages. The focus was on low-involvement purchasing, where the consumer puts limited effort into the decision-making. The basis was a scenario in which the consumer faces an unpredictable problem needing immediate action. The consumer may be in hurry, which indicate time pressure. The consumer may lack brand preferences, or the preferred brand may be out of stock. The issue is that the choice is to be made at the point of purchase. Further, the purchasing involves product classes where the core products behind the brands are indistinguishable from each other. Three research questions were posed. Two questions were answered by conjoint analysis, i.e. if colours have an impact on decision-making and if a possible impact is related to the product class. 16 hypothetical packages were designed in two product classes within the healthcare, i.e. painkillers and medicine against sore throats. The last research question aimed at detecting how an analysis could be carried out in order to understand the impact of colours. This question was answered by conducting interviews that were analysed by applying laddering method and a semiotics approach. The study found that colours do indeed have an impact on consumer behaviour, this being related to the context, such as product class. The role of colours on packages was found to be threefold: attention, aesthetics, and communication. The study focused on colours as a means of communication, and it proposes that colours convey product, brand, and product class meanings, these meanings having an impact on consumers’ decision-making at the point of purchase. In addition, the study demonstrates how design elements such as colours can be understood by regarding them as non-verbal signs. The study also presents an empirical design, involving quantitative and qualitative techniques that can be used to gain in depth understanding of the impact of design elements on consumer behaviour. Hannele Kauppinen is associated with CERS, the Centre for Relationship Marketing and Service Management of the Swedish School of Economics and Business Administration

Sense development through non verbal signs: early infancy and clinical psychoterapy

This thesis will describe the development of a relationship which is not necessarily verbal, but which generates communication, creates sense and meaning between human beings and produces “becomings” in the body that feels, perceives and physically transforms itself. This leads to a biosemiotic understanding of both the seen and unseen figure.

The use of non-verbal repair strategies by children with autism

This study examined possible links between the occurrence of prosodic changes to vocalizations and gestures and the use of problem behaviors by children with autism when attempting to repair communication breakdowns. The repair strategies of six children with autism aged 2-5 years and with fewer than 10 words or signs were analyzed. Mother-child dyads were videotaped at home interacting in naturally occurring contexts. Videotapes were analyzed and coded for communication breakdowns and repair attempts made by the child. Repairs were further analyzed according to the type of repair strategy used, changes in prosidy, and whether the repair mode involved problematic or non-problematic behavior. In most situations, this group of children attempted to repair breakdowns in communication that occurred while interacting with their mothers. Most children used both nonproblematic and problematic behaviors and were less likely to use augmentations as a repair strategy than repetitions and substitutions. Some repetitions and some augmentations involved the use of gestures or vocalizations with increased emphasis or prosidy. Possible links between repair strategies involving increased prosidy and the use of problem behaviors are discussed together with the implications and significance of these finding in relation to early intervention for children with significant communication impairments. (C) 2004 Elsevier Ltd. All rights reserved.

Non-verbal signalling in digital discourse:the case of letter repetition

This study focuses on the interactional functions of non-standard spelling, in particular letter repetition, used in text-based computer-mediated communication as a means of non-verbal signalling. The aim of this paper is to assess the current state of non-verbal cue research in computer-mediated discourse and demonstrate the need for a more comprehensive and methodologically rigorous exploration of written non-verbal signalling. The study proposes a contextual and usage-centered view of written paralanguage. Through illustrative, close linguistic analyses the study proves that previous approaches to non-standard spelling based on their relation to the spoken word might not account for the complexities of this CMC cue, and in order to further our understanding of their interactional functions it is more fruitful to describe the role they play during the contextualisation of the verbal messages. The interactional sociolinguistic approach taken in the analysis demonstrates the range of interactional functions letter repetition can achieve, including contribution to the inscription of socio-emotional information into writing, to the evoking of auditory cues or to a display of informality through using a relaxed writing style.

Learning Data-Driven Models of Non-Verbal Behaviors for Building Rapport Using an Intelligent Virtual Agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness. Evidence-based patient-centered Brief Motivational Interviewing (BMI) interven- tions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary. Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems. To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14].

Learning data-driven models of non-verbal behaviors for building rapport using an intelligent virtual agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness.^ Evidence-based patient-centered Brief Motivational Interviewing (BMI) interventions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary.^ Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems.^ To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14].^

Emotional intelligence, personality and decoding non-verbal expressions of emotion

Previous research has highlighted theoretical and empirical links between measures of both personality and trait emotional intelligence (EI), and the ability to decode facial expressions of emotion. Research has also found that the posed, static characteristics of the photographic stimuli used to explore these links affects the decoding process and differentiates them from the natural expressions they represent. This undermines the ecological validity of established trait-emotion decoding relationships. This study addresses these methodological shortcomings by testing relationships between the reliability of participant ratings of dynamic, spontaneously elicited expressions of emotion with personality and trait EI. Fifty participants completed personality and self-report EI questionnaires, and used a computer-logging program to continuously rate change in emotional intensity expressed in video clips. Each clip was rated twice to obtain an intra-rater reliability score. The results provide limited support for links between both trait EI and personality variables and how reliably we decode natural expressions of emotion. Limitations and future directions are discussed.

Further refinement of the nature of the communication impairment in Cornelia de Lange syndrome

Purpose – Research into the communication skills of individuals with Cornelia de Lange syndrome (CdLS) is extremely limited. This paper aims to evaluate the nature of these skills and impairments in CdLS using a detailed informant assessment of pre-verbal communication skills.
Design/methodology/approach – The study used the Pre-verbal Communication Schedule to evaluate communication skills in individuals with CdLS (n ¼ 14), aged five to14 years. The group was compared with a contrast group of individuals with Cri du Chat syndrome (CdCS; n ¼ 14) who were matched for age and intellectual ability.
Findings – A significant difference was identified in understanding non-vocal communication (p , 0.005), with the CdLS group showing a greater deficit. These findings indicate the presence of a syndrome-specific deficit in understanding non-verbal communication in individuals with CdLS and suggest that there may be a dissociation between the processing of verbal and non-verbal communication.
Originality/value – The findings indicate that, in many ways, these two syndrome groups are not dissimilar in terms of their communication skills. However, individuals with CdLS show a syndrome-specific deficit in understanding non-vocal communication relative to the CdCS group.