Learning Data-Driven Models of Non-Verbal Behaviors for Building Rapport Using an Intelligent Virtual Agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness. Evidence-based patient-centered Brief Motivational Interviewing (BMI) interven- tions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary. Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems. To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14].

Learning data-driven models of non-verbal behaviors for building rapport using an intelligent virtual agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness.^ Evidence-based patient-centered Brief Motivational Interviewing (BMI) interventions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary.^ Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems.^ To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14].^

Factors associated with critical care nurses' communication with non-communicative patients in the ICU

Hospitalized individuals are isolated from their familiar environment at the onset of illness. Those individuals who are non-communicative are detached from the world and from life, as they previously knew it. Although nurses have long since recognized the importance of communication, patients still report the lack of iy. This study was done to identify factors influencing critical care nurses to communicate with their noncommunicative patients. The overall results of the study indicate that nurses are aware of the importance of verbal communication with patients who may be intubated, paralyzed, unconscious, comatose or neurologically impaired and are not deterred by them. Despite these results, some significant observations emerged identified. CCRN certified nurses and nurses with more years of experience were less likely to have verbal communication with noncommunicative patients. Nurses with children, spouses and those working full-time were more likely to communicate with non-communicative patients.

Detecting deception: Identifying differences in liars' and truth tellers' verbal strategies

Deception research has traditionally focused on three methods of identifying liars and truth tellers: observing non-verbal or behavioral cues, analyzing verbal cues, and monitoring changes in physiological arousal during polygraph tests. Research shows that observers are often incapable of discriminating between liars and truth tellers with better than chance accuracy when they use these methods. One possible explanation for observers' poor performance is that they are not properly applying existing lie detection methods. An alternative explanation is that the cues on which these methods — and observers' judgments — are based do not reliably discriminate between liars and truth tellers. It may be possible to identify more reliable cues, and potentially improve observers' ability to discriminate, by developing a better understanding of how liars and truth tellers try to tell a convincing story. ^ This research examined (a) the verbal strategies used by truthful and deceptive individuals during interviews concerning an assigned activity, and (b) observers' ability to discriminate between them based on their verbal strategies. In Experiment I, pre-interview instructions manipulated participants' expectations regarding verifiability; each participant was led to believe that the interviewer could check some types of details, but not others, before deciding whether the participant was being truthful or deceptive. Interviews were then transcribed and scored for quantity and type of information provided. In Experiment II, observers listened to a random sample of the Experiment I interviews and rendered veracity judgments; half of the observers were instructed to judge the interviews according to the verbal strategies used by liars and truth tellers and the other half were uninstructed. ^ Results of Experiment I indicate that liars and truth tellers use different verbal strategies, characterized by a differential amount of detail. Overall, truthful participants provided more information than deceptive participants. This effect was moderated by participants' expectations regarding verifiability such that truthful participants provided more information only with regard to verifiable details. Results of Experiment II indicate that observers instructed about liars' and truth tellers' verbal strategies identify them with greater accuracy than uninstructed observers. ^

Profiling The Campus Recruiter At A Four-Year Hospitality Program

Profiling the Campus Recruiter At a Four-Year Hospitality Program, is a written profile, supported by anecdotal rather than stridently empirical evidence, by Al lzzolo, Assistant Professor, College of Hotel Administration, University of Nevada, Las Vegas. “Each year major chain corporations as well as single unit companies interview hospitality students throughout the country. A study conducted at the University of Nevada, Las Vegas, was designed to profile the hospitality industry campus recruiter and to provide meaningful data to college students who would be interviewing with these recruiters,” the author initially proffers. “Recruiting at the four-year hospitality program, by its nature, is not a science, nor is it highly quantifiable. The interviewing and selection processes are highly subjective and vary from company to company,” says Izzolo to preface his essay. “Data were collected via a questionnaire specifically designed to answer questions about the recruiters and/or the companies that sent interviewers to the placement office of the university's hospitality program,” our author says to explain the process used to gather information for the piece. Findings of the study indicate that the typical recruiter is male, college educated – but not necessarily in a Hospitality’ curriculum – and almost 80 percent of respondents said they had the authority to hire management trainees. Few campuses are visited by hospitality industry recruitment staff as evidenced by Izzolo’s observations/data. Table 3 analyzes the desirable traits a recruiter deems appropriate for the potential employee candidate. Personal appearance, work experience, grade point average, and verbal communication rank high on the list of distinguishable attributes. The most striking finding in this portion of the study is that a student’s GPA is virtually ignored. “Recruiting for the hospitality industry appears to be very subjective,” Izzolo says. “Recruiters are basing decisions to hire not on knowledge levels as determined by an academic grade point average but rather on criteria much less definitive, such as verbal skills and personal appearance,” our author opines. In closing, Izzolo concedes this is not a definitive study, but is merely a launching pad to a more comprehensive investigation on the recruitment subject.

Interpersonal Techniques Boost your "Hospitality Batting Average"

The ability to listen and comprehend the intrinsic meaning behind the words people are saying is an important skill for those in the hospitality industry. The author provides some prescriptions for "winning friends and influencing people.”

The differential effects of *American and British trial proceedings on juror decision-making

Seven basic elements differentiate British from American trial procedures: confining attorneys to their tables; dealing with objections outside the presence of the jury; resolving disagreements between attorneys prior to objections being made; presenting the defense opening statement at the close of the prosecution case; the judge directly questions witnesses and has a wider latitude in controlling the evidence; and the judge gives a summation of all the evidence presented to the jury (Fulero & Turner, 1997). The present experiment examined the influence of these different courtroom procedures, judges' non-verbal behavior, and evidence strength on juror decision-making. Using models of persuasion to understand how the varying elements may effect juror decision-making, it was predicted that trials following American courtroom procedures would be more distracting for jurors and as such, they would be more likely to rely on the peripheral cue of the judge's expectations for trial outcome as expressed in his nonverbal behavior. In trials following British procedures jurors should be less distracted and better able to scrutinize the strength of the evidence that in turn should minimize the influence of the judge's nonverbal behavior. Two hundred forty-five participants viewed a mock civil trial in which courtroom procedure, judge's nonverbal behavior, and evidence strength were varied. Analyses suggest that courtroom procedure and evidence strength influenced the direction of participants' verdicts, but that judge's nonverbal behavior did not have a direct impact on verdict preference. Judge's nonverbal behavior appeared to influence other measures related to verdict. Participants were more confident in their verdicts when they agreed with judge's nonverbal behavior and when they viewed British courtroom procedures. Participants were more likely to return estimates of the defendant's liability that reflected judge's nonverbal behavior and a congruency with evidence strength. Participants also recalled more facts in the British conditions than in the American conditions. These findings are interpreted as indicating the importance of the impact of trial procedures and of nonverbal influence. ^

Drawing as a technique to facilitate childrens memory

This study examined a technique to assist children to recall more information about witnessed events. Thirty-eight fourth-grade children from a public grade school in Miami Florida participated in the experiment. The participants watched a Red Cross demonstration and were interviewed one week later about details of the demonstration. All of the children were interviewed using a police style interview. In addition, half of the children were instructed to draw during the interview. The current study supported previous findings that the instruction to draw increased the amount of information recalled. The effect of drawing was greatest for high-visual events. In addition, the instruction to draw prompted an increase in non-verbal information, which had an unusually high accuracy rate.

An Analysis of the Proposition Density, Sentence and Clause Types, and Non-Finite Verbal Usage in Two College Textbooks

This study investigated the proposition density, sentence and clause type usage and non-finite verbal usage in two college textbooks. The teaching implications are presented.

Evoking non-repertory verbal behavior across operant classes : the effects of motor echoic sign language training within the context of a motivating operation

The individual effects that echoic, mand, and sign language training procedures have on the acquisition of verbal behavior have been widely demonstrated, but more efficient strategies are still needed. This study combined all three treatment strategies into one treatment intervention in order to investigate the joint effects they may have on verbal behavior. Six participants took part in the study. Intervention totaled 1 hour/day for 5 days/week until mastery criterion for motor echoic behavior was achieved. Although motor echoic behavior were solely targeted for acquisition, significant increases in spontaneous motor mands were noted in all treatment participants. Additionally, 4 treatment participants also demonstrated significant gains in vocal echoics and spontaneous vocal mands. No significant increases were noted for the control participant. Results suggest that the aforementioned procedure may provide more efficient results as a first-step to teaching a functional repertoire of verbal behavior to developmentally delayed children.

Leadership in the Lodging and Non-Commercial Food Service Industries

The qualities of vision, communication, trust, and perseverance are strongly identified by leaders in the lodging and food service businesses as characterizing effective leaders. The authors report on their research into essential qualities which mark the innovative industry leader.

Medical advice and diabetes self-management reported by Mexican-American, Black- and White-non-Hispanic adults across the United States

Background Diabetes has reached epidemic proportions in the United States, particularly among minorities, and if improperly managed can lead to medical complications and death. Healthcare providers play vital roles in communicating standards of care, which include guidance on diabetes self-management. The background of the client may play a role in the patient-provider communication process. The aim of this study was to determine the association between medical advice and diabetes self care management behaviors for a nationally representative sample of adults with diabetes. Moreover, we sought to establish whether or not race/ethnicity was a modifier for reported medical advice received and diabetes self-management behaviors. Methods We analyzed data from 654 adults aged 21 years and over with diagnosed diabetes [130 Mexican-Americans; 224 Black non-Hispanics; and, 300 White non-Hispanics] and an additional 161 with 'undiagnosed diabetes' [N = 815(171 MA, 281 BNH and 364 WNH)] who participated in the National Health and Nutrition Examination Survey (NHANES) 2007-2008. Logistic regression models were used to evaluate whether medical advice to engage in particular self-management behaviors (reduce fat or calories, increase physical activity or exercise, and control or lose weight) predicted actually engaging in the particular behavior and whether the impact of medical advice on engaging in the behavior differed by race/ethnicity. Additional analyses examined whether these relationships were maintained when other factors potentially related to engaging in diabetes self management such as participants' diabetes education, sociodemographics and physical characteristics were controlled. Sample weights were used to account for the complex sample design. Results Although medical advice to the patient is considered a standard of care for diabetes, approximately one-third of the sample reported not receiving dietary, weight management, or physical activity self-management advice. Participants who reported being given medical advice for each specific diabetes self-management behaviors were 4-8 times more likely to report performing the corresponding behaviors, independent of race. These results supported the ecological model with certain caveats. Conclusions Providing standard medical advice appears to lead to diabetes self-management behaviors as reported by adults across the United States. Moreover, it does not appear that race/ethnicity influenced reporting performance of the standard diabetes self-management behavior. Longitudinal studies evaluating patient-provider communication, medical advice and diabetes self-management behaviors are needed to clarify our findings.

Medical Advice and Diabetes Self-Management Reported by Mexican-American, Black- and White-Non-Hispanic Adults Across the United States

Background: Diabetes has reached epidemic proportions in the United States, particularly among minorities, and if improperly managed can lead to medical complications and death. Healthcare providers play vital roles in communicating standards of care, which include guidance on diabetes self-management. The background of the client may play a role in the patient-provider communication process. The aim of this study was to determine the association between medical advice and diabetes self care management behaviors for a nationally representative sample of adults with diabetes. Moreover, we sought to establish whether or not race/ethnicity was a modifier for reported medical advice received and diabetes self-management behaviors. Methods: We analyzed data from 654 adults aged 21 years and over with diagnosed diabetes [130 MexicanAmericans; 224 Black non-Hispanics; and, 300 White non-Hispanics] and an additional 161 with ‘undiagnosed diabetes’ [N = 815(171 MA, 281 BNH and 364 WNH)] who participated in the National Health and Nutrition Examination Survey (NHANES) 2007-2008. Logistic regression models were used to evaluate whether medical advice to engage in particular self-management behaviors (reduce fat or calories, increase physical activity or exercise, and control or lose weight) predicted actually engaging in the particular behavior and whether the impact of medical advice on engaging in the behavior differed by race/ethnicity. Additional analyses examined whether these relationships were maintained when other factors potentially related to engaging in diabetes self management such as participants’ diabetes education, sociodemographics and physical characteristics were controlled. Sample weights were used to account for the complex sample design. Results: Although medical advice to the patient is considered a standard of care for diabetes, approximately onethird of the sample reported not receiving dietary, weight management, or physical activity self-management advice. Participants who reported being given medical advice for each specific diabetes self-management behaviors were 4-8 times more likely to report performing the corresponding behaviors, independent of race. These results supported the ecological model with certain caveats. Conclusions: Providing standard medical advice appears to lead to diabetes self-management behaviors as reported by adults across the United States. Moreover, it does not appear that race/ethnicity influenced reporting performance of the standard diabetes self-management behavior. Longitudinal studies evaluating patient-provider communication, medical advice and diabetes self-management behaviors are needed to clarify our findings.

Logical simulation of communication subsystem for Universal Serial Bus (USB)

The primary purpose of this thesis was to design a logical simulation of a communication sub block to be used in the effective communication of digital data between the host and the peripheral devices. The module designed is a Serial interface engine in the Universal Serial Bus that effectively controls the flow of data for communication between the host and the peripheral devices with the emphasis on the study of timing and control signals, considering the practical aspects of them. In this study an attempt was made to realize data communication in the hardware using the Verilog Hardware Description language, which is supported by most popular logic synthesis tools. Various techniques like Cyclic Redundancy Checks, bit-stuffing and Non Return to Zero are implemented in the design to provide enhanced performance of the module.

Mand – to Tact Training Transfer Acquisition Rates in Children Diagnosed with Autism Spectrum Disorder with Limited Verbal Skills

Autism Spectrum Disorder () is defined as “the presence of severe and pervasive impairments in reciprocal social interaction and in verbal and nonverbal communication skills” (Diagnostic & Statistical Manual, 2000). It is estimated that 1 in 68 children across the United States are diagnosed with ASD. One of the most common delays that children diagnosed with ASD experience are language delays. Children with ASD that have a language delay will often develop maladaptive behaviors as a result of poor communication skills (Carr & Durand, 1985). The failure to develop mand acquisition in typical fashion results in behaviors ranging from social withdrawal to self-injurious behaviors (Cooper et. al, 2007). A lack of a strong tact repertoire can further impede and complicate the learning of other necessary components of language due to the inability to successfully label items and events in the physical environment of the child. The purpose of this study is to replicate with a reversal in verbal operant training of the procedures described in Wallace et al. (2006) in which two children with ASD underwent tact training to facilitate the formation of mands; essentially this study aims to accomplish mand training first to establish as tact. It is hypothesized that mand training will result in a greater repertoire of tacts due to strength of the relationship between mands and the control over the social environment (Cooper et al., 2007). The two children in the study will be taught to mand items that will be ranked in order of preference via stimulus preference assessment. This study is of great importance due to the indispensable value of effective social communication skills. Data gathered on improving communication skills is of great value to the ASD community as the implications for functional skills result in better communication with family and greater control of individual functioning.