Learning Data-Driven Models of Non-Verbal Behaviors for Building Rapport Using an Intelligent Virtual Agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness. Evidence-based patient-centered Brief Motivational Interviewing (BMI) interven- tions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary. Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems. To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14].

Airline Deregulation, Computerized Reservation Systems, and Travel Agents

With the beginning of airline deregulations in 1978, U.S. domestic operations were in for a period of turmoil, adjustment, vibrancy, entrepreneurship, and change. A great deal has been written about the effects of deregulation on airlines and their personnel, and on the public at large. Less attention has been paid to the effects on travel agents and on the seminal role of computerized reservations systems (CRSs) in the flowering of travel agencies. This article examines both of these phenomena.

High natural gene expression variation in the reef-building coral Acropora millepora: potential for acclimative and adaptive plasticity

Background: Ecosystems worldwide are suffering the consequences of anthropogenic impact. The diverse ecosystem of coral reefs, for example, are globally threatened by increases in sea surface temperatures due to global warming. Studies to date have focused on determining genetic diversity, the sequence variability of genes in a species, as a proxy to estimate and predict the potential adaptive response of coral populations to environmental changes linked to climate changes. However, the examination of natural gene expression variation has received less attention. This variation has been implicated as an important factor in evolutionary processes, upon which natural selection can act. Results: We acclimatized coral nubbins from six colonies of the reef-building coral Acropora millepora to a common garden in Heron Island (Great Barrier Reef, GBR) for a period of four weeks to remove any site-specific environmental effects on the physiology of the coral nubbins. By using a cDNA microarray platform, we detected a high level of gene expression variation, with 17% (488) of the unigenes differentially expressed across coral nubbins of the six colonies (jsFDR-corrected, p < 0.01). Among the main categories of biological processes found differentially expressed were transport, translation, response to stimulus, oxidation-reduction processes, and apoptosis. We found that the transcriptional profiles did not correspond to the genotype of the colony characterized using either an intron of the carbonic anhydrase gene or microsatellite loci markers. Conclusion: Our results provide evidence of the high inter-colony variation in A. millepora at the transcriptomic level grown under a common garden and without a correspondence with genotypic identity. This finding brings to our attention the importance of taking into account natural variation between reef corals when assessing experimental gene expression differences. The high transcriptional variation detected in this study is interpreted and discussed within the context of adaptive potential and phenotypic plasticity of reef corals. Whether this variation will allow coral reefs to survive to current challenges remains unknown.

Integrated Performance Assessment of Engineering Projects at the Interface of Emergent Properties and Uncertainty

Investigation of the performance of engineering project organizations is critical for understanding and eliminating inefficiencies in today’s dynamic global markets. The existing theoretical frameworks consider project organizations as monolithic systems and attribute the performance of project organizations to the characteristics of the constituents. However, project organizations consist of complex interdependent networks of agents, information, and resources whose interactions give rise to emergent properties that affect the overall performance of project organizations. Yet, our understanding of the emergent properties in project organizations and their impact on project performance is rather limited. This limitation is one of the major barriers towards creation of integrated theories of performance assessment in project organizations. The objective of this paper is to investigate the emergent properties that affect the ability of project organization to cope with uncertainty. Based on the theories of complex systems, we propose and test a novel framework in which the likelihood of performance variations in project organizations could be investigated based on the environment of uncertainty (i.e., static complexity, dynamic complexity, and external source of disruption) as well as the emergent properties (i.e., absorptive capacity, adaptive capacity, and restorative capacity) of project organizations. The existence and significance of different dimensions of the environment of uncertainty and emergent properties in the proposed framework are tested based on the analysis of the information collected from interviews with senior project managers in the construction industry. The outcomes of this study provide a novel theoretical lens for proactive bottom-up investigation of performance in project organizations at the interface of emergent properties and uncertainty

Learning data-driven models of non-verbal behaviors for building rapport using an intelligent virtual agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness.^ Evidence-based patient-centered Brief Motivational Interviewing (BMI) interventions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary.^ Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems.^ To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14].^

The development, application, and implications of a strategy for reflective learning from experience

The problem on which this study focused was individuals' reduced capacity to respond to change and to engage in innovative learning when their reflective learning skills are limited. In this study, the preceding problem was addressed by two primary questions: To what degree can mastery of a strategy for reflective learning be facilitated as a part of an academic curriculum for professional practitioners? What impact will mastery of this strategy have on the learning style and adaptive flexibility of adult learners? The focus of the study was a direct application of human resource development technology in the professional preparation of teachers. The background of the problem in light of changing global paradigms and educational action orientations was outlined and a review of the literature was provided. Roots of thought for two key concepts (i.e., learning to learn from experience and meaningful reflection in learning) were traced. Reflective perspectives from the work of eight researchers were compared. A meta-model of learning from experience drawn from the literature served as a conceptual framework for the study. A strategy for reflective learning developed from this meta-model was taught to 109 teachers-in-training at Florida International University in Miami, Florida. Kolb's Adaptive Style Inventory and Learning Style Inventory were administered to the treatment group and to two control groups taught by the same professor. Three research questions and fourteen hypotheses guided data analysis. Qualitative review of 1565 personal documents generated by the treatment group indicated that 77 students demonstrated "double-loop" learning, going beyond previously established limits to perception, understanding, or action. The mean score for depth of reflection indicated "single-loop" learning with "reflection-in-action" present. The change in the mean score for depth of reflection from the beginning to end of the study was statistically significant (p $<$.05). On quantitative measures of adaptive flexibility and learning style, with two exceptions, there were no significant differences noted between treatment and control groups on pre-test to post-test differences and on post-test mean scores adjusted for pre-test responses and demographic variables. Conclusions were drawn regarding treatment, instrumentation, and application of the strategy and the meta-model. Implications of the strategy and the meta-model for research, for education, for human resource development, for professional practice, and for personal growth were suggested. Qualitative training materials and Kolb's instruments were provided in the appendices.

Integration and querying of heterogeneous, autonomous, distributed database systems

Today, databases have become an integral part of information systems. In the past two decades, we have seen different database systems being developed independently and used in different applications domains. Today's interconnected networks and advanced applications, such as data warehousing, data mining & knowledge discovery and intelligent data access to information on the Web, have created a need for integrated access to such heterogeneous, autonomous, distributed database systems. Heterogeneous/multidatabase research has focused on this issue resulting in many different approaches. However, a single, generally accepted methodology in academia or industry has not emerged providing ubiquitous intelligent data access from heterogeneous, autonomous, distributed information sources. ^ This thesis describes a heterogeneous database system being developed at High-performance Database Research Center (HPDRC). A major impediment to ubiquitous deployment of multidatabase technology is the difficulty in resolving semantic heterogeneity. That is, identifying related information sources for integration and querying purposes. Our approach considers the semantics of the meta-data constructs in resolving this issue. The major contributions of the thesis work include: (i) providing a scalable, easy-to-implement architecture for developing a heterogeneous multidatabase system, utilizing Semantic Binary Object-oriented Data Model (Sem-ODM) and Semantic SQL query language to capture the semantics of the data sources being integrated and to provide an easy-to-use query facility; (ii) a methodology for semantic heterogeneity resolution by investigating into the extents of the meta-data constructs of component schemas. This methodology is shown to be correct, complete and unambiguous; (iii) a semi-automated technique for identifying semantic relations, which is the basis of semantic knowledge for integration and querying, using shared ontologies for context-mediation; (iv) resolutions for schematic conflicts and a language for defining global views from a set of component Sem-ODM schemas; (v) design of a knowledge base for storing and manipulating meta-data and knowledge acquired during the integration process. This knowledge base acts as the interface between integration and query processing modules; (vi) techniques for Semantic SQL query processing and optimization based on semantic knowledge in a heterogeneous database environment; and (vii) a framework for intelligent computing and communication on the Internet applying the concepts of our work. ^

VHITS: Vertical handoff initiation and target selection in a heterogeneous wireless network

Global connectivity, for anyone, at anyplace, at anytime, to provide high-speed, high-quality, and reliable communication channels for mobile devices, is now becoming a reality. The credit mainly goes to the recent technological advances in wireless communications comprised of a wide range of technologies, services, and applications to fulfill the particular needs of end-users in different deployment scenarios (Wi-Fi, WiMAX, and 3G/4G cellular systems). In such a heterogeneous wireless environment, one of the key ingredients to provide efficient ubiquitous computing with guaranteed quality and continuity of service is the design of intelligent handoff algorithms. Traditional single-metric handoff decision algorithms, such as Received Signal Strength (RSS) based, are not efficient and intelligent enough to minimize the number of unnecessary handoffs, decision delays, and call-dropping and/or blocking probabilities. This research presented a novel approach for the design and implementation of a multi-criteria vertical handoff algorithm for heterogeneous wireless networks. Several parallel Fuzzy Logic Controllers were utilized in combination with different types of ranking algorithms and metric weighting schemes to implement two major modules: the first module estimated the necessity of handoff, and the other module was developed to select the best network as the target of handoff. Simulations based on different traffic classes, utilizing various types of wireless networks were carried out by implementing a wireless test-bed inspired by the concept of Rudimentary Network Emulator (RUNE). Simulation results indicated that the proposed scheme provided better performance in terms of minimizing the unnecessary handoffs, call dropping, and call blocking and handoff blocking probabilities. When subjected to Conversational traffic and compared against the RSS-based reference algorithm, the proposed scheme, utilizing the FTOPSIS ranking algorithm, was able to reduce the average outage probability of MSs moving with high speeds by 17%, new call blocking probability by 22%, the handoff blocking probability by 16%, and the average handoff rate by 40%. The significant reduction in the resulted handoff rate provides MS with efficient power consumption, and more available battery life. These percentages indicated a higher probability of guaranteed session continuity and quality of the currently utilized service, resulting in higher user satisfaction levels.

Covalent protein adduction of nitrogen mustards and related compounds

Chemical warfare agents continue to pose a global threat despite the efforts of the international community to prohibit their use in warfare. For this reason, improvement in the detection of these compounds remains of forensic interest. Protein adducts formed by the covalent modification of an electrophilic xenobiotic and a nucleophilic amino acid may provide a biomarker of exposure that is stable and specific to compounds of interest (such as chemical warfare agents), and have the capability to extend the window of detection further than the parent compound or circulating metabolites. This research investigated the formation of protein adducts of the nitrogen mustard chemical warfare agents mechlorethamine (HN-2) and tris(2-chloroethyl)amine (HN-3) to lysine and histidine residues found on the blood proteins hemoglobin and human serum albumin. Identified adducts were assessed for reproducibility and stability both in model peptide and whole protein assays. Specificity of these identified adducts was assessed using in vitro assays to metabolize common therapeutic drugs containing nitrogen mustard moieties. Results of the model peptide assays demonstrated that HN-2 and HN-3 were able to form stable adducts with lysine and histidine residues under physiological conditions. Results for whole protein assays identified three histidine adducts on hemoglobin, and three adducts (two lysine residues and one histidine residue) on human serum albumin that were previously unknown. These protein adducts were determined to be reproducible and stable at physiological conditions over a three-week analysis period. Results from the in vitro metabolic assays revealed that adducts formed by HN-2 and HN-3 are specific to these agents, as metabolized therapeutic drugs (chlorambucil, cyclophosphamide, and melphalan) did not form the same adducts on lysine or histidine residues as the previously identified adducts formed by HN-2 and HN-3. Results obtained from the model peptide and full protein work were enhanced by comparing experimental data to theoretical calculations for adduct formation, providing further confirmatory data. This project was successful in identifying and characterizing biomarkers of exposure to HN-2 and HN-3 that are specific and stable and which have the potential to be used for the forensic determination of exposure to these dangerous agents.

Racialized sexualities within the romance tour industry: The influence of affect and emotion upon transnational hierarchies of desire

Online international introduction sites that offer romance tours to American men in search of a foreign bride are an important and rapidly growing component of the internet dating industry; the number of these agencies in the U.S. tripled from two hundred to six hundred in the past 10 years. Previous scholars have examined the so-called `mail order bride' industry in order to demonstrate that the women involved are agents and not victims. Many scholars have also highlighted the importance of race in shaping American men's desires in one particular region or country. My dissertation provides an important addition to the literature surrounding romance tourism by including participants from all three major regions associated with romance tourism: Eastern Europe, South America, and Southeast Asia. I collected the data for the dissertation by becoming a participant observer of a romance tour in Ukraine, Colombia, and the Philippines. I argue that romance tourism is an important example of the global intimate, and the ways in which globalized processes are created and sustained through everyday intimate emotions and interactions. By examining the ways in which the emotions of desire, disgust, and anxiety influence individual romance tour participant's constructions of racialized hierarchies, the links between individual emotions and global systems are revealed. The concept of the global intimate challenges the hierarchy of scale that places the body, the home, and the intimate on a much lower level than the scale of the global or the national, and at the same time challenges the binary that divides the individual from the global. Through highlighting the different emotional negotiations that are constantly occurring in the romance tour industry, I highlight the important ways in which individual emotions and affects influence global processes on a large scale and vice versa.^

Managing small-scale commercial fisheries for adaptive capacity: Insights from dynamic social-ecological drivers of change in Monterey Bay

Globally, small-scale fisheries (SSFs) are driven by climate, governance, and market factors of social-ecological change, presenting both challenges and opportunities. The ability of small-scale fishermen and buyers to adapt to changing conditions allows participants to survive economic or environmental disturbances and to benefit from optimal conditions. This study presented here identifies key large-scale factors that drive SSFs in California to shift focus among targets and that dictate long-term trends in landings. We use Elinor Ostrom’s Social-Ecological System (SES) framework to apply an interdisciplinary approach when identifying potential factors and when understanding the complex dynamics of these fisheries. We analyzed the interactions among Monterey Bay SSFs over the past four decades since the passage of the Magnuson Stevens Fisheries Conservation and Management Act of 1976. In this region, the Pacific sardine (Sardinops sagax), northern anchovy (Engraulis mordax), and market squid (Loligo opalescens) fisheries comprise a tightly linked system where shifting focus among fisheries is a key element to adaptive capacity and reduced social and ecological vulnerability. Using a cluster analysis of landings, we identified four modes from 1974 to 2012 that were dominated by squid, sardine, anchovy, or lacked any dominance, enabling us to identify external drivers attributed to a change in fishery dominance during seven distinct transition points. Overall, we show that market and climate factors drive the transitions among dominance modes. Governance phases most dictated long-term trends in landings and are best viewed as a response to changes in perceived biomass and thus a proxy for biomass. Our findings suggest that globally, small-scale fishery managers should consider enabling shifts in effort among fisheries and retaining existing flexibility, as adaptive capacity is a critical determinant for social and ecological resilience.

Integration and querying of heterogeneous, autonomous, distributed database systems

Today, databases have become an integral part of information systems. In the past two decades, we have seen different database systems being developed independently and used in different applications domains. Today's interconnected networks and advanced applications, such as data warehousing, data mining & knowledge discovery and intelligent data access to information on the Web, have created a need for integrated access to such heterogeneous, autonomous, distributed database systems. Heterogeneous/multidatabase research has focused on this issue resulting in many different approaches. However, a single, generally accepted methodology in academia or industry has not emerged providing ubiquitous intelligent data access from heterogeneous, autonomous, distributed information sources. This thesis describes a heterogeneous database system being developed at Highperformance Database Research Center (HPDRC). A major impediment to ubiquitous deployment of multidatabase technology is the difficulty in resolving semantic heterogeneity. That is, identifying related information sources for integration and querying purposes. Our approach considers the semantics of the meta-data constructs in resolving this issue. The major contributions of the thesis work include: (i.) providing a scalable, easy-to-implement architecture for developing a heterogeneous multidatabase system, utilizing Semantic Binary Object-oriented Data Model (Sem-ODM) and Semantic SQL query language to capture the semantics of the data sources being integrated and to provide an easy-to-use query facility; (ii.) a methodology for semantic heterogeneity resolution by investigating into the extents of the meta-data constructs of component schemas. This methodology is shown to be correct, complete and unambiguous; (iii.) a semi-automated technique for identifying semantic relations, which is the basis of semantic knowledge for integration and querying, using shared ontologies for context-mediation; (iv.) resolutions for schematic conflicts and a language for defining global views from a set of component Sem-ODM schemas; (v.) design of a knowledge base for storing and manipulating meta-data and knowledge acquired during the integration process. This knowledge base acts as the interface between integration and query processing modules; (vi.) techniques for Semantic SQL query processing and optimization based on semantic knowledge in a heterogeneous database environment; and (vii.) a framework for intelligent computing and communication on the Internet applying the concepts of our work.

Racialized Sexualities within the Romance Tour Industry: the Influence of Affect and Emotion Upon Transnational Hierarchies of Desire

Online international introduction sites that offer romance tours to American men in search of a foreign bride are an important and rapidly growing component of the internet dating industry; the number of these agencies in the U.S. tripled from two hundred to six hundred in the past 10 years. Previous scholars have examined the so-called ‘mail order bride’ industry in order to demonstrate that the women involved are agents and not victims. Many scholars have also highlighted the importance of race in shaping American men’s desires in one particular region or country. My dissertation provides an important addition to the literature surrounding romance tourism by including participants from all three major regions associated with romance tourism: Eastern Europe, South America, and Southeast Asia. I collected the data for the dissertation by becoming a participant observer of a romance tour in Ukraine, Colombia, and the Philippines. I argue that romance tourism is an important example of the global intimate, and the ways in which globalized processes are created and sustained through everyday intimate emotions and interactions. By examining the ways in which the emotions of desire, disgust, and anxiety influence individual romance tour participant’s constructions of racialized hierarchies, the links between individual emotions and global systems are revealed. The concept of the global intimate challenges the hierarchy of scale that places the body, the home, and the intimate on a much lower level than the scale of the global or the national, and at the same time challenges the binary that divides the individual from the global. Through highlighting the different emotional negotiations that are constantly occurring in the romance tour industry, I highlight the important ways in which individual emotions and affects influence global processes on a large scale and vice versa.