Learning data-driven models of non-verbal behaviors for building rapport using an intelligent virtual agent

There is a growing societal need to address the increasing prevalence of behavioral health issues, such as obesity, alcohol or drug use, and general lack of treatment adherence for a variety of health problems. The statistics, worldwide and in the USA, are daunting. Excessive alcohol use is the third leading preventable cause of death in the United States (with 79,000 deaths annually), and is responsible for a wide range of health and social problems. On the positive side though, these behavioral health issues (and associated possible diseases) can often be prevented with relatively simple lifestyle changes, such as losing weight with a diet and/or physical exercise, or learning how to reduce alcohol consumption. Medicine has therefore started to move toward finding ways of preventively promoting wellness, rather than solely treating already established illness.^ Evidence-based patient-centered Brief Motivational Interviewing (BMI) interventions have been found particularly effective in helping people find intrinsic motivation to change problem behaviors after short counseling sessions, and to maintain healthy lifestyles over the long-term. Lack of locally available personnel well-trained in BMI, however, often limits access to successful interventions for people in need. To fill this accessibility gap, Computer-Based Interventions (CBIs) have started to emerge. Success of the CBIs, however, critically relies on insuring engagement and retention of CBI users so that they remain motivated to use these systems and come back to use them over the long term as necessary.^ Because of their text-only interfaces, current CBIs can therefore only express limited empathy and rapport, which are the most important factors of health interventions. Fortunately, in the last decade, computer science research has progressed in the design of simulated human characters with anthropomorphic communicative abilities. Virtual characters interact using humans’ innate communication modalities, such as facial expressions, body language, speech, and natural language understanding. By advancing research in Artificial Intelligence (AI), we can improve the ability of artificial agents to help us solve CBI problems.^ To facilitate successful communication and social interaction between artificial agents and human partners, it is essential that aspects of human social behavior, especially empathy and rapport, be considered when designing human-computer interfaces. Hence, the goal of the present dissertation is to provide a computational model of rapport to enhance an artificial agent’s social behavior, and to provide an experimental tool for the psychological theories shaping the model. Parts of this thesis were already published in [LYL+12, AYL12, AL13, ALYR13, LAYR13, YALR13, ALY14].^

Predicting room occupancy with a single passive infrared (PIR) sensor through behavior extraction

Passive infrared sensors have widespread use in many applications, including motion detectors for alarms, lighting systems and hand dryers. Combinations of multiple PIR sensors have also been used to count the number of humans passing through doorways. In this paper, we demonstrate the potential of the PIR sensor as a tool for occupancy estimation inside of a monitored environment. Our approach shows how flexible nonparametric machine learning algorithms extract useful information about the occupancy from a single PIR sensor. The approach allows us to understand and make use of the motion patterns generated by people within the monitored environment. The proposed counting system uses information about those patterns to provide an accurate estimate of room occupancy which can be updated every 30 seconds. The system was successfully tested on data from more than 50 real office meetings consisting of at most 14 room occupants.

Machine Learning Unsupervised Methods in the Design of an On-board Health Monitoring System for Satellite Applications

The dissertation starts by providing a description of the phenomena related to the increasing importance recently acquired by satellite applications. The spread of such technology comes with implications, such as an increase in maintenance cost, from which derives the interest in developing advanced techniques that favor an augmented autonomy of spacecrafts in health monitoring. Machine learning techniques are widely employed to lay a foundation for effective systems specialized in fault detection by examining telemetry data. Telemetry consists of a considerable amount of information; therefore, the adopted algorithms must be able to handle multivariate data while facing the limitations imposed by on-board hardware features. In the framework of outlier detection, the dissertation addresses the topic of unsupervised machine learning methods. In the unsupervised scenario, lack of prior knowledge of the data behavior is assumed. In the specific, two models are brought to attention, namely Local Outlier Factor and One-Class Support Vector Machines. Their performances are compared in terms of both the achieved prediction accuracy and the equivalent computational cost. Both models are trained and tested upon the same sets of time series data in a variety of settings, finalized at gaining insights on the effect of the increase in dimensionality. The obtained results allow to claim that both models, combined with a proper tuning of their characteristic parameters, successfully comply with the role of outlier detectors in multivariate time series data. Nevertheless, under this specific context, Local Outlier Factor results to be outperforming One-Class SVM, in that it proves to be more stable over a wider range of input parameter values. This property is especially valuable in unsupervised learning since it suggests that the model is keen to adapting to unforeseen patterns.

Integrating Machine Learning Paradigms for Predictive Maintenance in the Fourth Industrial Revolution era

In the last decade, manufacturing companies have been facing two significant challenges. First, digitalization imposes adopting Industry 4.0 technologies and allows creating smart, connected, self-aware, and self-predictive factories. Second, the attention on sustainability imposes to evaluate and reduce the impact of the implemented solutions from economic and social points of view. In manufacturing companies, the maintenance of physical assets assumes a critical role. Increasing the reliability and the availability of production systems leads to the minimization of systems’ downtimes; In addition, the proper system functioning avoids production wastes and potentially catastrophic accidents. Digitalization and new ICT technologies have assumed a relevant role in maintenance strategies. They allow assessing the health condition of machinery at any point in time. Moreover, they allow predicting the future behavior of machinery so that maintenance interventions can be planned, and the useful life of components can be exploited until the time instant before their fault. This dissertation provides insights on Predictive Maintenance goals and tools in Industry 4.0 and proposes a novel data acquisition, processing, sharing, and storage framework that addresses typical issues machine producers and users encounter. The research elaborates on two research questions that narrow down the potential approaches to data acquisition, processing, and analysis for fault diagnostics in evolving environments. The research activity is developed according to a research framework, where the research questions are addressed by research levers that are explored according to research topics. Each topic requires a specific set of methods and approaches; however, the overarching methodological approach presented in this dissertation includes three fundamental aspects: the maximization of the quality level of input data, the use of Machine Learning methods for data analysis, and the use of case studies deriving from both controlled environments (laboratory) and real-world instances.

Data surveillance for infectious diseases: models, complex networks and machine learning

In this thesis, we investigate the role of applied physics in epidemiological surveillance through the application of mathematical models, network science and machine learning. The spread of a communicable disease depends on many biological, social, and health factors. The large masses of data available make it possible, on the one hand, to monitor the evolution and spread of pathogenic organisms; on the other hand, to study the behavior of people, their opinions and habits. Presented here are three lines of research in which an attempt was made to solve real epidemiological problems through data analysis and the use of statistical and mathematical models. In Chapter 1, we applied language-inspired Deep Learning models to transform influenza protein sequences into vectors encoding their information content. We then attempted to reconstruct the antigenic properties of different viral strains using regression models and to identify the mutations responsible for vaccine escape. In Chapter 2, we constructed a compartmental model to describe the spread of a bacterium within a hospital ward. The model was informed and validated on time series of clinical measurements, and a sensitivity analysis was used to assess the impact of different control measures. Finally (Chapter 3) we reconstructed the network of retweets among COVID-19 themed Twitter users in the early months of the SARS-CoV-2 pandemic. By means of community detection algorithms and centrality measures, we characterized users’ attention shifts in the network, showing that scientific communities, initially the most retweeted, lost influence over time to national political communities. In the Conclusion, we highlighted the importance of the work done in light of the main contemporary challenges for epidemiological surveillance. In particular, we present reflections on the importance of nowcasting and forecasting, the relationship between data and scientific research, and the need to unite the different scales of epidemiological surveillance.

A deep learning model via thermodynamics and condensed matter physics

Deep Learning architectures give brilliant results in a large variety of fields, but a comprehensive theoretical description of their inner functioning is still lacking. In this work, we try to understand the behavior of neural networks by modelling in the frameworks of Thermodynamics and Condensed Matter Physics. We approach neural networks as in a real laboratory and we measure the frequency spectrum and the entropy of the weights of the trained model. The stochasticity of the training occupies a central role in the dynamics of the weights and makes it difficult to assimilate neural networks to simple physical systems. However, the analogy with Thermodynamics and the introduction of a well defined temperature leads us to an interesting result: if we eliminate from a CNN the "hottest" filters, the performance of the model remains the same, whereas, if we eliminate the "coldest" ones, the performance gets drastically worst. This result could be exploited in the realization of a training loop which eliminates the filters that do not contribute to loss reduction. In this way, the computational cost of the training will be lightened and more importantly this would be done by following a physical model. In any case, beside important practical applications, our analysis proves that a new and improved modeling of Deep Learning systems can pave the way to new and more efficient algorithms.

Synthetic data generation for the assessment of antimicrobial resistance through machine learning

As a consequence of the diffusion of next generation sequencing techniques, metagenomics databases have become one of the most promising repositories of information about features and behavior of microorganisms. One of the subjects that can be studied from those data are bacteria populations. Next generation sequencing techniques allow to study the bacteria population within an environment by sampling genetic material directly from it, without the needing of culturing a similar population in vitro and observing its behavior. As a drawback, it is quite complex to extract information from those data and usually there is more than one way to do that; AMR is no exception. In this study we will discuss how the quantified AMR, which regards the genotype of the bacteria, can be related to the bacteria phenotype and its actual level of resistance against the specific substance. In order to have a quantitative information about bacteria genotype, we will evaluate the resistome from the read libraries, aligning them against CARD database. With those data, we will test various machine learning algorithms for predicting the bacteria phenotype. The samples that we exploit should resemble those that could be obtained from a natural context, but are actually produced by a read libraries simulation tool. In this way we are able to design the populations with bacteria of known genotype, so that we can relay on a secure ground truth for training and testing our algorithms.

Discovery Of A Rare Pterosaur Bone Bed In A Cretaceous Desert With Insights On Ontogeny And Behavior Of Flying Reptiles.

A pterosaur bone bed with at least 47 individuals (wing spans: 0.65-2.35 m) of a new species is reported from southern Brazil from an interdunal lake deposit of a Cretaceous desert, shedding new light on several biological aspects of those flying reptiles. The material represents a new pterosaur, Caiuajara dobruskii gen. et sp. nov., that is the southermost occurrence of the edentulous clade Tapejaridae (Tapejarinae, Pterodactyloidea) recovered so far. Caiuajara dobruskii differs from all other members of this clade in several cranial features, including the presence of a ventral sagittal bony expansion projected inside the nasoantorbital fenestra, which is formed by the premaxillae; and features of the lower jaw, like a marked rounded depression in the occlusal concavity of the dentary. Ontogenetic variation of Caiuajara dobruskii is mainly reflected in the size and inclination of the premaxillary crest, changing from small and inclined (∼ 115°) in juveniles to large and steep (∼ 90°) in adults. No particular ontogenetic features are observed in postcranial elements. The available information suggests that this species was gregarious, living in colonies, and most likely precocial, being able to fly at a very young age, which might have been a general trend for at least derived pterosaurs.

Bile And Liver Metallothionein Behavior In Copper-exposed Fish.

The present study analyzed metallothionein (MT) excretion from liver to bile in Nile Tilapia (Oreochromis niloticus) exposed to sub-lethal copper concentrations (2mgL(-1)) in a laboratory setting. MTs in liver and bile were quantified by spectrophotometry after thermal incubation and MT metal-binding profiles were characterized by size exclusion high performance liquid chromatography coupled to ICP-MS (SEC-HPLC-ICP-MS). Results show that liver MT is present in approximately 250-fold higher concentrations than bile MT in non-exposed fish. Differences between the MT profiles from the control and exposed group were observed for both matrices, indicating differential metal-binding behavior when comparing liver and bile MT. This is novel data regarding intra-organ MT comparisons, since differences between organs are usually present only with regard to quantification, not metal-binding behavior. Bile MT showed statistically significant differences between the control and exposed group, while the same did not occur with liver MT. This indicates that MTs synthesized in the liver accumulate more slowly than MTs excreted from liver to bile, since the same fish presented significantly higher MT levels in liver when compared to bile. We postulate that bile, although excreted in the intestine and partially reabsorbed by the same returning to the liver, may also release MT-bound metals more rapidly and efficiently, which may indicate an efficient detoxification route. Thus, we propose that the analysis of bile MTs to observe recent metal exposure may be more adequate than the analysis of liver MTs, since organism responses to metals are more quickly observed in bile, although further studies are necessary.

[the Perception Of Behavior Related To Mindfulness And The Brazilian Version Of The Freiburg Mindfulness Inventory].

Mindfulness is a practice and a form of consciousness which has been the basis for innovative interventions in care and health promotion. This study presents mindfulness, describes and discusses the process of cultural adaptation of The Freiburg Mindfulness Inventory (FMI) to Brazilian Portuguese. From the original version of this pioneering instrument for assessing mindfulness two translations and two back-translations were made. These were evaluated by a committee of 14 experts (Buddhists, linguists, health professionals), who helped to create two versions for the first pre-test, based on which suggestions were made by a sample of 41 people of the population through interviews. Considering the difficulties in understanding the concepts that are unfamiliar to the Brazilian culture, a new version was prepared with additional explanations, which underwent a further evaluation of the experts and a second pre-test with 72 people. This process aimed at addressing the limitations and challenges of evaluating mindfulness in a country of western culture through a self-report instrument based on Buddhist psychology. With appropriate levels of clarity and equivalence with the original instrument, the Freiburg Mindfulness Inventory adapted for Brazil is presented.

Beliefs Related To Adherence To Oral Antidiabetic Treatment According To The Theory Of Planned Behavior.

to identify salient behavioral, normative, control and self-efficacy beliefs related to the behavior of adherence to oral antidiabetic agents, using the Theory of Planned Behavior. cross-sectional, exploratory study with 17 diabetic patients in chronic use of oral antidiabetic medication and in outpatient follow-up. Individual interviews were recorded, transcribed and content-analyzed using pre-established categories. behavioral beliefs concerning advantages and disadvantages of adhering to medication emerged, such as the possibility of avoiding complications from diabetes, preventing or delaying the use of insulin, and a perception of side effects. The children of patients and physicians are seen as important social references who influence medication adherence. The factors that facilitate adherence include access to free-of-cost medication and taking medications associated with temporal markers. On the other hand, a complex therapeutic regimen was considered a factor that hinders adherence. Understanding how to use medication and forgetfulness impact the perception of patients regarding their ability to adhere to oral antidiabetic agents. medication adherence is a complex behavior permeated by behavioral, normative, control and self-efficacy beliefs that should be taken into account when assessing determinants of behavior.

Changes In Motor Behavior During Pregnancy In Rats: The Basis For A Possible Animal Model Of Restless Legs Syndrome.

Pregnant women have a 2-3 fold higher probability of developing restless legs syndrome (RLS - sleep-related movement disorders) than general population. This study aims to evaluate the behavior and locomotion of rats during pregnancy in order to verify if part of these animals exhibit some RLS-like features. We used 14 female 80-day-old Wistar rats that weighed between 200 and 250 g. The rats were distributed into control (CTRL) and pregnant (PN) groups. After a baseline evaluation of their behavior and locomotor activity in an open-field environment, the PN group was inducted into pregnancy, and their behavior and locomotor activity were evaluated on days 3, 10 and 19 of pregnancy and in the post-lactation period in parallel with the CTRL group. The serum iron and transferrin levels in the CTRL and PN groups were analyzed in blood collected after euthanasia by decapitation. There were no significant differences in the total ambulation, grooming events, fecal boli or urine pools between the CTRL and PN groups. However, the PN group exhibited fewer rearing events, increased grooming time and reduced immobilization time than the CTRL group (ANOVA, p<0.05). These results suggest that pregnant rats show behavioral and locomotor alterations similar to those observed in animal models of RLS, demonstrating to be a possible animal model of this sleep disorder.

Ecological Literacy And Beyond: Problem-based Learning For Future Professionals.

Ecological science contributes to solving a broad range of environmental problems. However, lack of ecological literacy in practice often limits application of this knowledge. In this paper, we highlight a critical but often overlooked demand on ecological literacy: to enable professionals of various careers to apply scientific knowledge when faced with environmental problems. Current university courses on ecology often fail to persuade students that ecological science provides important tools for environmental problem solving. We propose problem-based learning to improve the understanding of ecological science and its usefulness for real-world environmental issues that professionals in careers as diverse as engineering, public health, architecture, social sciences, or management will address. Courses should set clear learning objectives for cognitive skills they expect students to acquire. Thus, professionals in different fields will be enabled to improve environmental decision-making processes and to participate effectively in multidisciplinary work groups charged with tackling environmental issues.

Behavior Of Listeria Monocytogenes In A Multi-species Biofilm With Enterococcus Faecalis And Enterococcus Faecium And Control Through Sanitation Procedures.

The formation of mono-species biofilm (Listeria monocytogenes) and multi-species biofilms (Enterococcus faecium, Enterococcus faecalis, and L. monocytogenes) was evaluated. In addition, the effectiveness of sanitation procedures for the control of the multi-species biofilm also was evaluated. The biofilms were grown on stainless steel coupons at various incubation temperatures (7, 25 and 39°C) and contact times (0, 1, 2, 4, 6 and 8days). In all tests, at 7°C, the microbial counts were below 0.4 log CFU/cm(2) and not characteristic of biofilms. In mono-species biofilm, the counts of L. monocytogenes after 8days of contact were 4.1 and 2.8 log CFU/cm(2) at 25 and 39°C, respectively. In the multi-species biofilms, Enterococcus spp. were present at counts of 8 log CFU/cm(2) at 25 and 39°C after 8days of contact. However, the L. monocytogenes in multi-species biofilms was significantly affected by the presence of Enterococcus spp. and by temperature. At 25°C, the growth of L. monocytogenes biofilms was favored in multi-species cultures, with counts above 6 log CFU/cm(2) after 8days of contact. In contrast, at 39°C, a negative effect was observed for L. monocytogenes biofilm growth in mixed cultures, with a significant reduction in counts over time and values below 0.4 log CFU/cm(2) starting at day 4. Anionic tensioactive cleaning complemented with another procedure (acid cleaning, disinfection or acid cleaning+disinfection) eliminated the multi-species biofilms under all conditions tested (counts of all micro-organisms<0.4 log CFU/cm(2)). Peracetic acid was the most effective disinfectant, eliminating the multi-species biofilms under all tested conditions (counts of the all microorganisms <0.4 log CFU/cm(2)). In contrast, biguanide was the least effective disinfectant, failing to eliminate biofilms under all the test conditions.

Biofilm And Saliva Affect The Biomechanical Behavior Of Dental Implants.

Friction coefficient (FC) was quantified between titanium-titanium (Ti-Ti) and titanium-zirconia (Ti-Zr), materials commonly used as abutment and implants, in the presence of a multispecies biofilm (Bf) or salivary pellicle (Pel). Furthermore, FC was used as a parameter to evaluate the biomechanical behavior of a single implant-supported restoration. Interface between Ti-Ti and Ti-Zr without Pel or Bf was used as control (Ctrl). FC was recorded using tribometer and analyzed by two-way Anova and Tukey test (p<0.05). Data were transposed to a finite element model of a dental implant-supported restoration. Models were obtained varying abutment material (Ti and Zr) and FCs recorded (Bf, Pel, and Ctrl). Maximum and shear stress were calculated for bone and equivalent von Misses for prosthetic components. Data were analyzed using two-way ANOVA (p<0.05) and percentage of contribution for each condition (material and FC) was calculated. FC significant differences were observed between Ti-Ti and Ti-Zr for Ctrl and Bf groups, with lower values for Ti-Zr (p<0.05). Within each material group, Ti-Ti differed between all treatments (p<0.05) and for Ti-Zr, only Pel showed higher values compared with Ctrl and Bf (p<0.05). FC contributed to 89.83% (p<0.05) of the stress in the screw, decreasing the stress when the FC was lower. FC resulted in an increase of 59.78% of maximum stress in cortical bone (p=0.05). It can be concluded that the shift of the FC due to the presence of Pel or Bf is able to jeopardize the biomechanical behavior of a single implant-supported restoration.