An hybrid methodology for RL-based behavior coordination in a target following mission with an AUV

Proposes a behavior-based scheme for high-level control of autonomous underwater vehicles (AUVs). Two main characteristics can be highlighted in the control scheme. Behavior coordination is done through a hybrid methodology, which takes in advantages of the robustness and modularity in competitive approaches, as well as optimized trajectories

A behavior-based scheme using reinforcement learning for autonomous underwater vehicles

This paper presents a hybrid behavior-based scheme using reinforcement learning for high-level control of autonomous underwater vehicles (AUVs). Two main features of the presented approach are hybrid behavior coordination and semi on-line neural-Q_learning (SONQL). Hybrid behavior coordination takes advantages of robustness and modularity in the competitive approach as well as efficient trajectories in the cooperative approach. SONQL, a new continuous approach of the Q_learning algorithm with a multilayer neural network is used to learn behavior state/action mapping online. Experimental results show the feasibility of the presented approach for AUVs

Preventive medicine for epidemic outbreaks and risky behavior through mobile devices and ubiquitous computing

In this work, we have developed the first free software for mobile devices with the Android operating system that can preventively mitigate the number of contagions of sexually transmitted infections (STI), associated with risk behavior. This software runs in two modes. The normal mode allows the user to see the alerts and nearby health centers. The second mode enables the service to work in the background. This software reports the health risks, as well as the location of different test centers.

Embedding Emotional Context in Recommender Systems

Emotions are crucial for user's decision making in recommendation processes. We first introduce ambient recommender systems, which arise from the analysis of new trends on the exploitation of the emotional context in the next generation of recommender systems. We then explain some results of these new trends in real-world applications through the smart prediction assistant (SPA) platform in an intelligent learning guide with more than three million users. While most approaches to recommending have focused on algorithm performance. SPA makes recommendations to users on the basis of emotional information acquired in an incremental way. This article provides a cross-disciplinary perspective to achieve this goal in such recommender systems through a SPA platform. The methodology applied in SPA is the result of a bunch of technology transfer projects for large real-world rccommender systems

Contextual effects on political behavior

In her post-doctoral research stay, Aina Gallego has conducted several research projects with the overarching theme of identifying the effects of contexts on political behavior. She has examined the effects of institutions, the economic situation, or local contexts on outcomes such as voter turnout, vote choice, and positions on salient issues. As detailed below, this work has been published in several journal articles in leading Political Science journals such as Comparative Political Studies, Political Behavior, and Electoral Studies (see attached documents). She has a forthcoming book with Cambridge University Press, the most prestigious book press in Political Science.She has also published book chapters and has several working papers. In addition to conducting her research, Aina has received extensive training in both substantive areas and research methods. She has participated fully in the Department’s academic life by attending seminars and engaging in research projects with other members of the Department.

Emotional attention as a modulatory system of perception

Report for the scientific sojourn carried out at the University Medical Center, Swiss, from 2010 to 2012. Abundant evidence suggests that negative emotional stimuli are prioritized in the perceptual systems, eliciting enhanced neural responses in early sensory regions as compared with neutral information. This facilitated detection is generally paralleled by larger neural responses in early sensory areas, relative to the processing of neutral information. In this sense, the amygdala and other limbic regions, such as the orbitofrontal cortex, may play a critical role by sending modulatory projections onto the sensory cortices via direct or indirect feedback.The present project aimed at investigating two important issues regarding these mechanisms of emotional attention, by means of functional magnetic resonance imaging. In Study I, we examined the modulatory effects of visual emotion signals on the processing of task-irrelevant visual, auditory, and somatosensory input, that is, the intramodal and crossmodal effects of emotional attention. We observed that brain responses to auditory and tactile stimulation were enhanced during the processing of visual emotional stimuli, as compared to neutral, in bilateral primary auditory and somatosensory cortices, respectively. However, brain responses to visual task-irrelevant stimulation were diminished in left primary and secondary visual cortices in the same conditions. The results also suggested the existence of a multimodal network associated with emotional attention, presumably involving mediofrontal, temporal and orbitofrontal regions Finally, Study II examined the different brain responses along the low-level visual pathways and limbic regions, as a function of the number of retinal spikes during visual emotional processing. The experiment used stimuli resulting from an algorithm that simulates how the visual system perceives a visual input after a given number of retinal spikes. The results validated the visual model in human subjects and suggested differential emotional responses in the amygdala and visual regions as a function of spike-levels. A list of publications resulting from work in the host laboratory is included in the report.

Emotional attention as a modulatory system of perception

Report for the scientific sojourn carried out at the University Medical Center, Swiss, from 2010 to 2012. Abundant evidence suggests that negative emotional stimuli are prioritized in the perceptual systems, eliciting enhanced neural responses in early sensory regions as compared with neutral information. This facilitated detection is generally paralleled by larger neural responses in early sensory areas, relative to the processing of neutral information. In this sense, the amygdala and other limbic regions, such as the orbitofrontal cortex, may play a critical role by sending modulatory projections onto the sensory cortices via direct or indirect feedback.The present project aimed at investigating two important issues regarding these mechanisms of emotional attention, by means of functional magnetic resonance imaging. In Study I, we examined the modulatory effects of visual emotion signals on the processing of task-irrelevant visual, auditory, and somatosensory input, that is, the intramodal and crossmodal effects of emotional attention. We observed that brain responses to auditory and tactile stimulation were enhanced during the processing of visual emotional stimuli, as compared to neutral, in bilateral primary auditory and somatosensory cortices, respectively. However, brain responses to visual task-irrelevant stimulation were diminished in left primary and secondary visual cortices in the same conditions. The results also suggested the existence of a multimodal network associated with emotional attention, presumably involving mediofrontal, temporal and orbitofrontal regions Finally, Study II examined the different brain responses along the low-level visual pathways and limbic regions, as a function of the number of retinal spikes during visual emotional processing. The experiment used stimuli resulting from an algorithm that simulates how the visual system perceives a visual input after a given number of retinal spikes. The results validated the visual model in human subjects and suggested differential emotional responses in the amygdala and visual regions as a function of spike-levels. A list of publications resulting from work in the host laboratory is included in the report.

Essential role of the N-terminal region of TFII-I in viability and behavior

Background: GTF2I codes for a general intrinsic transcription factor and calcium channel regulator TFII-I, with high and ubiquitous expression, and a strong candidate for involvement in the morphological and neuro-developmental anomalies of the Williams-Beuren syndrome (WBS). WBS is a genetic disorder due to a recurring deletion of about 1,55-1,83 Mb containing 25-28 genes in chromosome band 7q11.23 including GTF2I. Completed homozygous loss of either the Gtf2i or Gtf2ird1 function in mice provided additional evidence for the involvement of both genes in the craniofacial and cognitive phenotype. Unfortunately nothing is now about the behavioral characterization of heterozygous mice. Methods: By gene targeting we have generated a mutant mice with a deletion of the first 140 amino-acids of TFII-I. mRNA and protein expression analysis were used to document the effect of the study deletion. We performed behavioral characterization of heterozygous mutant mice to document in vivo implications of TFII-I in the cognitive profile of WBS patients. Results: Homozygous and heterozygous mutant mice exhibit craniofacial alterations, most clearly represented in homozygous condition. Behavioral test demonstrate that heterozygous mutant mice exhibit some neurobehavioral alterations and hyperacusis or odynacusis that could be associated with specific features of WBS phenotype. Homozygous mutant mice present highly compromised embryonic viability and fertility. Regarding cellular model, we documented a retarded growth in heterozygous MEFs respect to homozygous or wild-type MEFs. Conclusion: Our data confirm that, although additive effects of haploinsufficiency at several genes may contribute to the full craniofacial or neurocognitive features of WBS, correct expression of GTF2I is one of the main players. In addition, these findings show that the deletion of the fist 140 amino-acids of TFII-I altered it correct function leading to a clear phenotype, at both levels, at the cellular model and at the in vivo model.

The effects of employment uncertainty and wealth shocks on the labor supply and claiming behavior of older American workers

Unemployment rates in developed countries have recently reached levels not seenin a generation, and workers of all ages are facing increasing probabilities of losingtheir jobs and considerable losses in accumulated assets. These events likely increasethe reliance that most older workers will have on public social insurance programs,exactly at a time that public finances are suffering from a large drop in contributions.Our paper explicitly accounts for employment uncertainty and unexpectedwealth shocks, something that has been relatively overlooked in the literature, butthat has grown in importance in recent years. Using administrative and householdlevel data we empirically characterize a life-cycle model of retirement and claimingdecisions in terms of the employment, wage, health, and mortality uncertainty facedby individuals. Our benchmark model explains with great accuracy the strikinglyhigh proportion of individuals who claim benefits exactly at the Early RetirementAge, while still explaining the increased claiming hazard at the Normal RetirementAge. We also discuss some policy experiments and their interplay with employmentuncertainty. Additionally, we analyze the effects of negative wealth shocks on thelabor supply and claiming decisions of older Americans. Our results can explainwhy early claiming has remained very high in the last years even as the early retirementpenalties have increased substantially compared with previous periods, andwhy labor force participation has remained quite high for older workers even in themidst of the worse employment crisis in decades.

One person in the battlefield is not a warrior: Self-construal, perceived ability to make a difference, and socially responsible behavior

We suggest that cultivating an individual's connectedness to others promotes sociallyresponsible behavior both directly and indirectly through increased perceived abilityto make a difference. Individuals whose interdependent self is more prominent feel theyhave more of an impact on larger scale societal outcomes and, therefore, engage more insocially responsible behaviors than do individuals whose independent self is moreprominent. We test these hypotheses in two experiments in which participants makefinancial contributions or exert an effort for a social cause. In a survey, we find thatperceived effectiveness mediates the effect of self-construal on socially responsibleconsumption.

An experimental study of adaptive behavior in an oligopolistic market game

We consider an oligopolistic market game, in which the players are competing firm in the same market of a homogeneous consumption good. The consumer side is represented by a fixed demand function. The firms decide how much to produce of a perishable consumption good, and they decide upon a number of information signals to be sent into the population in order to attract customers. Due to the minimal information provided, the players do not have a well--specified model of their environment. Our main objective is to characterize the adaptive behavior of the players in such a situation.

A dynamic choice model of hybrid behavior in the attribute-space

This paper presents a dynamic choice model in the attributespace considering rational consumers that discount the future. In lightof the evidence of several state-dependence patterns, the model isfurther extended by considering a utility function that allows for thedifferent types of behavior described in the literature: pure inertia,pure variety seeking and hybrid. The model presents a stationaryconsumption pattern that can be inertial, where the consumer only buysone product, or a variety-seeking one, where the consumer buys severalproducts simultane-ously. Under the inverted-U marginal utilityassumption, the consumer behaves inertial among the existing brands forseveral periods, and eventually, once the stationary levels areapproached, the consumer turns to a variety-seeking behavior. An empiricalanalysis is run using a scanner database for fabric softener andsignificant evidence of hybrid behavior for most attributes is found,which supports the functional form considered in the theory.

Strategic behavior and price discovery

The paper analyzes the effects of strategic behavior by an insider in a price discovery process, akin to an information tatonnement, in the presence of a competitive informed sector. Such processes are used in the preopening period of continuous trading systems in several exchanges. It is found that the insider manipulates the market using a contrarian strategy in order to neutralize the effect of the trades of competitive informed agents. Furthermore, consistently with the empirical evidence available, we find that information revelation accelerates close to the opening, that the market price does not converge to the fundamental value no matter how many rounds the tatonnement has, and that the expected trading volume displays a U-shaped pattern. We also find that a market with a larger competitive sector (smaller insider) has an improved informational efficiency and an increased trading volume. The insider provides a public good (a lower informativeness of the price) for the competitive informed sector.

Is confidence in decisions related to feedback? Evidence-and lack of evidence-from random samples of real-world managerial behavior?

Confidence in decision making is an important dimension of managerialbehavior. However, what is the relation between confidence, on the onehand, and the fact of receiving or expecting to receive feedback ondecisions taken, on the other hand? To explore this and related issuesin the context of everyday decision making, use was made of the ESM(Experience Sampling Method) to sample decisions taken by undergraduatesand business executives. For several days, participants received 4 or 5SMS messages daily (on their mobile telephones) at random moments at whichpoint they completed brief questionnaires about their current decisionmaking activities. Issues considered here include differences between thetypes of decisions faced by the two groups, their structure, feedback(received and expected), and confidence in decisions taken as well as inthe validity of feedback. No relation was found between confidence indecisions and whether participants received or expected to receivefeedback on those decisions. In addition, although participants areclearly aware that feedback can provide both confirming and disconfirming evidence, their ability to specify appropriatefeedback is imperfect. Finally, difficulties experienced inusing the ESM are discussed as are possibilities for further researchusing this methodology.