A behavior-based scheme using reinforcement learning for autonomous underwater vehicles

This paper presents a hybrid behavior-based scheme using reinforcement learning for high-level control of autonomous underwater vehicles (AUVs). Two main features of the presented approach are hybrid behavior coordination and semi on-line neural-Q_learning (SONQL). Hybrid behavior coordination takes advantages of robustness and modularity in the competitive approach as well as efficient trajectories in the cooperative approach. SONQL, a new continuous approach of the Q_learning algorithm with a multilayer neural network is used to learn behavior state/action mapping online. Experimental results show the feasibility of the presented approach for AUVs

Preventive medicine for epidemic outbreaks and risky behavior through mobile devices and ubiquitous computing

In this work, we have developed the first free software for mobile devices with the Android operating system that can preventively mitigate the number of contagions of sexually transmitted infections (STI), associated with risk behavior. This software runs in two modes. The normal mode allows the user to see the alerts and nearby health centers. The second mode enables the service to work in the background. This software reports the health risks, as well as the location of different test centers.

A systematic and feasible method for computing nuclear contributions to electrical properties of polyatomic molecules

An analytic method to evaluate nuclear contributions to electrical properties of polyatomic molecules is presented. Such contributions control changes induced by an electric field on equilibrium geometry (nuclear relaxation contribution) and vibrational motion (vibrational contribution) of a molecular system. Expressions to compute the nuclear contributions have been derived from a power series expansion of the potential energy. These contributions to the electrical properties are given in terms of energy derivatives with respect to normal coordinates, electric field intensity or both. Only one calculation of such derivatives at the field-free equilibrium geometry is required. To show the useful efficiency of the analytical evaluation of electrical properties (the so-called AEEP method), results for calculations on water and pyridine at the SCF/TZ2P and the MP2/TZ2P levels of theory are reported. The results obtained are compared with previous theoretical calculations and with experimental values

Electronic couplings and on-site energies for hole transfer in DNA: systematic quantum mechanical/molecular dynamic study

The electron hole transfer (HT) properties of DNA are substantially affected by thermal fluctuations of the π stack structure. Depending on the mutual position of neighboring nucleobases, electronic coupling V may change by several orders of magnitude. In the present paper, we report the results of systematic QM/molecular dynamic (MD) calculations of the electronic couplings and on-site energies for the hole transfer. Based on 15 ns MD trajectories for several DNA oligomers, we calculate the average coupling squares 〈 V2 〉 and the energies of basepair triplets X G+ Y and X A+ Y, where X, Y=G, A, T, and C. For each of the 32 systems, 15 000 conformations separated by 1 ps are considered. The three-state generalized Mulliken-Hush method is used to derive electronic couplings for HT between neighboring basepairs. The adiabatic energies and dipole moment matrix elements are computed within the INDO/S method. We compare the rms values of V with the couplings estimated for the idealized B -DNA structure and show that in several important cases the couplings calculated for the idealized B -DNA structure are considerably underestimated. The rms values for intrastrand couplings G-G, A-A, G-A, and A-G are found to be similar, ∼0.07 eV, while the interstrand couplings are quite different. The energies of hole states G+ and A+ in the stack depend on the nature of the neighboring pairs. The X G+ Y are by 0.5 eV more stable than X A+ Y. The thermal fluctuations of the DNA structure facilitate the HT process from guanine to adenine. The tabulated couplings and on-site energies can be used as reference parameters in theoretical and computational studies of HT processes in DNA

Contextual effects on political behavior

In her post-doctoral research stay, Aina Gallego has conducted several research projects with the overarching theme of identifying the effects of contexts on political behavior. She has examined the effects of institutions, the economic situation, or local contexts on outcomes such as voter turnout, vote choice, and positions on salient issues. As detailed below, this work has been published in several journal articles in leading Political Science journals such as Comparative Political Studies, Political Behavior, and Electoral Studies (see attached documents). She has a forthcoming book with Cambridge University Press, the most prestigious book press in Political Science.She has also published book chapters and has several working papers. In addition to conducting her research, Aina has received extensive training in both substantive areas and research methods. She has participated fully in the Department’s academic life by attending seminars and engaging in research projects with other members of the Department.

Essential role of the N-terminal region of TFII-I in viability and behavior

Background: GTF2I codes for a general intrinsic transcription factor and calcium channel regulator TFII-I, with high and ubiquitous expression, and a strong candidate for involvement in the morphological and neuro-developmental anomalies of the Williams-Beuren syndrome (WBS). WBS is a genetic disorder due to a recurring deletion of about 1,55-1,83 Mb containing 25-28 genes in chromosome band 7q11.23 including GTF2I. Completed homozygous loss of either the Gtf2i or Gtf2ird1 function in mice provided additional evidence for the involvement of both genes in the craniofacial and cognitive phenotype. Unfortunately nothing is now about the behavioral characterization of heterozygous mice. Methods: By gene targeting we have generated a mutant mice with a deletion of the first 140 amino-acids of TFII-I. mRNA and protein expression analysis were used to document the effect of the study deletion. We performed behavioral characterization of heterozygous mutant mice to document in vivo implications of TFII-I in the cognitive profile of WBS patients. Results: Homozygous and heterozygous mutant mice exhibit craniofacial alterations, most clearly represented in homozygous condition. Behavioral test demonstrate that heterozygous mutant mice exhibit some neurobehavioral alterations and hyperacusis or odynacusis that could be associated with specific features of WBS phenotype. Homozygous mutant mice present highly compromised embryonic viability and fertility. Regarding cellular model, we documented a retarded growth in heterozygous MEFs respect to homozygous or wild-type MEFs. Conclusion: Our data confirm that, although additive effects of haploinsufficiency at several genes may contribute to the full craniofacial or neurocognitive features of WBS, correct expression of GTF2I is one of the main players. In addition, these findings show that the deletion of the fist 140 amino-acids of TFII-I altered it correct function leading to a clear phenotype, at both levels, at the cellular model and at the in vivo model.

BDNF impairment in the hippocampus is related to enhanced despair behavior in CB1 knockout mice

Stress can cause damage and atrophy of neurons in the hippocampus by deregulating the expression of neurotrophic factors that promote neuronal plasticity. The endocannabinoid system represents a physiological substrate involved in neuroprotection at both cellular and emotional levels. The lack of CB1 receptor alters neuronal plasticity and originates an anxiety-like phenotype in mice. In the present study, CB1 knockout mice exhibited an augmented response to stress revealed by the increased despair behavior and corticosterone levels showed in the tail suspension test and decreased brain derived neurotrophic factor (BDNF) levels in the hippocampus. Interestingly, local administration of BDNF in the hippocampus reversed the increased despair behavior of CB1 knockout mice, confirming the crucial role played by BDNF on the emotional impairment of these mutants. The neurotrophic deficiency seems to be specific for BDNF since no differences were found in the levels of NGF and NT-3, two additional neurotrophic factors. Moreover, BDNF impairment is not related to the activity of its specific receptor TrkB or the activity of the transcription factor CREB. These results suggest that the lack of CB1 receptor originates an enhanced response to stress and neuronal plasticity by decreasing BDNF levels in the hippocampus that lead to impairment in the responses to emotional disturbances.

The effects of employment uncertainty and wealth shocks on the labor supply and claiming behavior of older American workers

Unemployment rates in developed countries have recently reached levels not seenin a generation, and workers of all ages are facing increasing probabilities of losingtheir jobs and considerable losses in accumulated assets. These events likely increasethe reliance that most older workers will have on public social insurance programs,exactly at a time that public finances are suffering from a large drop in contributions.Our paper explicitly accounts for employment uncertainty and unexpectedwealth shocks, something that has been relatively overlooked in the literature, butthat has grown in importance in recent years. Using administrative and householdlevel data we empirically characterize a life-cycle model of retirement and claimingdecisions in terms of the employment, wage, health, and mortality uncertainty facedby individuals. Our benchmark model explains with great accuracy the strikinglyhigh proportion of individuals who claim benefits exactly at the Early RetirementAge, while still explaining the increased claiming hazard at the Normal RetirementAge. We also discuss some policy experiments and their interplay with employmentuncertainty. Additionally, we analyze the effects of negative wealth shocks on thelabor supply and claiming decisions of older Americans. Our results can explainwhy early claiming has remained very high in the last years even as the early retirementpenalties have increased substantially compared with previous periods, andwhy labor force participation has remained quite high for older workers even in themidst of the worse employment crisis in decades.

One person in the battlefield is not a warrior: Self-construal, perceived ability to make a difference, and socially responsible behavior

We suggest that cultivating an individual's connectedness to others promotes sociallyresponsible behavior both directly and indirectly through increased perceived abilityto make a difference. Individuals whose interdependent self is more prominent feel theyhave more of an impact on larger scale societal outcomes and, therefore, engage more insocially responsible behaviors than do individuals whose independent self is moreprominent. We test these hypotheses in two experiments in which participants makefinancial contributions or exert an effort for a social cause. In a survey, we find thatperceived effectiveness mediates the effect of self-construal on socially responsibleconsumption.

On the term structure of Interbank interest rates: Jump-diffusion processes and option pricing

In this paper we study the dynamic behavior of the term structureof Interbank interest rates and the pricing of options on interest ratesensitive securities. We posit a generalized single factor model withjumps to take into account external influences in the market. Daily datais used to test for jump effects. Qualitative examination of the linkagebetween Monetary Authorities' interventions and jumps are studied. Pricingresults suggests a systematic underpricing in bonds and call options ifthe jumps component is not included. However, the pricing of put optionson bonds presents indeterminacies.

An experimental study of adaptive behavior in an oligopolistic market game

We consider an oligopolistic market game, in which the players are competing firm in the same market of a homogeneous consumption good. The consumer side is represented by a fixed demand function. The firms decide how much to produce of a perishable consumption good, and they decide upon a number of information signals to be sent into the population in order to attract customers. Due to the minimal information provided, the players do not have a well--specified model of their environment. Our main objective is to characterize the adaptive behavior of the players in such a situation.

A dynamic choice model of hybrid behavior in the attribute-space

This paper presents a dynamic choice model in the attributespace considering rational consumers that discount the future. In lightof the evidence of several state-dependence patterns, the model isfurther extended by considering a utility function that allows for thedifferent types of behavior described in the literature: pure inertia,pure variety seeking and hybrid. The model presents a stationaryconsumption pattern that can be inertial, where the consumer only buysone product, or a variety-seeking one, where the consumer buys severalproducts simultane-ously. Under the inverted-U marginal utilityassumption, the consumer behaves inertial among the existing brands forseveral periods, and eventually, once the stationary levels areapproached, the consumer turns to a variety-seeking behavior. An empiricalanalysis is run using a scanner database for fabric softener andsignificant evidence of hybrid behavior for most attributes is found,which supports the functional form considered in the theory.

Strategic behavior and price discovery

The paper analyzes the effects of strategic behavior by an insider in a price discovery process, akin to an information tatonnement, in the presence of a competitive informed sector. Such processes are used in the preopening period of continuous trading systems in several exchanges. It is found that the insider manipulates the market using a contrarian strategy in order to neutralize the effect of the trades of competitive informed agents. Furthermore, consistently with the empirical evidence available, we find that information revelation accelerates close to the opening, that the market price does not converge to the fundamental value no matter how many rounds the tatonnement has, and that the expected trading volume displays a U-shaped pattern. We also find that a market with a larger competitive sector (smaller insider) has an improved informational efficiency and an increased trading volume. The insider provides a public good (a lower informativeness of the price) for the competitive informed sector.

Is confidence in decisions related to feedback? Evidence-and lack of evidence-from random samples of real-world managerial behavior?

Confidence in decision making is an important dimension of managerialbehavior. However, what is the relation between confidence, on the onehand, and the fact of receiving or expecting to receive feedback ondecisions taken, on the other hand? To explore this and related issuesin the context of everyday decision making, use was made of the ESM(Experience Sampling Method) to sample decisions taken by undergraduatesand business executives. For several days, participants received 4 or 5SMS messages daily (on their mobile telephones) at random moments at whichpoint they completed brief questionnaires about their current decisionmaking activities. Issues considered here include differences between thetypes of decisions faced by the two groups, their structure, feedback(received and expected), and confidence in decisions taken as well as inthe validity of feedback. No relation was found between confidence indecisions and whether participants received or expected to receivefeedback on those decisions. In addition, although participants areclearly aware that feedback can provide both confirming and disconfirming evidence, their ability to specify appropriatefeedback is imperfect. Finally, difficulties experienced inusing the ESM are discussed as are possibilities for further researchusing this methodology.