Learning processes and the neural analysis of conditioning

Classical and operant conditioning principles, such as the behavioral discrepancy-derived assumption that reinforcement always selects antecedent stimulus and response relations, have been studied at the neural level, mainly by observing the strengthening of neuronal responses or synaptic connections. A review of the literature on the neural basis of behavior provided extensive scientific data that indicate a synthesis between the two conditioning processes based mainly on stimulus control in learning tasks. The resulting analysis revealed the following aspects. Dopamine acts as a behavioral discrepancy signal in the midbrain pathway of positive reinforcement, leading toward the nucleus accumbens. Dopamine modulates both types of conditioning in the Aplysia mollusk and in mammals. In vivo and in vitro mollusk preparations show convergence of both types of conditioning in the same motor neuron. Frontal cortical neurons are involved in behavioral discrimination in reversal and extinction procedures, and these neurons preferentially deliver glutamate through conditioned stimulus or discriminative stimulus pathways. Discriminative neural responses can reliably precede operant movements and can also be common to stimuli that share complex symbolic relations. The present article discusses convergent and divergent points between conditioning paradigms at the neural level of analysis to advance our knowledge on reinforcement.

Accelerating autonomous learning by using heuristic selection of actions

This paper investigates how to make improved action selection for online policy learning in robotic scenarios using reinforcement learning (RL) algorithms. Since finding control policies using any RL algorithm can be very time consuming, we propose to combine RL algorithms with heuristic functions for selecting promising actions during the learning process. With this aim, we investigate the use of heuristics for increasing the rate of convergence of RL algorithms and contribute with a new learning algorithm, Heuristically Accelerated Q-learning (HAQL), which incorporates heuristics for action selection to the Q-Learning algorithm. Experimental results on robot navigation show that the use of even very simple heuristic functions results in significant performance enhancement of the learning rate.

Robust integration of real time optimization with linear model predictive control

Here, we study the stable integration of real time optimization (RTO) with model predictive control (MPC) in a three layer structure. The intermediate layer is a quadratic programming whose objective is to compute reachable targets to the MPC layer that lie at the minimum distance to the optimum set points that are produced by the RTO layer. The lower layer is an infinite horizon MPC with guaranteed stability with additional constraints that force the feasibility and convergence of the target calculation layer. It is also considered the case in which there is polytopic uncertainty in the steady state model considered in the target calculation. The dynamic part of the MPC model is also considered unknown but it is assumed to be represented by one of the models of a discrete set of models. The efficiency of the methods presented here is illustrated with the simulation of a low order system. (C) 2010 Elsevier Ltd. All rights reserved.

The Policy Iteration Algorithm for Average Continuous Control of Piecewise Deterministic Markov Processes

The main goal of this paper is to apply the so-called policy iteration algorithm (PIA) for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP`s) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we first derive some important properties for a pseudo-Poisson equation associated to the problem. In the sequence it is shown that the convergence of the PIA to a solution satisfying the optimality equation holds under some classical hypotheses and that this optimal solution yields to an optimal control strategy for the average control problem for the continuous-time PDMP in a feedback form.

THE VANISHING DISCOUNT APPROACH FOR THE AVERAGE CONTINUOUS CONTROL OF PIECEWISE DETERMINISTIC MARKOV PROCESSES

This work is concerned with the existence of an optimal control strategy for the long-run average continuous control problem of piecewise-deterministic Markov processes (PDMPs). In Costa and Dufour (2008), sufficient conditions were derived to ensure the existence of an optimal control by using the vanishing discount approach. These conditions were mainly expressed in terms of the relative difference of the alpha-discount value functions. The main goal of this paper is to derive tractable conditions directly related to the primitive data of the PDMP to ensure the existence of an optimal control. The present work can be seen as a continuation of the results derived in Costa and Dufour (2008). Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP. An example based on the capacity expansion problem is presented, illustrating the possible applications of the results developed in the paper.

The interaction between technologies and society: Lessons learnt from 160 evolutionary years of online news services

In mapping the evolutionary process of online news and the socio-cultural factors determining this development, this paper has a dual purpose. First, in reworking the definition of “online communication”, it argues that despite its seemingly sudden emergence in the 1990s, the history of online news started right in the early days of the telegraphs and spread throughout the development of the telephone and the fax machine before becoming computer-based in the 1980s and Web-based in the 1990s. Second, merging macro-perspectives on the dynamic of media evolution by DeFleur and Ball-Rokeach (1989) and Winston (1998), the paper consolidates a critical point for thinking about new media development: that something technically feasible does not always mean that it will be socially accepted and/or demanded. From a producer-centric perspective, the birth and development of pre-Web online news forms have been more or less generated by the traditional media’s sometimes excessive hype about the power of new technologies. However, placing such an emphasis on technological potentials at the expense of their social conditions not only can be misleading but also can be detrimental to the development of new media, including the potential of today’s online news.

Useful representations of series solutions for transport problems

Simple techniques are presented for rearrangement of an infinite series in a systematic way such that the convergence of the resulting expression is accelerated. These procedures also allow calculation of required boundary derivatives. Several examples of conduction and diffusion-reaction problems illustrate the methods.

Relative motions of Africa, Iberia and Europe during Alpine orogeny

A revised kinematic model for the motions of Africa and Iberia relative to Europe since the Middle Jurassic is presented in order to provide boundary conditions for Alpine-Mediterranean reconstructions. These motions were calculated using up-to-date kinematic data predominantly based on magnetic isochrons in the Atlantic Ocean and published by various authors during the last 15 years. It is shown that convergence of Africa with respect to Europe commenced during the Cretaceous Normal Superchron (CNS), between chrons MO and 34 (120-83 Ma). This motion was subjected to fluctuations in convergence rates characterised by two periods of relatively rapid convergence (during Late Cretaceous and Eocene-Oligocene times) that alternated with periods of slower convergence (during the Paleocene and since the Early Miocene). Distinct changes in plate kinematics are recognised in the motion of Iberia with respect to Europe, indicated by: (1) a Late Jurassic-Early Cretaceous left-lateral strike-slip motion; (2) Late Cretaceous convergence; (3) Paleocene quiescence; (4) a short period of right-lateral strike-slip motion; and (5) final Eocene-Oligocene convergence. Based on these results, it is speculated that a collisional episode in the Alpine orogeny at ca. 65 Ma resulted in a dramatic decrease in the relative plate motions and that a slower motion since the Early Miocene promoted extension in the Mediterranean back-arc basins. (C) 2002 Elsevier Science B.V. All rights reserved.

Communication and health beliefs - Mass and interpersonal influences on perceptions of risk to self and others

This study investigated the impact of media coverage of a health issue (skin cancer) on judgements of risk to self and others and the role of related communication processes. Consistent with predictions derived from the impersonal impact hypothesis, the effects of mass communication were more evident in perceptions of risk to others rather than in perceptions of personal risk. Perceptions of personal risk were more strongly correlated with interpersonal communication. However, as suggested by media system dependency theory, the relationship between mass communication and beliefs was complex. The impact of mass communication on both personal and impersonal perceptions was bound to be moderated by self-reported dependence on mass mediated information. The effect of this two-way interaction 071 perceptions of personal risk was partially mediated through interpersonal communication. Results point to the interdependence of mass and interpersonal communication as sources of social influence and the role of media dependency in shaping media impact.

Accumulation of manganese in Neisseria gonorrhoeae correlates with resistance to oxidative killing by superoxide anion and is independent of superoxide dismutase activity

As a facultative aerobe with a high iron requirement and a highly active aerobic respiratory chain, Neisseria gonorrhoeae requires defence systems to respond to toxic oxygen species such as superoxide. It has been shown that supplementation of media with 100 muM Mn(II) considerably enhanced the resistance of this bacterium to oxidative killing by superoxide. This protection was not associated with the superoxide dismutase enzymes of N. gonorrhoeae. In contrast to previous studies, which suggested that some strains of N. gonorrhoeae might not contain a superoxide dismutase, we identified a sodB gene by genome analysis and confirmed its presence in all strains examined by Southern blotting, but found no evidence for sodA or sodC. A sodB mutant showed very similar susceptibility to superoxide killing to that of wild-type cells, indicating that the Fe-dependent SOD B did not have a major role in resistance to oxidative killing under the conditions tested. The absence of a sodA gene indicated that the Mn-dependent protection against oxidative killing was independent of Mn-dependent SOD A. As a sodB mutant also showed Mn-dependent resistance to oxidative killing, then it is concluded that this resistance is independent of superoxide dismutase enzymes. Resistance to oxidative killing was correlated with accumulation of Mn(II) by the bacterium. We hypothesize that this bacterium uses Mn(II) as a chemical quenching agent in a similar way to the already established process in Lactobacillus plantarum. A search for putative Mn(II) uptake systems identified an ABC cassette-type system (MntABC) with a periplasmic-binding protein (MntC). An mntC mutant was shown to have lowered accumulation of Mn(II) and was also highly susceptible to oxidative killing, even in the presence of added Mn(II). Taken together, these data show that N. gonorrhoeae possesses a Mn(II) uptake system that is critical for resistance to oxidative stress.

What is the value of firms' prior knowledge? Building organisational knowledge capabilities

A firm's prior knowledge facilitates the absorption of new knowledge, thereby renewing a firm's systematic search, transfer and absorption capabilities. The rapidly expanding field of biotechnology is characterised by the convergence of disparate sciences and technologies. This paper, the shift from proteinbased to DNA-based diagnostic technologies, quantifies the value of a firm's prior knowledge and its relation to future knowledge development. Four dimensions of diagnostic and four dimensions of knowledge in biotechnology firms are analysed. A simple scaled matrix method is developed to quantify the positive and negative heuristic values of prior scientific and technological knowledge that is useful for the acquisition and absorption of new knowledge.

Patterns of change and stability in the gender division of household labour in Australia, 1986-1997

Recent research in Australia and overseas has suggested that we are witnessing a convergence of men's and women's time on domestic labour activities. But there is disagreement about whether this is due to women reducing their time on housework or men increasing their time on housework. This article addresses these issues using national survey data collected in Australia in 1986, 1993 and 1997. The results show some changes in the proportional responsibilities of men and women in the home with men reporting a greater share of traditional indoor activities. But overall both men and women are spending less time on housework. In particular, women's time on housework has declined by six hours per week since 1986. Hence, while the gender gap between men's and women's involvement in the home is getting smaller, it is not the result of men increasing their share of the load, but is due to the large decline in women's time spent on domestic labour. There is also evidence of change in the relationship. between paid and unpaid work for women. Women's hours of,paid labour had a greater impact on their involvement in domestic labour in 1997 compared to a decade earlier. The article concludes that women's increased labour force involvement in combination with changing patterns and styles, of consumption is leading to some changes in the gender-division:of household labour, but not in the direction anticipated by earlier commentators on the domestic division of labour.

Laminar disorganisation of mitral cells in the olfactory bulb does not affect topographic targeting of primary olfactory axons

Primary olfactory neurons expressing the same odorant receptor protein typically project to topographically fixed olfactory bulb sites. While cell adhesion molecules and odorant receptors have been implicated in guidance of primary olfactory axons. the postsynaptic mitral cells may also have a role in final target selection. We have examined the effect of disorganisation of the mitral cell soma layer in mutant mice heterozygous for the beta-subunit of platelet activating factor acetylhydrolase (Lis1(-/+)) on the targeting of primary olfactory axons. Lis1(-/+) mice display abnormal lamination of neurons in the olfactory bulb. Lis1(-/+) mice were crossed with the P2-IRES-tau:LacZ line of transgenic mice that selectively expresses beta-galactosidase in primary olfactory neurons expressing the P2 odorant receptor. LacZ histochemistry revealed blue-stained P2 axons that targeted topographically fixed glomeruli in these mice in a manner similar to that observed in the parent P2-IRES-tau:LacZ line. Thus, despite the aberrant organisation of postsynaptic mitral cells in Lis1(-/+) mice, primary olfactory axons continued to converge and form glomeruli at correct sites in the olfactory bulb. Next we examined whether challenging primary olfactory axons in adult Lis(-/+) mice with regeneration would affect their ability to converge and form glomeruli. Following partial chemical ablation of the olfactory neuroepithelium with dichlobenil, primary olfactory neurons die and are replaced by newly differentiating neurons that project axons to the olfactory bulb where they converge and form glomeruli. Despite the aberrant mitral cell layer in Lis(-/+) mice. primary olfactory axons continued to converge and form glomeruli during regeneration. Together these results demonstrate that the convergence of primary olfactory axons during development and regeneration is not affected by gross perturbations to the lamination of the mitral cell layer. Thus, these results support evidence from other studies indicating that mitral cells do not play a major role in the convergence and targeting of primary olfactory axons in the olfactory bulb. (C) 2002 Elsevier Science B.V. All rights reserved.

Variables affecting the fine grinding of minerals using stirred mills

Base metal resources are becoming more fine-grained and refractory and minerals separation processes require these ores to be milled to increasingly finer sizes. To cope with very fine grinding to below a P-80 of approximately 15 mum stirred milling technology has been adopted from other industries Neither this technology, nor the basic concepts of fine grinding, are well understood by the minerals processing industry. Laboratory studies were therefore carried out in order to investigate fine milling using different types of stirred mills. The variables analysed were stirrer speed, grinding media type and size, slurry solids content as well as the feed and product size. The results of the testwork have shown that all of these variables affect the grinding efficiency. The ratio of media size to material size was found to be of particular significance. The results were also analysed using the stress intensity approach and the optimum stress intensity ranges for the most efficient grinding were determined. Application of the results for process optimisation in the industrial size units is also discussed in this paper. (C) 2003 Elsevier Science Ltd. All rights reserved.

Valuing of firm's prior knowledge: A measure of knowledge distance

Knowledge, especially scientific and technological knowledge, grows according to knowledge trajectories and guideposts that make up the prior knowledge of an organization. We argue that these knowledge structures and their specific components lead to successful innovation. A firm's prior knowledge facilitates the absorption of new knowledge, thereby renewing a firm's systematic search, transfer and acquisition of knowledge and capabilities. In particular, the exponential growth in biotechnology is characterized by the convergence of disparate scientific and technological knowledge resources. This paper examines the shift from protein-based to DNA-based diagnostic technologies as an example, to quantify the value of a firm's prior knowledge using relative values of knowledge distance. The distance between core prior knowledge and the rate of transition from one knowledge system to another has been identified as a proxy for the value a firm's prior knowledge. The overall difficulty of transition from one technology paradigm to another is discussed. We argue this transition is possible when the knowledge distance is minimal and the transition process has a correspondingly high value of absorptive capacities. Our findings show knowledge distance is a determinant of the feasibility, continuity and capture of scientific and technological knowledge. Copyright © 2003 John Wiley & Sons, Ltd.