Functional requirements for reward-modulated spike-timing-dependent plasticity.

Recent experiments have shown that spike-timing-dependent plasticity is influenced by neuromodulation. We derive theoretical conditions for successful learning of reward-related behavior for a large class of learning rules where Hebbian synaptic plasticity is conditioned on a global modulatory factor signaling reward. We show that all learning rules in this class can be separated into a term that captures the covariance of neuronal firing and reward and a second term that presents the influence of unsupervised learning. The unsupervised term, which is, in general, detrimental for reward-based learning, can be suppressed if the neuromodulatory signal encodes the difference between the reward and the expected reward-but only if the expected reward is calculated for each task and stimulus separately. If several tasks are to be learned simultaneously, the nervous system needs an internal critic that is able to predict the expected reward for arbitrary stimuli. We show that, with a critic, reward-modulated spike-timing-dependent plasticity is capable of learning motor trajectories with a temporal resolution of tens of milliseconds. The relation to temporal difference learning, the relevance of block-based learning paradigms, and the limitations of learning with a critic are discussed.

Functional programming based CACSD environment

An engineering design environment should allow users to design complex engineering systems, to manage and coordinate the designs as they proceed, and to develop and modify the software tools used for designs. These requirements call for a programming environment with an integrated set of software tools of different functionalities. The required functionalities are mainly: the provision of design algorithms based on suitable numeric software, appropriate data structures for the application area, a user-friendly interface, and the provision of a design database for the long term management of the designs generated. The provision of such an integrated design environment in a functional programming environment with particular emphasis on the provision of appropriate control-theoretic data structures and data model is described. Object-orientation is used to model entities in the application domain, which are represented by persistent objects in the database. Structural properties, relationships and operations on entities are modelled through objects and functions classified into strict types with inheritance semantics and a recursive structure.

The MHP36 line of murine neural stem cells expresses functional CXCR1 chemokine receptors that initiate chemotaxis in vitro.

Chemokines help to establish cerebral inflammation after ischemia, which comprises a major component of secondary brain injury. The CXCR4 chemokine receptor system induces neural stem cell migration, and hence has been implicated in brain repair. We show that CXCR1 and interleukin-8 also stimulate chemotaxis in murine neural stem cells from the MHP36 cell line. The presence of CXCR1 was confirmed by reverse transcriptase PCR and immunohistochemistry. Interleukin-8 evoked intracellular calcium currents, upregulated doublecortin (a protein expressed by migrating neuroblasts), and elicited positive chemotaxis in vitro. Therefore, effectors of the early innate immune response may also influence brain repair mechanisms.

A comparison of winter pre-heating requirements for natural displacement and natural mixing ventilation

In winter, natural ventilation can be achieved either through mixing ventilation or upward displacement ventilation (P.F. Linden, The fluid mechanics of natural ventilation, Annual Review of Fluid Mechanics 31 (1999) pp. 201-238). We show there is a significant energy saving possible by using mixing ventilation, in the case that the internal heat gains are significant, and illustrate these savings using an idealized model, which predicts that with internal heat gains of order 0.1 kW per person, mixing ventilation uses of a fraction of order 0.2-0.4 of the heat load of displacement ventilation assuming a well-insulated building. We then describe a strategy for such mixing natural ventilation in an atrium style building in which the rooms surrounding the atrium are able to vent directly to the exterior and also through the atrium to the exterior. The results are motivated by the desire to reduce the energy burden in large public buildings such as hospitals, schools or office buildings centred on atria. We illustrate a strategy for the natural mixing ventilation in order that the rooms surrounding the atrium receive both pre-heated but also sufficiently fresh air, while the central atrium zone remains warm. We test the principles with some laboratory experiments in which a model air chamber is ventilated using both mixing and displacement ventilation, and compare the energy loads in each case. We conclude with a discussion of the potential applications of the approach within the context of open plan atria type office buildings.