The moving targets algorithm for difficult temporal credit assignment problems

The 'moving targets' algorithm for training recurrent networks is reviewed and applied to a task which demonstrates the ability of this algorithm to use distant contextual information. Some practical difficulties are discussed, especially with regard to the minimization process. Results on performance and computational requirements of several different 2nd-order minimization algorithms are presented for moving target problems.

The 'moving targets' training algorithm

A simple method for training the dynamical behavior of a neural network is derived. It is applicable to any training problem in discrete-time networks with arbitrary feedback. The algorithm resembles back-propagation in that an error function is minimized using a gradient-based method, but the optimization is carried out in the hidden part of state space either instead of, or in addition to weight space. Computational results are presented for some simple dynamical training problems, one of which requires response to a signal 100 time steps in the past.

The 'moving targets' training algorithm

A simple method for training the dynamical behavior of a neural network is derived. It is applicable to any training problem in discrete-time networks with arbitrary feedback. The method resembles back-propagation in that it is a least-squares, gradient-based optimization method, but the optimization is carried out in the hidden part of state space instead of weight space. A straightforward adaptation of this method to feedforward networks offers an alternative to training by conventional back-propagation. Computational results are presented for simple dynamical training problems, with varied success. The failures appear to arise when the method converges to a chaotic attractor. A patch-up for this problem is proposed. The patch-up involves a technique for implementing inequality constraints which may be of interest in its own right.

Mycobacterium tuberculosis peptides presented by HLA-E molecules are targets for human CD8 T-cells with cytotoxic as well as regulatory activity

Tuberculosis (TB) is an escalating global health problem and improved vaccines against TB are urgently needed. HLA-E restricted responses may be of interest for vaccine development since HLA-E displays very limited polymorphism (only 2 coding variants exist), and is not down-regulated by HIV-infection. The peptides from Mycobacterium tuberculosis (Mtb) potentially presented by HLA-E molecules, however, are unknown. Here we describe human T-cell responses to Mtb-derived peptides containing predicted HLA-E binding motifs and binding-affinity for HLA-E. We observed CD8(+) T-cell proliferation to the majority of the 69 peptides tested in Mtb responsive adults as well as in BCG-vaccinated infants. CD8(+) T-cells were cytotoxic against target-cells transfected with HLA-E only in the presence of specific peptide. These T cells were also able to lyse M. bovis BCG infected, but not control monocytes, suggesting recognition of antigens during mycobacterial infection. In addition, peptide induced CD8(+) T-cells also displayed regulatory activity, since they inhibited T-cell proliferation. This regulatory activity was cell contact-dependent, and at least partly dependent on membrane-bound TGF-beta. Our results significantly increase our understanding of the human immune response to Mtb by identification of CD8(+) T-cell responses to novel HLA-E binding peptides of Mtb, which have cytotoxic as well as immunoregulatory activity.

Finding closest targets in non-oriented DEA models:the case of convex and non-convex technologies

This paper draws attention for the fact that traditional Data Envelopment Analysis (DEA) models do not provide the closest possible targets (or peers) to inefficient units, and presents a procedure to obtain such targets. It focuses on non-oriented efficiency measures (which assume that production units are able to control, and thus change, inputs and outputs simultaneously) both measured in relation to a Free Disposal Hull (FDH) technology and in relation to a convex technology. The approaches developed for finding close targets are applied to a sample of Portuguese bank branches.

The relative contributions of colour and luminance signals towards the visuomotor localisation of targets in human peripheral vision

We sought to determine the extent to which colour (and luminance) signals contribute towards the visuomotor localization of targets. To do so we exploited the movement-related illusory displacement a small stationary window undergoes when it has a continuously moving carrier grating behind it. We used drifting (1.0-4.2 Hz) red/green-modulated isoluminant gratings or yellow/black luminance-modulated gratings as carriers, each curtailed in space by a stationary, two-dimensional window. After each trial, the perceived location of the window was recorded with reference to an on-screen ruler (perceptual task) or the on-screen touch of a ballistic pointing movement made without visual feedback (visuomotor task). Our results showed that the perceptual displacement measures were similar for each stimulus type and weakly dependent on stimulus drift rate. However, while the visuomotor displacement measures were similar for each stimulus type at low drift rates (<4 Hz), they were significantly larger for luminance than colour stimuli at high drift rates (>4 Hz). We show that the latter cannot be attributed to differences in perceived speed between stimulus types. We assume, therefore, that our visuomotor localization judgements were more susceptible to the (carrier) motion of luminance patterns than colour patterns. We suggest that, far from being detrimental, this susceptibility may indicate the operation of mechanisms designed to counter the temporal asynchrony between perceptual experiences and the physical changes in the environment that give rise to them. We propose that perceptual localisation is equally supported by both colour and luminance signals but that visuomotor localisation is predominantly supported by luminance signals. We discuss the neural pathways that may be involved with visuomotor localization. © 2007 Springer-Verlag.

Modulating receptor function through RAMPs:can they represent drug targets in themselves?

G protein-coupled receptors (GPCRs) are successfully exploited as drug targets. As our understanding of how distinct GPCR subtypes can be generated expands, so do possibilities for therapeutic intervention via these receptors. Receptor activity-modifying proteins (RAMPs) are excellent examples of proteins that enhance diversity in. GPCR function. They facilitate the creation of binding pockets, controlling the pharmacology of some GPCRs. Moreover, they have the ability to regulate cell-surface trafficking, internalisation and signalling of GPCRs, creating novel opportunities for drug discovery. RAMPs could be directly targeted by drugs, or advantage could be taken of unique RAMP/GPCR interfaces for generating highly selective ligands.

Targets and self monitoring in hypertension: randomised controlled trial and cost effectiveness analysis

OBJECTIVES: To assess whether blood pressure control in primary care could be improved with the use of patient held targets and self monitoring in a practice setting, and to assess the impact of these on health behaviours, anxiety, prescribed antihypertensive drugs, patients' preferences, and costs. DESIGN: Randomised controlled trial. SETTING: Eight general practices in south Birmingham. PARTICIPANTS: 441 people receiving treatment in primary care for hypertension but not controlled below the target of < 140/85 mm Hg. INTERVENTIONS: Patients in the intervention group received treatment targets along with facilities to measure their own blood pressure at their general practice; they were also asked to visit their general practitioner or practice nurse if their blood pressure was repeatedly above the target level. Patients in the control group received usual care (blood pressure monitoring by their practice). MAIN OUTCOME MEASURES: Primary outcome: change in systolic blood pressure at six months and one year in both intervention and control groups. Secondary outcomes: change in health behaviours, anxiety, prescribed antihypertensive drugs, patients' preferences of method of blood pressure monitoring, and costs. RESULTS: 400 (91%) patients attended follow up at one year. Systolic blood pressure in the intervention group had significantly reduced after six months (mean difference 4.3 mm Hg (95% confidence interval 0.8 mm Hg to 7.9 mm Hg)) but not after one year (mean difference 2.7 mm Hg (- 1.2 mm Hg to 6.6 mm Hg)). No overall difference was found in diastolic blood pressure, anxiety, health behaviours, or number of prescribed drugs. Patients who self monitored lost more weight than controls (as evidenced by a drop in body mass index), rated self monitoring above monitoring by a doctor or nurse, and consulted less often. Overall, self monitoring did not cost significantly more than usual care (251 pounds sterling (437 dollars; 364 euros) (95% confidence interval 233 pounds sterling to 275 pounds sterling) versus 240 pounds sterling (217 pounds sterling to 263 pounds sterling). CONCLUSIONS: Practice based self monitoring resulted in small but significant improvements of blood pressure at six months, which were not sustained after a year. Self monitoring was well received by patients, anxiety did not increase, and there was no appreciable additional cost. Practice based self monitoring is feasible and results in blood pressure control that is similar to that in usual care.

A simple, sensitive and selective quantum-dot-based western blot method for the simultaneous detection of multiple targets from cell lysates

Quantum dots (Qdots) are fluorescent nanoparticles that have great potential as detection agents in biological applications. Their optical properties, including photostability and narrow, symmetrical emission bands with large Stokes shifts, and the potential for multiplexing of many different colours, give them significant advantages over traditionally used fluorescent dyes. Here, we report the straightforward generation of stable, covalent quantum dot-protein A/G bioconjugates that will be able to bind to almost any IgG antibody, and therefore can be used in many applications. An additional advantage is that the requirement for a secondary antibody is removed, simplifying experimental design. To demonstrate their use, we show their application in multiplexed western blotting. The sensitivity of Qdot conjugates is found to be superior to fluorescent dyes, and comparable to, or potentially better than, enhanced chemiluminescence. We show a true biological validation using a four-colour multiplexed western blot against a complex cell lysate background, and have significantly improved previously reported non-specific binding of the Qdots to cellular proteins.

Projected sequential Gaussian processes: flexible interpolation for large data sets

Recently within the machine learning and spatial statistics communities many papers have explored the potential of reduced rank representations of the covariance matrix, often referred to as projected or fixed rank approaches. In such methods the covariance function of the posterior process is represented by a reduced rank approximation which is chosen such that there is minimal information loss. In this paper a sequential framework for inference in such projected processes is presented, where the observations are considered one at a time. We introduce a C++ library for carrying out such projected, sequential estimation which adds several novel features. In particular we have incorporated the ability to use a generic observation operator, or sensor model, to permit data fusion. We can also cope with a range of observation error characteristics, including non-Gaussian observation errors. Inference for the variogram parameters is based on maximum likelihood estimation. We illustrate the projected sequential method in application to synthetic and real data sets. We discuss the software implementation and suggest possible future extensions.

A projected process kriging algorithm for sensor networks with heterogeneous error characteristics

Large monitoring networks are becoming increasingly common and can generate large datasets from thousands to millions of observations in size, often with high temporal resolution. Processing large datasets using traditional geostatistical methods is prohibitively slow and in real world applications different types of sensor can be found across a monitoring network. Heterogeneities in the error characteristics of different sensors, both in terms of distribution and magnitude, presents problems for generating coherent maps. An assumption in traditional geostatistics is that observations are made directly of the underlying process being studied and that the observations are contaminated with Gaussian errors. Under this assumption, sub–optimal predictions will be obtained if the error characteristics of the sensor are effectively non–Gaussian. One method, model based geostatistics, assumes that a Gaussian process prior is imposed over the (latent) process being studied and that the sensor model forms part of the likelihood term. One problem with this type of approach is that the corresponding posterior distribution will be non–Gaussian and computationally demanding as Monte Carlo methods have to be used. An extension of a sequential, approximate Bayesian inference method enables observations with arbitrary likelihoods to be treated, in a projected process kriging framework which is less computationally intensive. The approach is illustrated using a simulated dataset with a range of sensor models and error characteristics.

Development of an on-demand beam pulsing system for Pixe-analysis of thick targets

This work concerns the developnent of a proton irduced X-ray emission (PIXE) analysis system and a multi-sample scattering chamber facility. The characteristics of the beam pulsing system and its counting rate capabilities were evaluated by observing the ion-induced X-ray emission from pure thick copper targets, with and without beam pulsing operation. The characteristic X-rays were detected with a high resolution Si(Li) detector coupled to a rrulti-channel analyser. The removal of the pile-up continuum by the use of the on-demand beam pulsing is clearly demonstrated in this work. This new on-demand pu1sirg system with its counting rate capability of 25, 18 and 10 kPPS corresponding to 2, 4 am 8 usec main amplifier time constant respectively enables thick targets to be analysed more readily. Reproducibility tests of the on-demard beam pulsing system operation were checked by repeated measurements of the system throughput curves, with and without beam pulsing. The reproducibility of the analysis performed using this system was also checked by repeated measurements of the intensity ratios from a number of standard binary alloys during the experimental work. A computer programme has been developed to evaluate the calculations of the X-ray yields from thick targets bornbarded by protons, taking into account the secondary X-ray yield production due to characteristic X-ray fluorescence from an element energetically higher than the absorption edge energy of the other element present in the target. This effect was studied on metallic binary alloys such as Fe/Ni and Cr/Fe. The quantitative analysis of Fe/Ni and Cr/Fe alloy samples to determine their elemental composition taking into account the enhancement has been demonstrated in this work. Furthermore, the usefulness of the Rutherford backscattering (R.B.S.) technique to obtain the depth profiles of the elements in the upper micron of the sample is discussed.

Investigation of potential intervention targets to improve insulin action: a therapeutic approach

Impaired insulin action (insulin resistance) is a key factor in the pathogenesis of diabetes mellitus. To investigate therapeutic targets against insulin resistance, this thesis explores the mechanism of action of pharmacological agents and exogenous peptides known or suspected to modify insulin action. These included leptin, a hormone primarily involved in the regulation of body weight; sibutramine, an antiobesity agent; plant-derived compounds (pinitol and chamaemeloside) and agents known to affect insulin sensitivity, e.g. metformin, tolbutamide, thiazolidinediones, vanadyl sulphate and thioctic acid. Models used for investigation included the L6 skeletal muscle cell line and isolated skeletal muscles. In vivo studies were undertaken to investigate glycaemia, insulinaemia, satiety and body weight in streptozotocin-induced diabetic mice and obese (ob/ob) mice. Leptin acutely altered insulin action in skeletal muscle cells via the short form of the leptin receptor. This direct action of leptin was mediated via a pathway involving PI 3-kinase but not Jak2. The active metabolites of sibutramine had antidiabetic properties in vivo and directly improved insulin sensitivity in vitro. This effect appeared to be conducted via a non-PI 3-kinase-mediated increase in protein synthesis with facilitated glucose transport, and was independent of the serotonin and noradrenaline reuptake inhibition produced by sibutramine. Pinitol (a methyl inositol) had an insulin mimetic effect and was an effective glucose-lowering agent in insulinopenic states, acting directly on skeletal muscle. Conversely chamaemeloside appeared to improve glucose tolerance without directly altering glucose transport. Metformin directly increased basal glucose uptake independently of PI 3-kinase, possibly via an increase in the intrinsic activity of glucose transporters. Neither tolbutamide nor thiazolidinediones directly altered insulin sensitivity in L6 skeletal muscle cells: however vanadyl sulphate and thioctic acid increased glucose transport but appeared to exert toxic effects at therapeutic concentrations. Examination of glucose transport in skeletal muscle in this thesis has identified various components of post-receptor insulin signalling pathways which may be targeted to ameliorate insulin resistance. Type 2 Diabetes Mellitus Obesity L6 Skeletal Muscle Cells Glucose Transport Insulin Signalling 2

Early visual detection of oriented line targets: spatial characteristics,and reference frames of early visual orientation-processing

The orientations of lines and edges are important in defining the structure of the visual environment, and observers can detect differences in line orientation within the first few hundred milliseconds of scene viewing. The present work is a psychophysical investigation of the mechanisms of early visual orientation-processing. In experiments with briefly presented displays of line elements, observers indicated whether all the elements were uniformly oriented or whether a uniquely oriented target was present among uniformly oriented nontargets. The minimum difference between nontarget and target orientations that was required for effective target-detection (the orientation increment threshold) varied little with the number of elements and their spatial density, but the percentage of correct responses in detection of a large orientation-difference increased with increasing element density. The differing variations with element density of thresholds and percent-correct scores may indicate the operation of more than one mechanism in early visual orientation-processIng. Reducing element length caused threshold to increase with increasing number of elements, showing that the effectiveness of rapid, spatially parallel orientation-processing depends on element length. Orientational anisotropy in line-target detection has been reported previously: a coarse periodic variation and some finer variations in orientation increment threshold with nontarget orientation have been found. In the present work, the prominence of the coarse variation in relation to finer variations decreased with increasing effective viewing duration, as if the operation of coarse orientation-processing mechanisms precedes the operation of finer ones. Orientational anisotropy was prominent even when observers lay horizontally and viewed displays by looking upwards through a black cylinder that excluded all possible visual references for orientation. So, gravitational and visual cues are not essential to the definition of an orientational reference frame for early vision, and such a reference can be well defined by retinocentric neural coding, awareness of body-axis orientation, or both.

Non-neuronal, slow GABA signalling in the ventrobasal thalamus targets δ-subunit-containing GABA(A) receptors

The rodent ventrobasal (VB) thalamus contains a relatively uniform population of thalamocortical (TC) neurons that receive glutamatergic input from the vibrissae and the somatosensory cortex, and inhibitory input from the nucleus reticularis thalami (nRT). In this study we describe ?-aminobutyric acid (GABA)(A) receptor-dependent slow outward currents (SOCs) in TC neurons that are distinct from fast inhibitory postsynaptic currents (IPSCs) and tonic currents. SOCs occurred spontaneously or could be evoked by hypo-osmotic stimulus, and were not blocked by tetrodotoxin, removal of extracellular Ca(2+) or bafilomycin A1, indicating a non-synaptic, non-vesicular GABA origin. SOCs were more common in TC neurons of the VB compared with the dorsal lateral geniculate nucleus, and were rarely observed in nRT neurons, whilst SOC frequency in the VB increased with age. Application of THIP, a selective agonist at d-subunit-containing GABA(A) receptors, occluded SOCs, whereas the benzodiazepine site inverse agonist ß-CCB had no effect, but did inhibit spontaneous and evoked IPSCs. In addition, the occurrence of SOCs was reduced in mice lacking the d-subunit, and their kinetics were also altered. The anti-epileptic drug vigabatrin increased SOC frequency in a time-dependent manner, but this effect was not due to reversal of GABA transporters. Together, these data indicate that SOCs in TC neurons arise from astrocytic GABA release, and are mediated by d-subunit-containing GABA(A) receptors. Furthermore, these findings suggest that the therapeutic action of vigabatrin may occur through the augmentation of this astrocyte-neuron interaction, and highlight the importance of glial cells in CNS (patho) physiology.