Visualization of learning in multilayer perceptron networks using principal component analysis

This paper is concerned with the use of scientific visualization methods for the analysis of feedforward neural networks (NNs). Inevitably, the kinds of data associated with the design and implementation of neural networks are of very high dimensionality, presenting a major challenge for visualization. A method is described using the well-known statistical technique of principal component analysis (PCA). This is found to be an effective and useful method of visualizing the learning trajectories of many learning algorithms such as back-propagation and can also be used to provide insight into the learning process and the nature of the error surface.

Genetic algorithms for design of liquid retaining structure

In this paper, genetic algorithm (GA) is applied to the optimum design of reinforced concrete liquid retaining structures, which comprise three discrete design variables, including slab thickness, reinforcement diameter and reinforcement spacing. GA, being a search technique based on the mechanics of natural genetics, couples a Darwinian survival-of-the-fittest principle with a random yet structured information exchange amongst a population of artificial chromosomes. As a first step, a penalty-based strategy is entailed to transform the constrained design problem into an unconstrained problem, which is appropriate for GA application. A numerical example is then used to demonstrate strength and capability of the GA in this domain problem. It is shown that, only after the exploration of a minute portion of the search space, near-optimal solutions are obtained at an extremely converging speed. The method can be extended to application of even more complex optimization problems in other domains.

Inter-subband redundancy prediction using neural network for video coding

High performance video codec is mandatory for multimedia applications such as video-on-demand and video conferencing. Recent research has proposed numerous video coding techniques to meet the requirement in bandwidth, delay, loss and Quality-of-Service (QoS). In this paper, we present our investigations on inter-subband self-similarity within the wavelet-decomposed video frames using neural networks, and study the performance of applying the spatial network model to all video frames over time. The goal of our proposed method is to restore the highest perceptual quality for video transmitted over a highly congested network. Our contributions in this paper are: (1) A new coding model with neural network based, inter-subband redundancy (ISR) prediction for video coding using wavelet (2) The performance of 1D and 2D ISR prediction, including multiple levels of wavelet decompositions. Our result shows a short-term quality enhancement may be obtained using both 1D and 2D ISR prediction.

Neural correlates of the emergence of consciousness of thirst

Thirst was induced by rapid i.v. infusion of hypertonic saline (0.51 M at 13.4 ml/min). Ten humans were neuroimaged by positron-emission tomography (PET) and four by functional MRI (fMRI). PET images were made 25 min after beginning infusion, when the sensation of thirst began to enter the stream of consciousness. The fMRI images were made when the maximum rate of increase of thirst occurred. The PET results showed regional cerebral blood flow changes similar to those delineated when thirst was maximal. These loci involved the phylogenetically ancient areas of the brain. fMRI showed activation in the anterior wall of the third ventricle, an area that is key in the genesis of thirst but is not an area revealed by PET imaging. Thus, this region plays as major a role in thirst for humans as for animals. Strong activations in the brain with fMRI included the anterior cingulate, parahippocampal gyrus, inferior and middle frontal gyri, insula, and cerebellum. When the subjects drank water to satiation, thirst declined immediately to baseline. A precipitate decline in intensity of activation signal occurred in the anterior cingulate area (Brodmann area 32) putatively related to consciousness of thirst. The intensity of activation in the anterior wall of the third ventricle was essentially unchanged, which is consistent with the fact that a significant time (15-20 min) would be needed before plasma Na concentration changed as a result of water absorption from the gut.

Attentional modulation of neural responses to action observation: Implications for models of the human 'mirror' system

In primates, the observation of meaningful, goaldirected actions engages a network of cortical areas located within the premotor and inferior parietal lobules. Current models suggest that activity within these regions arises relatively automatically during passive action observation without the need for topdown control. Here we used functional magnetic resonance imaging to determine whether cortical activit)' associated with action observation is modulated by the strategic allocation of selective attention. Normal observers viewed movie clips of reach-to-grasp actions while performing an easy or difficult visual discrimination at the fovea. A wholebrain analysis was performed to determine the effects of attentional load on neural responses to observed hand actions. Our results suggest that cortical areas involved in action observation are significantiy modulated by attentional load. These findings have important implications for recent attempts to link the human action-observation system to response properties of "mirror neurons" in monkeys.

L-Allylglycine dissociates the neural substrates of fear in the periaqueductal gray of rats

The dorsal (dPAG) and ventral (vPAG) regions of the periaqueductal gray are well known to contain the neural substrates of fear and anxiety. Chemical or electrical stimulation of the dPAG induces freezing, followed by a robust behavioral reaction that has been considered an animal model of panic attack. In contrast, the vPAG is part of a neural system, in which immobility is the usual response to its stimulation. The defense reaction induced by the stimulation of either region is accompanied by anti nociception. Although GABAergic mechanisms are known to exert tonic inhibitory control on the neural substrates of fear in the dPAG, the role of these mechanisms in the vPAG is still unclear. The present study examined defensive behaviors and antinociception induced by microinjections of an inhibitor of gamma-aminobutyric acid synthesis, L-allylglycine (L-AG; 1, 3, and 5 mu g/0.2 mu l), into either the dPAG or vPAG of rats subjected to the open field and tail-flick tests. Passive or tense immobility was the predominant behavior after L-AG (1 or 3 mu g) microinjection into the vPAG and dPAG, respectively, which was replaced with intense hyperactivity, including jumps or rearings, after injections of a higher dose (5 mu g/0.2 mu l) into the dPAG or vPAG. Moreover, whereas intra-dPAG injection of 3 mu g L-AG produced intense antinociception, only weak antinociception was induced by intra-vPAG injections of 5 mu g L-AG. These findings suggest that GABA mechanisms are involved in the mediation of antinociception and behavioral inhibition to aversive stimulation of the vPAG and exert powerful control over the neural substrates of fear in the dPAG to prevent a full-blown defense reaction possibly associated with panic disorder. (C) 2009 Elsevier Inc. All rights reserved.

NEURAL CORRELATES OF SCENT MARKING BEHAVIOR IN C57BL/6J MICE: DETECTION AND RECOGNITION OF A SOCIAL STIMULUS

Mice show urinary scent marking behavior as a form of social communication. Marking to a conspecific stimulus mouse or odor varies with stimulus familiarity, indicating discrimination of novel and familiar animals. This study investigated Fos immunoreactivity in inbred C57BL/6J (C57) males following scent marking behavior in response to detection of a social stimulus, or discrimination between a familiar and an unfamiliar conspecific. In Experiment 1 C57 mice were exposed for four daily trials to an empty chamber; on a test day they were exposed to the same chamber or to a male CD-1 mouse in that chamber. Increased scent marking to the CD-1 mouse was associated with increased Fos-immunoreactive cells in the basolateral amygdala, medial amygdala, and dorsal and ventral premammillary nuclei. In Experiment 2 C57 mice were habituated to a CD-1 male for 4 consecutive days and, on the 5th day, exposed to the same CD-1 male, or to a novel CD-1 male. Mice exposed to a novel CD-1 displayed a significant increase in scent marking compared to their last exposure to the familiar stimulus, indicating discrimination of the novelty of this social stimulus. Marking to the novel stimulus was associated with enhanced activation of several telencephalic, as well as hypothalamic and midbrain, structures in which activation had not been seen in the detection paradigm (Experiment 1). These included medial prefrontal and piriform cortices, and lateral septum; the paraventricular nuclei, ventromedial nuclei, and lateral area of the hypothalamus, and the ventrolateral column of the periaqueductal gray. These data suggest that a circumscribed group of structures largely concerned with olfaction is involved in detection of a conspecific olfactory stimulus, whereas discrimination of a novel vs. a familiar conspecific stimulus engages a wider range of forebrain structures encompassing higher-order processes and potentially providing an interface between cognitions and emotions. (C) 2009 IBRO. Published by Elsevier Ltd. All rights reserved.

Use of the q-Gaussian mutation in evolutionary algorithms

This paper proposes the use of the q-Gaussian mutation with self-adaptation of the shape of the mutation distribution in evolutionary algorithms. The shape of the q-Gaussian mutation distribution is controlled by a real parameter q. In the proposed method, the real parameter q of the q-Gaussian mutation is encoded in the chromosome of individuals and hence is allowed to evolve during the evolutionary process. In order to test the new mutation operator, evolution strategy and evolutionary programming algorithms with self-adapted q-Gaussian mutation generated from anisotropic and isotropic distributions are presented. The theoretical analysis of the q-Gaussian mutation is also provided. In the experimental study, the q-Gaussian mutation is compared to Gaussian and Cauchy mutations in the optimization of a set of test functions. Experimental results show the efficiency of the proposed method of self-adapting the mutation distribution in evolutionary algorithms.

Spectrum and Prevalence of FP/TMEM127 Gene Mutations in Pheochromocytomas and Paragangliomas

Context Pheochromocytomas and paragangliomas are genetically heterogeneous neural crest-derived neoplasms. We recently identified germline mutations of the novel transmembrane-encoding gene FP/TMEM127 in familial and sporadic pheochromocytomas consistent with a tumor suppressor effect. Objectives To examine the prevalence and spectrum of FP/TMEM127 mutations in pheochromocytomas and paragangliomas and to test the effect of mutations in vitro. Design, Setting, and Participants We sequenced the FP/TMEM127 gene in 990 individuals with pheochromocytomas and/or paragangliomas, including 898 previously unreported cases without mutations in other susceptibility genes from 8 independent worldwide referral centers between January 2009 and June 2010. A multiplex polymerase chain reaction-based method was developed to screen for large gene deletions in 545 of these samples. Confocal microscopy of 5 transfected mutant proteins was used to determine their subcellular localization. Main Outcome Measures The frequency and type of FP/TMEM127 mutation or deletion was assessed and correlated with clinical variables; the subcellular localization of 5 overexpressed mutants was compared with wild-type FP/TMEM127 protein. Results We identified 19 potentially pathogenic FP/TMEM127 germline mutations in 20 independent families, but no large deletions were detected. All mutation carriers had adrenal tumors, including 7 bilateral (P=2.7 x 10(-4)) and/or with familial disease (5 of 20 samples; P=.005). The median age at disease onset in the FP/TMEM127 mutation group was similar to that of patients without a mutation (41.5 vs 45 years, respectively; P=.54). The most common presentation was that of a single benign adrenal tumor in patients older than 40 years. Malignancy was seen in 1 mutation carrier (5%). Expression of 5 novel FP/TMEM127 mutations in cell lines revealed diffuse localization of the mutant proteins in contrast with the discrete multiorganelle distribution of wild-type TMEM127. Conclusions Germline mutations of FP/TMEM127 were associated with pheochromocytoma but not paraganglioma and occured in an age group frequently excluded from genetic screening algorithms. Disease-associated mutations disrupt intracellular distribution of the FP/TMEM127 protein. JAMA. 2010;304(23):2611-2619 www.jama.com

Robust algorithms for solving stochastic partial differential equations

A robust semi-implicit central partial difference algorithm for the numerical solution of coupled stochastic parabolic partial differential equations (PDEs) is described. This can be used for calculating correlation functions of systems of interacting stochastic fields. Such field equations can arise in the description of Hamiltonian and open systems in the physics of nonlinear processes, and may include multiplicative noise sources. The algorithm can be used for studying the properties of nonlinear quantum or classical field theories. The general approach is outlined and applied to a specific example, namely the quantum statistical fluctuations of ultra-short optical pulses in chi((2)) parametric waveguides. This example uses a non-diagonal coherent state representation, and correctly predicts the sub-shot noise level spectral fluctuations observed in homodyne detection measurements. It is expected that the methods used wilt be applicable for higher-order correlation functions and other physical problems as well. A stochastic differencing technique for reducing sampling errors is also introduced. This involves solving nonlinear stochastic parabolic PDEs in combination with a reference process, which uses the Wigner representation in the example presented here. A computer implementation on MIMD parallel architectures is discussed. (C) 1997 Academic Press.

Most of the patients presenting myocardial infarction would not be eligible for intensive lipid-lowering based on clinical algorithms or plasma C-reactive protein

Objective: The study we assessed how often patients who are manifesting a myocardial infarction (MI) would not be considered candidates for intensive lipid-lowering therapy based on the current guidelines. Methods: In 355 consecutive patients manifesting ST elevation MI (STEMI), admission plasma C-reactive protein (CRP) was measured and Framingham risk score (FRS), PROCAM risk score, Reynolds risk score, ASSIGN risk score, QRISK, and SCORE algorithms were applied. Cardiac computed tomography and carotid ultrasound were performed to assess the coronary artery calcium score (CAC), carotid intima-media thickness (cIMT) and the presence of carotid plaques. Results: Less than 50% of STEMI patients would be identified as having high risk before the event by any of these algorithms. With the exception of FRS (9%), all other algorithms would assign low risk to about half of the enrolled patients. Plasma CRP was <1.0 mg/L in 70% and >2 mg/L in 14% of the patients. The average cIMT was 0.8 +/- 0.2 mm and only in 24% of patients was >= 1.0 mm. Carotid plaques were found in 74% of patients. CAC > 100 was found in 66% of patients. Adding CAC >100 plus the presence of carotid plaque, a high-risk condition would be identified in 100% of the patients using any of the above mentioned algorithms. Conclusion: More than half of patients manifesting STEMI would not be considered as candidates for intensive preventive therapy by the current clinical algorithms. The addition of anatomical parameters such as CAC and the presence of carotid plaques can substantially reduce the CVD risk underestimation. (C) 2010 Elsevier Ireland Ltd. All rights reserved.

Neural activity changes to emotional stimuli in healthy individuals under chronic use of clomipramine

Previous functional magnetic resonance imaging (fMRI) studies examined neural activity responses to emotive stimuli in healthy individuals after acute/subacute administration of antidepressants. We now report the effects of repeated use of the antidepressant clomipramine on fMRI data acquired during presentation of emotion-provoking and neutral stimuli on healthy volunteers. A total of 12 volunteers were evaluated with fMRI after receiving low doses of clomipramine for 4 weeks and again after 4 weeks of washout. Fear-, happiness-, anger-provoking and neutral pictures from the International Affective Picture System (IAPS) were used. Data analysis was performed with statistical parametric mapping (P < 0.05). Paired t-test comparisons for each condition between medicated and unmedicated states showed, to negative valence paradigms, decrease in brain activity in the amygdala when participants were medicated. We also demonstrated, across both positive and negative valence paradigms, consistent decreases in brain activity in the medicated state in the anterior cingulate gyrus and insula. This is the first report of modulatory effects of repeated antidepressant use on the central representation of somatic states in response to emotions of both negative and positive valences in healthy individuals. Also, our results corroborate findings of antidepressant-induced temporolimbic activity changes to emotion-provoking stimuli obtained in studies of subjects treated acutely with such agents.

Hyperdopaminergia and NMDA Receptor Hypofunction Disrupt Neural Phase Signaling

Neural phase signaling has gained attention as a putative coding mechanism through which the brain binds the activity of neurons across distributed brain areas to generate thoughts, percepts, and behaviors. Neural phase signaling has been shown to play a role in various cognitive processes, and it has been suggested that altered phase signaling may play a role in mediating the cognitive deficits observed across neuropsychiatric illness. Here, we investigated neural phase signaling in two mouse models of cognitive dysfunction: mice with genetically induced hyperdopaminergia [dopamine transporter knock-out (DAT-KO) mice] and mice with genetically induced NMDA receptor hypofunction [NMDA receptor subunit-1 knockdown (NR1-KD) mice]. Cognitive function in these mice was assessed using a radial-arm maze task, and local field potentials were recorded from dorsal hippocampus and prefrontal cortex as DAT-KO mice, NR1-KD mice, and their littermate controls engaged in behavioral exploration. Our results demonstrate that both DAT-KO and NR1-KD mice display deficits in spatial cognitive performance. Moreover, we show that persistent hyperdopaminergia alters interstructural phase signaling, whereas NMDA receptor hypofunction alters interstructural and intrastructural phase signaling. These results demonstrate that dopamine and NMDA receptor dependent glutamate signaling play a critical role in coordinating neural phase signaling, and encourage further studies to investigate the role that deficits in phase signaling play in mediating cognitive dysfunction.

Genetic algorithms for continuous optimization problems - a concept of parameter-space size adjustment

The concept of parameter-space size adjustment is pn,posed in order to enable successful application of genetic algorithms to continuous optimization problems. Performance of genetic algorithms with six different combinations of selection and reproduction mechanisms, with and without parameter-space size adjustment, were severely tested on eleven multiminima test functions. An algorithm with the best performance was employed for the determination of the model parameters of the optical constants of Pt, Ni and Cr.

Neural response telemetry in patients with the double-array cochlear implant

This study aimed to evaluate the neural response in double-array cochlear implant as well as to describe the refractory recovery and the spread of excitation functions. In a prospective study 11 patients were implanted with the double-array cochlear implant. Neural response telemetry (NRT) was performed intra-operatively. NRT threshold could be registered in 6 of the 11 patients, at least in one electrode. The remaining five patients did not show measurable neural response intra-operatively. It was noted that although recovery and spread of excitation functions could be recorded in all the tested electrodes with measurable neural responses, the responses were shown to be different from the usual register in patients with other etiologies.