ART-EMAP: A Neural Network Architecture for Learning and Prediction by Evidence Accumulation

This paper introduces ART-EMAP, a neural architecture that uses spatial and temporal evidence accumulation to extend the capabilities of fuzzy ARTMAP. ART-EMAP combines supervised and unsupervised learning and a medium-term memory process to accomplish stable pattern category recognition in a noisy input environment. The ART-EMAP system features (i) distributed pattern registration at a view category field; (ii) a decision criterion for mapping between view and object categories which can delay categorization of ambiguous objects and trigger an evidence accumulation process when faced with a low confidence prediction; (iii) a process that accumulates evidence at a medium-term memory (MTM) field; and (iv) an unsupervised learning algorithm to fine-tune performance after a limited initial period of supervised network training. ART-EMAP dynamics are illustrated with a benchmark simulation example. Applications include 3-D object recognition from a series of ambiguous 2-D views.

ARTMAP: Supervised Real-Time Learning and Classification of Nonstationary Data by a Self-Organizing Neural Network

This article introduces a new neural network architecture, called ARTMAP, that autonomously learns to classify arbitrarily many, arbitrarily ordered vectors into recognition categories based on predictive success. This supervised learning system is built up from a pair of Adaptive Resonance Theory modules (ARTa and ARTb) that are capable of self-organizing stable recognition categories in response to arbitrary sequences of input patterns. During training trials, the ARTa module receives a stream {a^(p)} of input patterns, and ARTb receives a stream {b^(p)} of input patterns, where b^(p) is the correct prediction given a^(p). These ART modules are linked by an associative learning network and an internal controller that ensures autonomous system operation in real time. During test trials, the remaining patterns a^(p) are presented without b^(p), and their predictions at ARTb are compared with b^(p). Tested on a benchmark machine learning database in both on-line and off-line simulations, the ARTMAP system learns orders of magnitude more quickly, efficiently, and accurately than alternative algorithms, and achieves 100% accuracy after training on less than half the input patterns in the database. It achieves these properties by using an internal controller that conjointly maximizes predictive generalization and minimizes predictive error by linking predictive success to category size on a trial-by-trial basis, using only local operations. This computation increases the vigilance parameter ρa of ARTa by the minimal amount needed to correct a predictive error at ARTb· Parameter ρa calibrates the minimum confidence that ARTa must have in a category, or hypothesis, activated by an input a^(p) in order for ARTa to accept that category, rather than search for a better one through an automatically controlled process of hypothesis testing. Parameter ρa is compared with the degree of match between a^(p) and the top-down learned expectation, or prototype, that is read-out subsequent to activation of an ARTa category. Search occurs if the degree of match is less than ρa. ARTMAP is hereby a type of self-organizing expert system that calibrates the selectivity of its hypotheses based upon predictive success. As a result, rare but important events can be quickly and sharply distinguished even if they are similar to frequent events with different consequences. Between input trials ρa relaxes to a baseline vigilance pa When ρa is large, the system runs in a conservative mode, wherein predictions are made only if the system is confident of the outcome. Very few false-alarm errors then occur at any stage of learning, yet the system reaches asymptote with no loss of speed. Because ARTMAP learning is self stabilizing, it can continue learning one or more databases, without degrading its corpus of memories, until its full memory capacity is utilized.

ART 2-A: An Adaptive Resonance Algorithm for Rapid Category Learning and Recognition

This article introduces ART 2-A, an efficient algorithm that emulates the self-organizing pattern recognition and hypothesis testing properties of the ART 2 neural network architecture, but at a speed two to three orders of magnitude faster. Analysis and simulations show how the ART 2-A systems correspond to ART 2 dynamics at both the fast-learn limit and at intermediate learning rates. Intermediate learning rates permit fast commitment of category nodes but slow recoding, analogous to properties of word frequency effects, encoding specificity effects, and episodic memory. Better noise tolerance is hereby achieved without a loss of learning stability. The ART 2 and ART 2-A systems are contrasted with the leader algorithm. The speed of ART 2-A makes practical the use of ART 2 modules in large-scale neural computation.

Fuzzy ART: Fast Stable Learning and Categorization of Analog Patterns by an Adaptive Resonance System

A Fuzzy ART model capable of rapid stable learning of recognition categories in response to arbitrary sequences of analog or binary input patterns is described. Fuzzy ART incorporates computations from fuzzy set theory into the ART 1 neural network, which learns to categorize only binary input patterns. The generalization to learning both analog and binary input patterns is achieved by replacing appearances of the intersection operator (n) in AHT 1 by the MIN operator (Λ) of fuzzy set theory. The MIN operator reduces to the intersection operator in the binary case. Category proliferation is prevented by normalizing input vectors at a preprocessing stage. A normalization procedure called complement coding leads to a symmetric theory in which the MIN operator (Λ) and the MAX operator (v) of fuzzy set theory play complementary roles. Complement coding uses on-cells and off-cells to represent the input pattern, and preserves individual feature amplitudes while normalizing the total on-cell/off-cell vector. Learning is stable because all adaptive weights can only decrease in time. Decreasing weights correspond to increasing sizes of category "boxes". Smaller vigilance values lead to larger category boxes. Learning stops when the input space is covered by boxes. With fast learning and a finite input set of arbitrary size and composition, learning stabilizes after just one presentation of each input pattern. A fast-commit slow-recode option combines fast learning with a forgetting rule that buffers system memory against noise. Using this option, rare events can be rapidly learned, yet previously learned memories are not rapidly erased in response to statistically unreliable input fluctuations.

Effect of chronic angiotensin converting enzyme inhibition on spatial memory and anxiety-like behavours in rats

Angiotensin converting enzyme inhibitors (ACEis) are widely used anti-hypertensive agents that are also reported to have positive effects on mood and cognition. The present study examined the influence of the ACEi, perindopril, on cognitive performance and anxiety measures in rats. Two groups of rats were treated orally for one week with the ACEi, perindopril, at doses of 0.1 and 1.0mg/kg/day. Learning was assessed by the reference memory task in the water maze, comparing treated to control rats. Over five training days both perindopril-treated groups learnt the location of the submerged platform in the water maze task significantly faster than control rats. A 60s probe trial on day 6 showed that the 1.0mg/kg/day group spent significantly longer time in the training quadrant than control rats. This improved performance in the swim maze task was not due to the effect of perindopril on motor activity or the anxiety levels of the rats as perindopril-treated and control animals behaved similarly in activity boxes and on the elevated+maze. These results confirm the anecdotal human studies that ACEis have a positive influence on cognition and provide possibilities for ACEis to be developed into therapies for memory loss.

The Association Between Childhood Trauma and Memory Functioning in Schizophrenia

Objective: Both neurocognitive impairments and a history of childhood abuse are highly prevalent in patients with schizophrenia. Childhood trauma has been associated with memory impairment as well as hippocampal volume reduction in adult survivors. The aim of the following study was to examine the contribution of childhood adversity to verbal memory functioning in people with schizophrenia. Methods: Eighty-five outpatients with a Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition) diagnosis of chronic schizophrenia were separated into 2 groups on the basis of self-reports of childhood trauma. Performance on measures of episodic narrative memory, list learning, and working memory was then compared using multivariate analysis of covariance. Results: Thirty-eight (45%) participants reported moderate to severe levels of childhood adversity, while 47 (55%) reported no or low levels of childhood adversity. After controlling for premorbid IQ and current depressive symptoms, the childhood trauma group had significantly poorer working memory and episodic narrative memory. However, list learning was similar between groups. Conclusion: Childhood trauma is an important variable that can contribute to specific ongoing memory impairments in schizophrenia.

Dual-processes in learning and judgment:Evidence from the multiple cue probability learning paradigm

Multiple cue probability learning (MCPL) involves learning to predict a criterion based on a set of novel cues when feedback is provided in response to each judgment made. But to what extent does MCPL require controlled attention and explicit hypothesis testing? The results of two experiments show that this depends on cue polarity. Learning about cues that predict positively is aided by automatic cognitive processes, whereas learning about cues that predict negatively is especially demanding on controlled attention and hypothesis testing processes. In the studies reported here, negative, but not positive cue learning related to individual differences in working memory capacity both on measures of overall judgment performance and modelling of the implicit learning process. However, the introduction of a novel method to monitor participants' explicit beliefs about a set of cues on a trial-by-trial basis revealed that participants were engaged in explicit hypothesis testing about positive and negative cues, and explicit beliefs about both types of cues were linked to working memory capacity. Taken together, our results indicate that while people are engaged in explicit hypothesis testing during cue learning, explicit beliefs are applied to judgment only when cues are negative. © 2012 Elsevier Inc.

Physiological correlates of memory recall in infancy:vagal tone, cortisol, and imitation in preterm and full-term infants at 6 months

We examined the role of physiological regulation (heart rate, vagal tone, and salivary cortisol) in short-term memory in preterm and full-term 6-month-old infants. Using a deferred imitation task to evaluate social learning and memory recall, an experimenter modeled three novel behaviors (removing, shaking, and replacing a glove) on a puppet. Infants were tested immediately after being shown the behaviors as well as following a 10-min delay. We found that greater suppression of vagal tone was related to better memory recall in full-term infants tested immediately after the demonstration as well as in preterm infants tested later after a 10-min delay. We also found that preterm infants showed greater coordination of physiology (i.e., tighter coupling of vagal tone, heart rate, and cortisol) at rest and during retrieval than full-term infants. These findings provide new evidence of the important links between changes in autonomic activity and memory recall in infancy. They also raise the intriguing possibility that social learning, imitation behavior, and the formation of new memories are modulated by autonomic activity that is coordinated differently in preterm and full-term infants.

A behavioral study of alpha-1b adrenergic receptor knockout mice: increased reaction to novelty and selectively reduced learning capacities.

Knockout mice lacking the alpha-1b adrenergic receptor were tested in behavioral experiments. Reaction to novelty was first assessed in a simple test in which the time taken by the knockout mice and their littermate controls to enter a second compartment was compared. Then the mice were tested in an open field to which unknown objects were subsequently added. Special novelty was introduced by moving one of the familiar objects to another location in the open field. Spatial behavior and memory were further studied in a homing board test, and in the water maze. The alpha-1b knockout mice showed an enhanced reactivity to new situations. They were faster to enter the new environment, covered longer paths in the open field, and spent more time exploring the new objects. They reacted like controls to modification inducing spatial novelty. In the homing board test, both the knockout mice and the control mice seemed to use a combination of distant visual and proximal olfactory cues, showing place preference only if the two types of cues were redundant. In the water maze the alpha-1b knockout mice were unable to learn the task, which was confirmed in a probe trial without platform. They were perfectly able, however, to escape in a visible platform procedure. These results confirm previous findings showing that the noradrenergic pathway is important for the modulation of behaviors such as reaction to novelty and exploration, and suggest that this is mediated, at least partly, through the alpha-1b adrenergic receptors. The lack of alpha-1b adrenergic receptors in spatial orientation does not seem important in cue-rich tasks but may interfere with orientation in situations providing distant cues only.

The role of retinoic acid in long-term memory formation and synaptic plasticity in the mollusc Lymnaea stagnalis

The active metabolite of vitamin A, retinoic acid (RA), is involved in memory formation and hippocampal plasticity in vertebrates. A similar role for retinoid signaling in learning and memory formation has not previously been examined in an invertebrate species. However, the conservation of retinoid signaling between vertebrates and invertebrates is supported by the presence of retinoid signaling machinery in invertebrates. For example, in the mollusc Lymnaea stagnalis the metabolic enzymes and retinoid receptors have been cloned from the CNS. In this study I demonstrated that impairing retinoid signaling in Lymnaea by either inhibiting RALDH activity or using retinoid receptor antagonists, prevented the formation of long-term memory (LTM). However, learning and intermediate-term memory were not affected. An additional finding was that exposure to constant darkness (due to the light-sensitive nature of RA) itself enhanced memory formation. This memory-promoting effect of darkness was sufficient to overcome the inhibitory effects of RALDH inhibition, but not that of a retinoid receptor antagonist, suggesting that environmental light conditions may influence retinoid signaling. Since RA also influences synaptic plasticity underlying hippocampal-dependent memory formation, I also examined whether RA would act in a trophic manner to influence synapse formation and/or synaptic transmission between invertebrate neurons. However, I found no evidence to support an effect of RA on post-tetanic potentiation of a chemical synapse. Retinoic acid did, however, reduce transmission at electrical synapses in a cell-specific manner. Overall, these studies provide the first evidence for a role of RA in the formation of implicit long-term memories in an invertebrate species and suggest that the role of retinoid signaling in memory formation has an ancient origin.

The roles of perirhinal cortex, postrhinal cortex, and the fornix in memory for objects, contexts, and events in the rat

Investigation of the anatomical substructure of the medial temporal lobe has revealed a number of highly interconnected areas, which has led some to propose that the region operates as a unitary memory system. However, here we outline the results of a number of studies from our laboratories, which investigate the contributions of the rat's perirhinal cortex and postrhinal cortex to memory, concentrating particularly on their respective roles in memory for objects. By contrasting patterns of impairment and spared abilities on a number of related tasks, we suggest that perirhinal cortex and postrhinal cortex make distinctive contributions to learning and memory: for example, that postrhinal cortex is important in learning about within-scene position and context. We also provide evidence that despite the strong connectivity between these cortical regions and the hippocampus, the hippocampus, as evidenced by lesions of the fornix, has a distinct function of its own-combining information about objects, positions, and contexts.

Auditory distraction from low-intensity noise: a review of the consequences for learning and workplace environments

The 'irrelevant sound effect' in short-term memory is commonly believed to entail a number of direct consequences for cognitive performance in the office and other workplaces (e.g. S. P. Banbury, S. Tremblay, W. J. Macken, & D. M. Jones, 2001). It may also help to identify what types of sound are most suitable as auditory warning signals. However, the conclusions drawn are based primarily upon evidence from a single task (serial recall) and a single population (young adults). This evidence is reconsidered from the standpoint of different worker populations confronted with common workplace tasks and auditory environments. Recommendations are put forward for factors to be considered when assessing the impact of auditory distraction in the workplace. Copyright (c) 2005 John Wiley & Sons, Ltd.

Neurofuzzy mixture of experts network parallel learning and model construction algorithms

A connection between a fuzzy neural network model with the mixture of experts network (MEN) modelling approach is established. Based on this linkage, two new neuro-fuzzy MEN construction algorithms are proposed to overcome the curse of dimensionality that is inherent in the majority of associative memory networks and/or other rule based systems. The first construction algorithm employs a function selection manager module in an MEN system. The second construction algorithm is based on a new parallel learning algorithm in which each model rule is trained independently, for which the parameter convergence property of the new learning method is established. As with the first approach, an expert selection criterion is utilised in this algorithm. These two construction methods are equivalent in their effectiveness in overcoming the curse of dimensionality by reducing the dimensionality of the regression vector, but the latter has the additional computational advantage of parallel processing. The proposed algorithms are analysed for effectiveness followed by numerical examples to illustrate their efficacy for some difficult data based modelling problems.

A role for hippocampal PSA-NCAM and NMDA-NR2B receptor function in flavonoid-induced spatial memory improvements in young rats

The increase in incidence and prevalence of neurodegenerative diseases highlights the need for a more comprehensive understanding of how food components may affect neural systems. In particular, flavonoids have been recognized as promising agents capable of influencing different aspects of synaptic plasticity resulting in improvements in memory and learning in both animals and humans. Our previous studies highlight the efficacy of flavonoids in reversing memory impairments in aged rats, yet little is known about the effects of these compounds in healthy animals, particularly with respect to the molecular mechanisms by which flavonoids might alter the underlying synaptic modifications responsible for behavioral changes. We demonstrate that a 3-week intervention with two dietary doses of flavonoids (Dose I: 8.7 mg/day and Dose II: 17.4 mg/day) facilitates spatial memory acquisition and consolidation (24 recall) (p < 0.05) in young healthy rats. We show for the first time that these behavioral improvements are linked to increased levels in the polysialylated form of the neural adhesion molecule (PSA-NCAM) in the dentate gyrus (DG) of the hippocampus, which is known to be required for the establishment of durable memories. We observed parallel increases in hippocampal NMDA receptors containing the NR2B subunit for both 8.7 mg/day (p < 0.05) and 17.4 mg/day (p < 0.001) doses, suggesting an enhancement of glutamate signaling following flavonoid intervention. This is further strengthened by the simultaneous modulation of hippocampal ERK/CREB/BDNF signaling and the activation of the Akt/mTOR/Arc pathway, which are crucial in inducing changes in the strength of hippocampal synaptic connections that underlie learning. Collectively, the present data supports a new role for PSA-NCAM and NMDA-NR2B receptor on flavonoid-induced improvements in learning and memory, contributing further to the growing body of evidence suggesting beneficial effects of flavonoids in cognition and brain health.

Spatial memory in sedentary and trained diabetic rats: Molecular mechanisms

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)