Adaptive Resonance Theory

SyNAPSE program of the Defense Advanced Projects Research Agency (Hewlett-Packard Company, subcontract under DARPA prime contract HR0011-09-3-0001, and HRL Laboratories LLC, subcontract #801881-BS under DARPA prime contract HR0011-09-C-0001); CELEST, an NSF Science of Learning Center (SBE-0354378)

Extracted Memory from Temporal Patterns Using Adaptive Resonance and Recurrent Network

We can recognize objects through receiving continuously huge temporal information including redundancy and noise, and can memorize them. This paper proposes a neural network model which extracts pre-recognized patterns from temporally sequential patterns which include redundancy, and memorizes the patterns temporarily. This model consists of an adaptive resonance system and a recurrent time-delay network. The extraction is executed by the matching mechanism of the adaptive resonance system, and the temporal information is processed and stored by the recurrent network. Simple simulations are examined to exemplify the property of extraction.

Fuzzy ART: An Adaptive Resonance Algorithm for Rapid, Stable Classification of Analog Patterns

The Fuzzy ART system introduced herein incorporates computations from fuzzy set theory into ART 1. For example, the intersection (n) operator used in ART 1 learning is replaced by the MIN operator (A) of fuzzy set theory. Fuzzy ART reduces to ART 1 in response to binary input vectors, but can also learn stable categories in response to analog input vectors. In particular, the MIN operator reduces to the intersection operator in the binary case. Learning is stable because all adaptive weights can only decrease in time. A preprocessing step, called complement coding, uses on-cell and off-cell responses to prevent category proliferation. Complement coding normalizes input vectors while preserving the amplitudes of individual feature activations.

ART 2-A: An Adaptive Resonance Algorithm for Rapid Category Learning and Recognition

This article introduces ART 2-A, an efficient algorithm that emulates the self-organizing pattern recognition and hypothesis testing properties of the ART 2 neural network architecture, but at a speed two to three orders of magnitude faster. Analysis and simulations show how the ART 2-A systems correspond to ART 2 dynamics at both the fast-learn limit and at intermediate learning rates. Intermediate learning rates permit fast commitment of category nodes but slow recoding, analogous to properties of word frequency effects, encoding specificity effects, and episodic memory. Better noise tolerance is hereby achieved without a loss of learning stability. The ART 2 and ART 2-A systems are contrasted with the leader algorithm. The speed of ART 2-A makes practical the use of ART 2 modules in large-scale neural computation.

Fuzzy ART: Fast Stable Learning and Categorization of Analog Patterns by an Adaptive Resonance System

A Fuzzy ART model capable of rapid stable learning of recognition categories in response to arbitrary sequences of analog or binary input patterns is described. Fuzzy ART incorporates computations from fuzzy set theory into the ART 1 neural network, which learns to categorize only binary input patterns. The generalization to learning both analog and binary input patterns is achieved by replacing appearances of the intersection operator (n) in AHT 1 by the MIN operator (Λ) of fuzzy set theory. The MIN operator reduces to the intersection operator in the binary case. Category proliferation is prevented by normalizing input vectors at a preprocessing stage. A normalization procedure called complement coding leads to a symmetric theory in which the MIN operator (Λ) and the MAX operator (v) of fuzzy set theory play complementary roles. Complement coding uses on-cells and off-cells to represent the input pattern, and preserves individual feature amplitudes while normalizing the total on-cell/off-cell vector. Learning is stable because all adaptive weights can only decrease in time. Decreasing weights correspond to increasing sizes of category "boxes". Smaller vigilance values lead to larger category boxes. Learning stops when the input space is covered by boxes. With fast learning and a finite input set of arbitrary size and composition, learning stabilizes after just one presentation of each input pattern. A fast-commit slow-recode option combines fast learning with a forgetting rule that buffers system memory against noise. Using this option, rare events can be rapidly learned, yet previously learned memories are not rapidly erased in response to statistically unreliable input fluctuations.

A Recurrent Cooperative/Competitive Field for Segmentation of Magnetic Resonance Brain Imagery

The Grey-White Decision Network is introduced as an application of an on-center, off-surround recurrent cooperative/competitive network for segmentation of magnetic resonance imaging (MRI) brain images. The three layer dynamical system relaxes into a solution where each pixel is labeled as either grey matter, white matter, or "other" matter by considering raw input intensity, edge information, and neighbor interactions. This network is presented as an example of applying a recurrent cooperative/competitive field (RCCF) to a problem with multiple conflicting constraints. Simulations of the network and its phase plane analysis are presented.

Adaptive Resonance Associative Map: A Hierarchical ART System for Fast Stable Associative Learning

This paper introduces a new class of predictive ART architectures, called Adaptive Resonance Associative Map (ARAM) which performs rapid, yet stable heteroassociative learning in real time environment. ARAM can be visualized as two ART modules sharing a single recognition code layer. The unit for recruiting a recognition code is a pattern pair. Code stabilization is ensured by restricting coding to states where resonances are reached in both modules. Simulation results have shown that ARAM is capable of self-stabilizing association of arbitrary pattern pairs of arbitrary complexity appearing in arbitrary sequence by fast learning in real time environment. Due to the symmetrical network structure, associative recall can be performed in both directions.

Attenuation of inflammatory events in human intervertebral disc cells with a tumor necrosis factor antagonist.

STUDY DESIGN: The inflammatory responses of primary human intervertebral disc (IVD) cells to tumor necrosis factor α (TNF-α) and an antagonist were evaluated in vitro. OBJECTIVE: To investigate an ability for soluble TNF receptor type II (sTNFRII) to antagonize TNF-α-induced inflammatory events in primary human IVD cells in vitro. SUMMARY OF BACKGROUND DATA: TNF-α is a known mediator of inflammation and pain associated with radiculopathy and IVD degeneration. sTNFRs and their analogues are of interest for the clinical treatment of these IVD pathologies, although information on the effects of sTNFR on human IVD cells remains unknown. METHODS: IVD cells were isolated from surgical tissues procured from 15 patients and cultured with or without 1.4 nmol/L TNF-α (25 ng/mL). Treatment groups were coincubated with varying doses of sTNFRII (12.5-100 nmol/L). Nitric oxide (NO), prostaglandin E₂ (PGE₂), and interleukin-6 (IL6) levels in media were quantified to characterize the inflammatory phenotype of the IVD cells. RESULTS: Across all patients, TNF-α induced large, statistically significant increases in NO, PGE₂, and IL6 secretion from IVD cells compared with controls (60-, 112-, and 4-fold increases, respectively; P < 0.0001). Coincubation of TNF-α with nanomolar doses of sTNFRII significantly attenuated the secretion of NO and PGE₂ in a dose-dependent manner, whereas IL6 levels were unchanged. Mean IC₅₀ values for NO and PGE₂ were found to be 35.1 and 20.5 nmol/L, respectively. CONCLUSION: Nanomolar concentrations of sTNFRII were able to significantly attenuate the effects of TNF-α on primary human IVD cells in vitro. These results suggest this sTNFR to be a potent TNF antagonist with potential to attenuate inflammation in IVD pathology.

Optimized, unequal pulse spacing in multiple echo sequences improves refocusing in magnetic resonance.

A recent quantum computing paper (G. S. Uhrig, Phys. Rev. Lett. 98, 100504 (2007)) analytically derived optimal pulse spacings for a multiple spin echo sequence designed to remove decoherence in a two-level system coupled to a bath. The spacings in what has been called a "Uhrig dynamic decoupling (UDD) sequence" differ dramatically from the conventional, equal pulse spacing of a Carr-Purcell-Meiboom-Gill (CPMG) multiple spin echo sequence. The UDD sequence was derived for a model that is unrelated to magnetic resonance, but was recently shown theoretically to be more general. Here we show that the UDD sequence has theoretical advantages for magnetic resonance imaging of structured materials such as tissue, where diffusion in compartmentalized and microstructured environments leads to fluctuating fields on a range of different time scales. We also show experimentally, both in excised tissue and in a live mouse tumor model, that optimal UDD sequences produce different T(2)-weighted contrast than do CPMG sequences with the same number of pulses and total delay, with substantial enhancements in most regions. This permits improved characterization of low-frequency spectral density functions in a wide range of applications.

Surface plasmon resonance in nanostructured metal films under the Kretschmann configuration

We systematically investigated the surface plasmon resonance in one-dimensional (1D) subwavelength nanostructured metal films under the Kretschmann configuration. We calculated the reflectance, transmittance, and absorption for varying the dielectric fill factor, the period of the 1D nanostructure, and the metal film thickness. We have found that the small dielectric slits in the metal films reduce the surface plasmon resonance angle and move it toward the critical angle for total internal reflection. The reduction in surface plasmon resonance angle in nanostructured metal films is due to the increased intrinsic free electron oscillation frequency in metal nanostructures. Also we have found that the increasing the spatial frequency of the 1D nanograting reduces the surface plasmon resonance angle, which indicates that less momentum is needed to match the momentum of the surface plasmon-polariton. The variation in the nanostructured metal film thickness changes the resonance angle slightly, but mainly remains as a mean to adjust the coupling between the incident optical wave and the surface plasmon-polariton wave. © 2009 American Institute of Physics.

Spectral structure of the pygmy dipole resonance.

High-sensitivity studies of E1 and M1 transitions observed in the reaction 138Ba(gamma,gamma{'}) at energies below the one-neutron separation energy have been performed using the nearly monoenergetic and 100% linearly polarized photon beams of the HIgammaS facility. The electric dipole character of the so-called "pygmy" dipole resonance was experimentally verified for excitations from 4.0 to 8.6 MeV. The fine structure of the M1 "spin-flip" mode was observed for the first time in N=82 nuclei.

Magnetic resonance water proton relaxation in protein solutions and tissue: T(1rho) dispersion characterization.

BACKGROUND: Image contrast in clinical MRI is often determined by differences in tissue water proton relaxation behavior. However, many aspects of water proton relaxation in complex biological media, such as protein solutions and tissue are not well understood, perhaps due to the limited empirical data. PRINCIPAL FINDINGS: Water proton T(1), T(2), and T(1rho) of protein solutions and tissue were measured systematically under multiple conditions. Crosslinking or aggregation of protein decreased T(2) and T(1rho), but did not change high-field T(1). T(1rho) dispersion profiles were similar for crosslinked protein solutions, myocardial tissue, and cartilage, and exhibited power law behavior with T(1rho)(0) values that closely approximated T(2). The T(1rho) dispersion of mobile protein solutions was flat above 5 kHz, but showed a steep curve below 5 kHz that was sensitive to changes in pH. The T(1rho) dispersion of crosslinked BSA and cartilage in DMSO solvent closely resembled that of water solvent above 5 kHz but showed decreased dispersion below 5 kHz. CONCLUSIONS: Proton exchange is a minor pathway for tissue T(1) and T(1rho) relaxation above 5 kHz. Potential models for relaxation are discussed, however the same molecular mechanism appears to be responsible across 5 decades of frequencies from T(1rho) to T(1).

Analysis of the genome and transcriptome of Cryptococcus neoformans var. grubii reveals complex RNA expression and microevolution leading to virulence attenuation.

Cryptococcus neoformans is a pathogenic basidiomycetous yeast responsible for more than 600,000 deaths each year. It occurs as two serotypes (A and D) representing two varieties (i.e. grubii and neoformans, respectively). Here, we sequenced the genome and performed an RNA-Seq-based analysis of the C. neoformans var. grubii transcriptome structure. We determined the chromosomal locations, analyzed the sequence/structural features of the centromeres, and identified origins of replication. The genome was annotated based on automated and manual curation. More than 40,000 introns populating more than 99% of the expressed genes were identified. Although most of these introns are located in the coding DNA sequences (CDS), over 2,000 introns in the untranslated regions (UTRs) were also identified. Poly(A)-containing reads were employed to locate the polyadenylation sites of more than 80% of the genes. Examination of the sequences around these sites revealed a new poly(A)-site-associated motif (AUGHAH). In addition, 1,197 miscRNAs were identified. These miscRNAs can be spliced and/or polyadenylated, but do not appear to have obvious coding capacities. Finally, this genome sequence enabled a comparative analysis of strain H99 variants obtained after laboratory passage. The spectrum of mutations identified provides insights into the genetics underlying the micro-evolution of a laboratory strain, and identifies mutations involved in stress responses, mating efficiency, and virulence.

Magnetic Resonance Imaging Biomarkers of Renal Structure and Function

The kidney's major role in filtration depends on its high blood flow, concentrating mechanisms, and biochemical activation. The kidney's greatest strengths also lead to vulnerability for drug-induced nephrotoxicity and other renal injuries. The current standard to diagnose renal injuries is with a percutaneous renal biopsy, which can be biased and insufficient. In one particular case, biopsy of a kidney with renal cell carcinoma can actually initiate metastasis. Tools that are sensitive and specific to detect renal disease early are essential, especially noninvasive diagnostic imaging. While other imaging modalities (ultrasound and x-ray/CT) have their unique advantages and disadvantages, MRI has superb soft tissue contrast without ionizing radiation. More importantly, there is a richness of contrast mechanisms in MRI that has yet to be explored and applied to study renal disease.

The focus of this work is to advance preclinical imaging tools to study the structure and function of the renal system. Studies were conducted in normal and disease models to understand general renal physiology as well as pathophysiology. This dissertation is separated into two parts--the first is the identification of renal architecture with ex vivo MRI; the second is the characterization of renal dynamics and function with in vivo MRI. High resolution ex vivo imaging provided several opportunities including: 1) identification of fine renal structures, 2) implementation of different contrast mechanisms with several pulse sequences and reconstruction methods, 3) development of image-processing tools to extract regions and structures, and 4) understanding of the nephron structures that create MR contrast and that are important for renal physiology. The ex vivo studies allowed for understanding and translation to in vivo studies. While the structure of this dissertation is organized by individual projects, the goal is singular: to develop magnetic resonance imaging biomarkers for renal system.

The work presented here includes three ex vivo studies and two in vivo studies:

1) Magnetic resonance histology of age-related nephropathy in sprague dawley.

2) Quantitative susceptibility mapping of kidney inflammation and fibrosis in type 1 angiotensin receptor-deficient mice.

3) Susceptibility tensor imaging of the kidney and its microstructural underpinnings.

4) 4D MRI of renal function in the developing mouse.

5) 4D MRI of polycystic kidneys in rapamycin treated Glis3-deficient mice.

Age-related effects on the neural correlates of autobiographical memory retrieval.

Older adults recall less episodically rich autobiographical memories (AM), however, the neural basis of this effect is not clear. Using functional MRI, we examined the effects of age during search and elaboration phases of AM retrieval. Our results suggest that the age-related attenuation in the episodic richness of AMs is associated with difficulty in the strategic retrieval processes underlying recovery of information during elaboration. First, age effects on AM activity were more pronounced during elaboration than search, with older adults showing less sustained recruitment of the hippocampus and ventrolateral prefrontal cortex (VLPFC) for less episodically rich AMs. Second, there was an age-related reduction in the modulation of top-down coupling of the VLPFC on the hippocampus for episodically rich AMs. In sum, the present study shows that changes in the sustained response and coupling of the hippocampus and prefrontal cortex (PFC) underlie age-related reductions in episodic richness of the personal past.