Fuzzy ART: Fast Stable Learning and Categorization of Analog Patterns by an Adaptive Resonance System

A Fuzzy ART model capable of rapid stable learning of recognition categories in response to arbitrary sequences of analog or binary input patterns is described. Fuzzy ART incorporates computations from fuzzy set theory into the ART 1 neural network, which learns to categorize only binary input patterns. The generalization to learning both analog and binary input patterns is achieved by replacing appearances of the intersection operator (n) in AHT 1 by the MIN operator (Λ) of fuzzy set theory. The MIN operator reduces to the intersection operator in the binary case. Category proliferation is prevented by normalizing input vectors at a preprocessing stage. A normalization procedure called complement coding leads to a symmetric theory in which the MIN operator (Λ) and the MAX operator (v) of fuzzy set theory play complementary roles. Complement coding uses on-cells and off-cells to represent the input pattern, and preserves individual feature amplitudes while normalizing the total on-cell/off-cell vector. Learning is stable because all adaptive weights can only decrease in time. Decreasing weights correspond to increasing sizes of category "boxes". Smaller vigilance values lead to larger category boxes. Learning stops when the input space is covered by boxes. With fast learning and a finite input set of arbitrary size and composition, learning stabilizes after just one presentation of each input pattern. A fast-commit slow-recode option combines fast learning with a forgetting rule that buffers system memory against noise. Using this option, rare events can be rapidly learned, yet previously learned memories are not rapidly erased in response to statistically unreliable input fluctuations.

The Construction of Arbitrary Stable Dynamics in Non-Linear Neural Networks

In this paper, two methods for constructing systems of ordinary differential equations realizing any fixed finite set of equilibria in any fixed finite dimension are introduced; no spurious equilibria are possible for either method. By using the first method, one can construct a system with the fewest number of equilibria, given a fixed set of attractors. Using a strict Lyapunov function for each of these differential equations, a large class of systems with the same set of equilibria is constructed. A method of fitting these nonlinear systems to trajectories is proposed. In addition, a general method which will produce an arbitrary number of periodic orbits of shapes of arbitrary complexity is also discussed. A more general second method is given to construct a differential equation which converges to a fixed given finite set of equilibria. This technique is much more general in that it allows this set of equilibria to have any of a large class of indices which are consistent with the Morse Inequalities. It is clear that this class is not universal, because there is a large class of additional vector fields with convergent dynamics which cannot be constructed by the above method. The easiest way to see this is to enumerate the set of Morse indices which can be obtained by the above method and compare this class with the class of Morse indices of arbitrary differential equations with convergent dynamics. The former set of indices are a proper subclass of the latter, therefore, the above construction cannot be universal. In general, it is a difficult open problem to construct a specific example of a differential equation with a given fixed set of equilibria, permissible Morse indices, and permissible connections between stable and unstable manifolds. A strict Lyapunov function is given for this second case as well. This strict Lyapunov function as above enables construction of a large class of examples consistent with these more complicated dynamics and indices. The determination of all the basins of attraction in the general case for these systems is also difficult and open.

The Synthesis of Arbitrary Stable Dynamics in Non-linear Neural Networks II: Feedback and Universality

We wish to construct a realization theory of stable neural networks and use this theory to model the variety of stable dynamics apparent in natural data. Such a theory should have numerous applications to constructing specific artificial neural networks with desired dynamical behavior. The networks used in this theory should have well understood dynamics yet be as diverse as possible to capture natural diversity. In this article, I describe a parameterized family of higher order, gradient-like neural networks which have known arbitrary equilibria with unstable manifolds of known specified dimension. Moreover, any system with hyperbolic dynamics is conjugate to one of these systems in a neighborhood of the equilibrium points. Prior work on how to synthesize attractors using dynamical systems theory, optimization, or direct parametric. fits to known stable systems, is either non-constructive, lacks generality, or has unspecified attracting equilibria. More specifically, We construct a parameterized family of gradient-like neural networks with a simple feedback rule which will generate equilibrium points with a set of unstable manifolds of specified dimension. Strict Lyapunov functions and nested periodic orbits are obtained for these systems and used as a method of synthesis to generate a large family of systems with the same local dynamics. This work is applied to show how one can interpolate finite sets of data, on nested periodic orbits.

Adaptive Resonance Associative Map: A Hierarchical ART System for Fast Stable Associative Learning

This paper introduces a new class of predictive ART architectures, called Adaptive Resonance Associative Map (ARAM) which performs rapid, yet stable heteroassociative learning in real time environment. ARAM can be visualized as two ART modules sharing a single recognition code layer. The unit for recruiting a recognition code is a pattern pair. Code stabilization is ensured by restricting coding to states where resonances are reached in both modules. Simulation results have shown that ARAM is capable of self-stabilizing association of arbitrary pattern pairs of arbitrary complexity appearing in arbitrary sequence by fast learning in real time environment. Due to the symmetrical network structure, associative recall can be performed in both directions.

On stable non supersymmetric vacua at the bottom of cascading theories

We consider a wide class of cascading gauge theories which usually lead to runaway behaviour in the IR, and discuss possible deformations of the superpotential at the bottom of the cascade which stabilize the runaway direction and provide stable non-supersymmetric vacua. The models we find may allow for a weakly coupled supergravity analysis of dynamical supersymmetric breaking in the context of the gauge/string correspondence. © SISSA 2006.

Stable serum levels of anti-Müllerian hormone during the menstrual cycle: A prospective study in normo-ovulatory women

Background: Anti-Müllerian hormone (AMH), secreted by the granulosa cells of preantral and small antral follicles, has been described as a potential marker of the ovarian reserve. The aim of this prospective study is to investigate the variations of AMH during the menstrual cycle in a young selected population of normo-ovulatory women and to analyse the correlation with other cyclic hormones. Methods: Twenty healthy volunteers from 19 to 35 years old, with regular menstrual cycles (26-31 days), normal ovulation (day 10-16), normal hormonal profile and normal body mass index (18-26 kg/m2) were recruited. AMH, inhibin B, LH, FSH, estradiol and progesterone were measured on days 3, 7, 10, 11, 12, 13, 14, 15, 16, 18, 21 and 25 of a spontaneous cycle. Results: AMH serum levels, either expressed by cycleday or aligned according to the ovulation day, did not show any significant variations during the menstrual cycle. Conclusions: No significant fluctuation of the AMH level during the menstrual cycle was observed. Therefore, this hormone is particularly interesting for clinical evaluation of the ovarian reserve as it may be used at any time during the cycle. © The Author 2007.

The effects of osmotic stress on the structure and function of the cell nucleus.

Osmotic stress is a potent regulator of the normal function of cells that are exposed to osmotically active environments under physiologic or pathologic conditions. The ability of cells to alter gene expression and metabolic activity in response to changes in the osmotic environment provides an additional regulatory mechanism for a diverse array of tissues and organs in the human body. In addition to the activation of various osmotically- or volume-activated ion channels, osmotic stress may also act on the genome via a direct biophysical pathway. Changes in extracellular osmolality alter cell volume, and therefore, the concentration of intracellular macromolecules. In turn, intracellular macromolecule concentration is a key physical parameter affecting the spatial organization and pressurization of the nucleus. Hyper-osmotic stress shrinks the nucleus and causes it to assume a convoluted shape, whereas hypo-osmotic stress swells the nucleus to a size that is limited by stretch of the nuclear lamina and induces a smooth, round shape of the nucleus. These behaviors are consistent with a model of the nucleus as a charged core/shell structure pressurized by uneven partition of macromolecules between the nucleoplasm and the cytoplasm. These osmotically-induced alterations in the internal structure and arrangement of chromatin, as well as potential changes in the nuclear membrane and pores are hypothesized to influence gene transcription and/or nucleocytoplasmic transport. A further understanding of the biophysical and biochemical mechanisms involved in these processes would have important ramifications for a range of fields including differentiation, migration, mechanotransduction, DNA repair, and tumorigenesis.

A novel, non-apoptotic role for Scythe/BAT3: a functional switch between the pro- and anti-proliferative roles of p21 during the cell cycle.

BACKGROUND: Scythe/BAT3 is a member of the BAG protein family whose role in apoptosis has been extensively studied. However, since the developmental defects observed in Bat3-null mouse embryos cannot be explained solely by defects in apoptosis, we investigated whether BAT3 is also involved in cell-cycle progression. METHODS/PRINCIPAL FINDINGS: Using a stable-inducible Bat3-knockdown cellular system, we demonstrated that reduced BAT3 protein level causes a delay in both G1/S transition and G2/M progression. Concurrent with these changes in cell-cycle progression, we observed a reduction in the turnover and phosphorylation of the CDK inhibitor p21, which is best known as an inhibitor of DNA replication; however, phosphorylated p21 has also been shown to promote G2/M progression. Our findings indicate that in Bat3-knockdown cells, p21 continues to be synthesized during cell-cycle phases that do not normally require p21, resulting in p21 protein accumulation and a subsequent delay in cell-cycle progression. Finally, we showed that BAT3 co-localizes with p21 during the cell cycle and is required for the translocation of p21 from the cytoplasm to the nucleus during the G1/S transition and G2/M progression. CONCLUSION: Our study reveals a novel, non-apoptotic role for BAT3 in cell-cycle regulation. By maintaining a low p21 protein level during the G1/S transition, BAT3 counteracts the inhibitory effect of p21 on DNA replication and thus enables the cells to progress from G1 to S phase. Conversely, during G2/M progression, BAT3 facilitates p21 phosphorylation by cyclin A/Cdk2, an event required for G2/M progression. BAT3 modulates these pro- and anti-proliferative roles of p21 at least in part by regulating cyclin A abundance, as well as p21 translocation between the cytoplasm and the nucleus to ensure that it functions in the appropriate intracellular compartment during each phase of the cell cycle.

Stable isotope ratios indicate diet and habitat use in New World monkeys.

This paper demonstrates the use of stable isotope ratios of carbon and nitrogen in animal tissue for indicating aspects of species behavioral strategy. We analyzed hair from individuals representing four species of New World monkeys (Alouatta palliata, the mantled howler; Ateles geoffroyi, the spider monkey; Cebus capucinus, the capuchin; and Brachyteles arachnoides, the woolly-spider monkey or muriqui) for delta 13C and delta 15N using previously developed methods. There are no significant differences in either carbon or nitrogen ratios between sexes, sampling year, or year of analysis. Seasonal differences in delta 13C reached a low level of significance but do not affect general patterns. Variation within species was similar to that recorded previously within single individuals. The omega 13C data show a bimodal distribution with significant difference between the means. The two monkey populations living in an evergreen forest were similar to each other and different from the other two monkey populations that inhabited dry, deciduous forests. This bimodal distribution is independent of any particular species' diet and reflects the level of leaf cover in the two types of forest. The delta 15N data display three significantly different modes. The omnivorous capuchins were most positive reflecting a trophic level offset. The spider monkeys and the muriquis were similar to one another and significantly more positive than the howlers. This distribution among totally herbivorous species correlates with the ingestion of legumes by the howler monkey population. In combination, these data indicate that museum-curated primate material can be analyzed to yield information on forest cover and diet in populations and species lacking behavioral data.

Injectable laminin-functionalized hydrogel for nucleus pulposus regeneration.

Cell delivery to the pathological intervertebral disc (IVD) has significant therapeutic potential for enhancing IVD regeneration. The development of injectable biomaterials that retain delivered cells, promote cell survival, and maintain or promote an NP cell phenotype in vivo remains a significant challenge. Previous studies have demonstrated NP cell - laminin interactions in the nucleus pulposus (NP) region of the IVD that promote cell attachment and biosynthesis. These findings suggest that incorporating laminin ligands into carriers for cell delivery may be beneficial for promoting NP cell survival and phenotype. Here, an injectable, laminin-111 functionalized poly(ethylene glycol) (PEG-LM111) hydrogel was developed as a biomaterial carrier for cell delivery to the IVD. We evaluated the mechanical properties of the PEG-LM111 hydrogel, and its ability to retain delivered cells in the IVD space. Gelation occurred in approximately 20 min without an initiator, with dynamic shear moduli in the range of 0.9-1.4 kPa. Primary NP cell retention in cultured IVD explants was significantly higher over 14 days when cells were delivered within a PEG-LM111 carrier, as compared to cells in liquid suspension. Together, these results suggest this injectable laminin-functionalized biomaterial may be an easy to use carrier for delivering cells to the IVD.

Integrin-mediated interactions with extracellular matrix proteins for nucleus pulposus cells of the human intervertebral disc.

The extracellular matrix (ECM) of the human intervertebral disc is rich in molecules that interact with cells through integrin-mediated attachments. Porcine nucleus pulposus (NP) cells have been shown to interact with laminin (LM) isoforms LM-111 and LM-511 through select integrins that regulate biosynthesis and cell attachment. Since human NP cells lose many phenotypic characteristics with age, attachment and interaction with the ECM may be altered. Expression of LM-binding integrins was quantified for human NP cells using flow cytometry. The cell-ECM attachment mechanism was determined by quantifying cell attachment to LM-111, LM-511, or type II collagen after functionally blocking specific integrin subunits. Human NP cells express integrins β1, α3, and α5, with over 70% of cells positive for each subunit. Blocking subunit β1 inhibited NP cell attachment to all substrates. Blocking subunits α1, α2, α3, and α5 simultaneously, but not individually, inhibits NP cell attachment to laminins. While integrin α6β1 mediated porcine NP cell attachment to LM-111, we found integrins α3, α5, and β1 instead contributed to human NP cell attachment. These findings identify integrin subunits that may mediate interactions with the ECM for human NP cells and could be used to promote cell attachment, survival, and biosynthesis in cell-based therapeutics.

Differentiation of mouse induced pluripotent stem cells (iPSCs) into nucleus pulposus-like cells in vitro.

A large percentage of the population may be expected to experience painful symptoms or disability associated with intervertebral disc (IVD) degeneration - a condition characterized by diminished integrity of tissue components. Great interest exists in the use of autologous or allogeneic cells delivered to the degenerated IVD to promote matrix regeneration. Induced pluripotent stem cells (iPSCs), derived from a patient's own somatic cells, have demonstrated their capacity to differentiate into various cell types although their potential to differentiate into an IVD cell has not yet been demonstrated. The overall objective of this study was to assess the possibility of generating iPSC-derived nucleus pulposus (NP) cells in a mouse model, a cell population that is entirely derived from notochord. This study employed magnetic activated cell sorting (MACS) to isolate a CD24(+) iPSC subpopulation. Notochordal cell-related gene expression was analyzed in this CD24(+) cell fraction via real time RT-PCR. CD24(+) iPSCs were then cultured in a laminin-rich culture system for up to 28 days, and the mouse NP phenotype was assessed by immunostaining. This study also focused on producing a more conducive environment for NP differentiation of mouse iPSCs with addition of low oxygen tension and notochordal cell conditioned medium (NCCM) to the culture platform. iPSCs were evaluated for an ability to adopt an NP-like phenotype through a combination of immunostaining and biochemical assays. Results demonstrated that a CD24(+) fraction of mouse iPSCs could be retrieved and differentiated into a population that could synthesize matrix components similar to that in native NP. Likewise, the addition of a hypoxic environment and NCCM induced a similar phenotypic result. In conclusion, this study suggests that mouse iPSCs have the potential to differentiate into NP-like cells and suggests the possibility that they may be used as a novel cell source for cellular therapy in the IVD.

The role of extracellular matrix elasticity and composition in regulating the nucleus pulposus cell phenotype in the intervertebral disc: a narrative review.

Intervertebral disc (IVD) disorders are a major contributor to disability and societal health care costs. Nucleus pulposus (NP) cells of the IVD exhibit changes in both phenotype and morphology with aging-related IVD degeneration that may impact the onset and progression of IVD pathology. Studies have demonstrated that immature NP cell interactions with their extracellular matrix (ECM) may be key regulators of cellular phenotype, metabolism and morphology. The objective of this article is to review our recent experience with studies of NP cell-ECM interactions that reveal how ECM cues can be manipulated to promote an immature NP cell phenotype and morphology. Findings demonstrate the importance of a soft (<700 Pa), laminin-containing ECM in regulating healthy, immature NP cells. Knowledge of NP cell-ECM interactions can be used for development of tissue engineering or cell delivery strategies to treat IVD-related disorders.

Delay activity of saccade-related neurons in the caudal dentate nucleus of the macaque cerebellum.

The caudal dentate nucleus (DN) in lateral cerebellum is connected with two visual/oculomotor areas of the cerebrum: the frontal eye field and lateral intraparietal cortex. Many neurons in frontal eye field and lateral intraparietal cortex produce "delay activity" between stimulus and response that correlates with processes such as motor planning. Our hypothesis was that caudal DN neurons would have prominent delay activity as well. From lesion studies, we predicted that this activity would be related to self-timing, i.e., the triggering of saccades based on the internal monitoring of time. We recorded from neurons in the caudal DN of monkeys (Macaca mulatta) that made delayed saccades with or without a self-timing requirement. Most (84%) of the caudal DN neurons had delay activity. These neurons conveyed at least three types of information. First, their activity was often correlated, trial by trial, with saccade initiation. Correlations were found more frequently in a task that required self-timing of saccades (53% of neurons) than in a task that did not (27% of neurons). Second, the delay activity was often tuned for saccade direction (in 65% of neurons). This tuning emerged continuously during a trial. Third, the time course of delay activity associated with self-timed saccades differed significantly from that associated with visually guided saccades (in 71% of neurons). A minority of neurons had sensory-related activity. None had presaccadic bursts, in contrast to DN neurons recorded more rostrally. We conclude that caudal DN neurons convey saccade-related delay activity that may contribute to the motor preparation of when and where to move.

Influence of the thalamus on spatial visual processing in frontal cortex.

Each of our movements activates our own sensory receptors, and therefore keeping track of self-movement is a necessary part of analysing sensory input. One way in which the brain keeps track of self-movement is by monitoring an internal copy, or corollary discharge, of motor commands. This concept could explain why we perceive a stable visual world despite our frequent quick, or saccadic, eye movements: corollary discharge about each saccade would permit the visual system to ignore saccade-induced visual changes. The critical missing link has been the connection between corollary discharge and visual processing. Here we show that such a link is formed by a corollary discharge from the thalamus that targets the frontal cortex. In the thalamus, neurons in the mediodorsal nucleus relay a corollary discharge of saccades from the midbrain superior colliculus to the cortical frontal eye field. In the frontal eye field, neurons use corollary discharge to shift their visual receptive fields spatially before saccades. We tested the hypothesis that these two components-a pathway for corollary discharge and neurons with shifting receptive fields-form a circuit in which the corollary discharge drives the shift. First we showed that the known spatial and temporal properties of the corollary discharge predict the dynamic changes in spatial visual processing of cortical neurons when saccades are made. Then we moved from this correlation to causation by isolating single cortical neurons and showing that their spatial visual processing is impaired when corollary discharge from the thalamus is interrupted. Thus the visual processing of frontal neurons is spatiotemporally matched with, and functionally dependent on, corollary discharge input from the thalamus. These experiments establish the first link between corollary discharge and visual processing, delineate a brain circuit that is well suited for mediating visual stability, and provide a framework for studying corollary discharge in other sensory systems.