Extracted Memory from Temporal Patterns Using Adaptive Resonance and Recurrent Network

We can recognize objects through receiving continuously huge temporal information including redundancy and noise, and can memorize them. This paper proposes a neural network model which extracts pre-recognized patterns from temporally sequential patterns which include redundancy, and memorizes the patterns temporarily. This model consists of an adaptive resonance system and a recurrent time-delay network. The extraction is executed by the matching mechanism of the adaptive resonance system, and the temporal information is processed and stored by the recurrent network. Simple simulations are examined to exemplify the property of extraction.

Space, Time and Learning in the Hippocampus: How Fine Spatial and Temporal Scales Are Expanded into Population Codes for Behavioral Control

The hippocampus participates in multiple functions, including spatial navigation, adaptive timing, and declarative (notably, episodic) memory. How does it carry out these particular functions? The present article proposes that hippocampal spatial and temporal processing are carried out by parallel circuits within entorhinal cortex, dentate gyrus, and CA3 that are variations of the same circuit design. In particular, interactions between these brain regions transform fine spatial and temporal scales into population codes that are capable of representing the much larger spatial and temporal scales that are needed to control adaptive behaviors. Previous models of adaptively timed learning propose how a spectrum of cells tuned to brief but different delays are combined and modulated by learning to create a population code for controlling goal-oriented behaviors that span hundreds of milliseconds or even seconds. Here it is proposed how projections from entorhinal grid cells can undergo a similar learning process to create hippocampal place cells that can cover a space of many meters that are needed to control navigational behaviors. The suggested homology between spatial and temporal processing may clarify how spatial and temporal information may be integrated into an episodic memory.

Emergence of Tri-Phasic Muscle Activation from the Non-linear Interactions of Central and Spinal Neural Network Circuits

The origin of the tri-phasic burst pattern, observed in the EMGs of opponent muscles during rapid self-terminated movements, has been controversial. Here we show by computer simulation that the pattern emerges from interactions between a central neural trajectory controller (VITE circuit) and a peripheral neuromuscularforce controller (FLETE circuit). Both neural models have been derived from simple functional constraints that have led to principled explanations of a wide variety of behavioral and neurobiological data, including, as shown here, the generation of tri-phasic bursts.

A Neural Network Model for the Spatial and Temporal Response of Retinal Ganglion Cells

This article introduces a quantitative model of early visual system function. The model is formulated to unify analyses of spatial and temporal information processing by the nervous system. Functional constraints of the model suggest mechanisms analogous to photoreceptors, bipolar cells, and retinal ganglion cells, which can be formally represented with first order differential equations. Preliminary numerical simulations and analytical results show that the same formal mechanisms can explain the behavior of both X (linear) and Y (nonlinear) retinal ganglion cell classes by simple changes in the relative width of the receptive field (RF) center and surround mechanisms. Specifically, an increase in the width of the RF center results in a change from X-like to Y-like response, in agreement with anatomical data on the relationship between α- and

Working Memory Networks for Learning Temporal Order, with Application to 3-D Visual Object Recognition

Working memory neural networks are characterized which encode the invariant temporal order of sequential events. Inputs to the networks, called Sustained Temporal Order REcurrent (STORE) models, may be presented at widely differing speeds, durations, and interstimulus intervals. The STORE temporal order code is designed to enable all emergent groupings of sequential events to be stably learned and remembered in real time, even as new events perturb the system. Such a competence is needed in neural architectures which self-organize learned codes for variable-rate speech perception, sensory-motor planning, or 3-D visual object recognition. Using such a working memory, a self-organizing architecture for invariant 3-D visual object recognition is described. The new model is based on the model of Seibert and Waxman (1990a), which builds a 3-D representation of an object from a temporally ordered sequence of its 2-D aspect graphs. The new model, called an ARTSTORE model, consists of the following cascade of processing modules: Invariant Preprocessor --> ART 2 --> STORE Model --> ART 2 --> Outstar Network.

An Integrated Neural Network-Event-Related Potentials Model of Temporal and Probability Context Effects on Event Categorization

We present a neural network that adapts and integrates several preexisting or new modules to categorize events in short term memory (STM), encode temporal order in working memory, evaluate timing and probability context in medium and long term memory. The model shows how processed contextual information modulates event recognition and categorization, focal attention and incentive motivation. The model is based on a compendium of Event Related Potentials (ERPs) and behavioral results either collected by the authors or compiled from the classical ERP literature. Its hallmark is, at the functional level, the interplay of memory registers endowed with widely different dynamical ranges, and at the structural level, the attempt to relate the different modules to known anatomical structures.

Working Memories for Storage and Recall of Arbitrary Temporal Sequences

A working memory model is described that is capable of storing and recalling arbitrary temporal sequences of events, including repeated items. These memories encode the invariant temporal order of sequential events that may be presented at widely differing speeds, durations, and interstimulus intervals. This temporal order code is designed to enable all possible groupings of sequential events to be stably learned and remembered in real time, even as new events perturb the system.

A Neural Network Model of Spatio-Temporal Pattern Recognition, Recall and Timing

This paper describes the design of a self~organizing, hierarchical neural network model of unsupervised serial learning. The model learns to recognize, store, and recall sequences of unitized patterns, using either short-term memory (STM) or both STM and long-term memory (LTM) mechanisms. Timing information is learned and recall {both from STM and from LTM) is performed with a learned rhythmical structure. The network, bearing similarities with ART (Carpenter & Grossberg 1987a), learns to map temporal sequences to unitized patterns, which makes it suitable for hierarchical operation. It is therefore capable of self-organizing codes for sequences of sequences. The capacity is only limited by the number of nodes provided. Selected simulation results are reported to illustrate system properties.

Equilibria and Dynamics of a Neural Network Model for Opponent Muscle Control

One of the advantages of biological skeleto-motor systems is the opponent muscle design, which in principle makes it possible to achieve facile independent control of joint angle and joint stiffness. Prior analysis of equilibrium states of a biologically-based neural network for opponent muscle control, the FLETE model, revealed that such independent control requires specialized interneuronal circuitry to efficiently coordinate the opponent force generators. In this chapter, we refine the FLETE circuit variables specification and update the equilibrium analysis. We also incorporate additional neuronal circuitry that ensures efficient opponent force generation and velocity regulation during movement.

Store Working Memory Networks for Storage and Recall of Arbitrary Temporal Sequences

Neural network models of working memory, called Sustained Temporal Order REcurrent (STORE) models, are described. They encode the invariant temporal order of sequential events in short term memory (STM) in a way that mimics cognitive data about working memory, including primacy, recency, and bowed order and error gradients. As new items are presented, the pattern of previously stored items is invariant in the sense that, relative activations remain constant through time. This invariant temporal order code enables all possible groupings of sequential events to be stably learned and remembered in real time, even as new events perturb the system. Such a competence is needed to design self-organizing temporal recognition and planning systems in which any subsequence of events may need to be categorized in order to to control and predict future behavior or external events. STORE models show how arbitrary event sequences may be invariantly stored, including repeated events. A preprocessor interacts with the working memory to represent event repeats in spatially separate locations. It is shown why at least two processing levels are needed to invariantly store events presented with variable durations and interstimulus intervals. It is also shown how network parameters control the type and shape of primacy, recency, or bowed temporal order gradients that will be stored.

Soft sediment ecology of Lough Hyne Marine Reserve - spatial and temporal patterns

Distribution of soft sediment benthic fauna and the environmental factors affecting them were studied, to investigate changes across spatial and temporal scales. Investigations took place at Lough Hyne Marine Reserve using a range of methods. Data on the sedimentation rates of organic and inorganic matter were collected at monthly intervals for one year at a number of sites around the Lough, by use of vertical midwater-column sediment traps. Sedimentation of these two fractions were not coupled; inorganic matter sedimentation depended on hydrodynamic and weather factors, while the organic matter sedimentation was more complex, being dependent on biological and chemical processes in the water column. The effects of regular hypoxic episodes on benthic fauna due to a natural seasonal thermocline were studied in the deep Western Trough, using camera-equipped remotely-operated vehicle to follow transects, on a three-monthly basis over one year. In late summer, the area below the thermocline of the Western Trough was devoid of visible fauna. Decapod crustaceans were the first taxon to make use of ameliorating oxygen conditions in autumn, by darting below the thermocline depth, most likely to scavenge. This was indicated by tracks that they left on the surface of the Trough floor. Some species, most noticeably Fries’ goby Lesueurigobius friesii, migrated below the thermocline depth when conditions were normoxic and established semi-permanent burrows. Their population encompassed all size classes, indicating that this habitat was not limited to juveniles of this territorial species. Recolonisation by macrofauna and burrowing megafauna was studied during normoxic conditions, from November 2009 to May 2010. Macrofauna displayed a typical post-disturbance pattern of recolonisation with one species, the polychaete Scalibregma inflatum, occurring at high abundance levels in March 2010. In May, this population had become significantly reduced and a more diverse community was established. The abundance of burrowing infauna comprising decapods crabs and Fries’ gobies, was estimated by identifying and counting their distinctive burrow structures. While above the summer thermocline depth, burrow abundance increased in a linear fashion, below the thermocline depth a slight reduction of burrow abundance occurred in May, when oxygen conditions deteriorated again. The majority of the burrows occurring in May were made by Fries’ gobies, which are thought to encounter low oxygen concentrations in their burrows. Reduction in burrow abundance of burrowing shrimps Calocaris macandreae and Callianassa subterranea (based on descriptions of burrow structures from the literature), from March to May, might be related to their reduced activity in hypoxia, leading to loss of structural burrow maintenance. Spatial and temporal changes to macrofaunal assemblage structures were studied seasonally for one year across 5 sites in the Lough and subject to multivariate statistical analysis. Assemblage structures were significantly correlated with organic matter levels in the sediment, the amounts of organic matter settling out of the water column one month before macrofaunal sampling took place as well as current speed and temperature. This study was the first to investigate patterns and processes in the Lough soft sediment ecology across all 3 basins on a temporal and spatial scale. An investigation into the oceanographic aspects of the development, behaviour and break-down of the summer thermocline of Lough Hyne was performed in collaboration with researchers from other Irish institutions.

Variability in north temperate dung beetle assemblages at different spatial and temporal scales

This study examined the spatial and temporal variability of dung beetle assemblages across a variety of scales e.g. from the between-pad scale (examining the effects of dung size and type) to larger spatial scales encompassing southern Ireland. Dung beetle assemblage structure as sampled by dung pad cohort samples and dung baited pitfall trapping were compared. Generally, the rank order of abundance of dung beetle species was significantly correlated between pitfall catches and cohort pad samples. Across different dung sizes, in both pitfall catches and cohort pad samples, the relative abundance of species was frequently significantly different, but the rank order of abundance of dung beetle was usually significantly correlated. Considerable variations in pitfall catches at temporal scales of a few days appeared to be closely related to weather conditions and rotational grazing. However, despite considerable variation in absolute abundances between consecutive days of sampling, assemblage structure typically remained very similar. The relationship between dung pad size and dung beetle colonisation was investigated. In field experiments in which pads of different sizes (0.25 L, 0.5 L, 1.0 L and 1.5 L) were artificially deposited, there was a positive relationship between pad size and both biomass and number of beetles colonising dung pads and pitfall traps. In addition, with one exception, the field experiments indicated a general positive relationship between dung pad size and biomass density (dung beetle biomass per unit dung volume). A laboratory experiment indicated that pat residence times of A. rufipes were significantly correlated with dung pad size. Investigation of naturally-deposited cow dung pads in the field also indicated that both larval numbers and densities were significantly correlated with dung pad size. These results were discussed in the context of theory related to aggregation and coexistence of species, and resource utilisation by organisms in ephemeral, patchy resources. The colonisation by dung beetles of dung types from native herbivores (sheep, horse and cow) was investigated in field experiments. There were significant differences between the dung types in the chemical parameters measured, and there were significant differences in abundances of dung beetles colonising the dung types. Sheep dung was typically the preferred dung type. Data from these field experiments, and from published literature, indicated that dung beetle species can display dung type preferences, in terms of comparisons of both absolute and relative abundances. In addition, data from laboratory experiments indicate that both Aphodius larval production and pat residence times tended to be higher in those dung types which were preferred by adult Aphodius in the colonisation experiments. Data from dung-baited pitfall trapping (from this and another study) at several sites (up to 180 km distant) and over a number of years (between 1991 and 1996) were used to investigate spatial and temporal variation in dung beetle assemblage structure and composition (Aphodius, Sphaeridium and Geotrupes) across a range of scales in southern Ireland. Species richness levels, species composition and rank order of abundances were very similar between the assemblages. The temporal variability between seasons within any year exceeded temporal variability between years. DCA ordinations indicated that there was a similar level of variability between assemblage structure from the between-field (~1km) to regional (~180 km) spatial scales, and between year (6 years) temporal scales. At the biogeographical spatial scale, analysis of data from the literature indicated that there was considerable variability at this scale, largely due to species turnover.

Fractionation and compositional studies of rabbit skeletal muscle membranes

The observations of Hooke (1665), Schleiden & Schwann (1839) and Virchow (1855) led to the identification of the cell as the basic structural unit of living material. In the intervening years, it has been firmly established that the chemical processes which underlie the proper functioning, development and reproduction of the organism are cellular activities. The development of the electron microscope has enabled cell structure to be studied in detail. A picture of the cell as an entity with a complex and highly organised internal structure has emerged from the work of Palade, Porter, Fernandez-Moran and many others. Although cells from different tissues and organisms differ in aspects of their structure and consequently in function, they have several features in common. A retentive membrane encloses a number of cell constituents, which include membrane-enclosed subcellular structures known as organelles. The cells of most tissues also contain a reticulum or system of branching tubules. The interplay of the biochemical activities of these structures enables the cell to function. Almost thirty years ago, Claude, Palade, Schneider, Hogeboom, de Duve and others set out to analytically fractionate the subcellular components obtained after the fragmentation of liver cells. This approach has become known as subcellular fractionation, and signalled a major conceptual breakthrough in biochemistry (reviewed by de Duve, 1964, 1967, 1971). The significance of this breakthrough has been underlined by the award of the 1974 Nobel Prize in Medicine to de Duve, Palade and Claude. This thesis is concerned with the application of subcellular fractionation techniques to the separation and characterisation of the membrane systems of the rabbit skeletal muscle cell.

Characterisation of the non-muscle α-actinins

Actinins are cytoskeleton proteins that cross-link actin filaments. Evolution of the actinin family resulted in the formation of Ca++-insensitive muscle isoforms (actinin-2 and- 3) and Ca++-sensitive non-muscle isoforms (actinin-1 and -4) with regard to their actin-binding function. Despite high sequence similarity, unique properties have been ascribed to actinin-4 compared with actinin-1. Actinin-4 is the predominant isoform reported to be associated with the cancer phenotype. Actinin-4, but not actinin-1, is essential for normal glomerular function in the kidney and and is able to translocate to the nucleus to regulate transcription. To understand the molecular basis for such isoform-specific functions I have comprehensively compared these proteins in terms of localisation, migration, alternative splicing, actin-binding properties, heterodimer formation and molecular interactions for the first time. This work characterises a number of commercially available actinin antibodies and in doing so, identifies actinin-1, -2 and -4 isoform-specific antibodies that enabled studies of actinin expression and localisation. This work identifies the actinin rod domain as the predominant domain that influences actinin localisation however localisation is likely to be effected by the entire actinin protein. si-RNA- mediated knockdown of actinin-1 and -4 did not affect migration in a number of cell lines highlighting that migration may only require a fraction of total non-muscle actinin levels. This work finds that the Ca++-insensitive variant of actinin-4 is expressed only in the nervous system and thus cannot be regarded as a smooth muscle isoform, as is the case for the Ca++-insensitive variant of actinin-1. This work also identifies a previously unreported exon 19a+19b expressing variant of actinin-4 in human skeletal muscle. This work finds that alternative splice variants of actinin-1 and -4 are co-expressed in a number of tissues, in particular the brain. In contrast to healthy brain, glioblastoma cells express Ca++-sensitive variants of both actinin-1 and -4. Actin-binding properties of actinin-1 and -4 are similar and are unlikely to explain isoform-specific functions. Surprisingly, this work reveals that actinin-1/-4 heterodimers, rather than homodimers, are the most abundant form of actinin in many cancer cell lines. Taken together this data suggests that actinin-1 and -4 cannot be viewed as distinct entities from each other but rather as proteins that can exist in both homodimeric and heterodimeric forms. Finally, this work employs yeast two-hybrid and proteomic approaches to identify actinin-interacting proteins. In doing so, this work identifies a number of putative actinin-4 specific interacting partners that may help to explain some of the unique functions attributed the actinin-4. The observation of alternative splice variants of actinin-1 and -4 combined with the observed potential of these proteins to form homodimers and heterodimers suggests that homodimers and heterodimers with novel actin-binding properties and interaction networks may exist. The ability to behave in this manner may have functional implications. This may be of importance considering that these proteins are central to such processes as cell migration and adhesion. This significantly alters our view of the non-muscle actinins.

Role of KLF4 in regulation of myocardin induced SMC differentiation in human smooth muscle stem progenitor cells (hSMSPC)

The differentiation of stem cells into multiple lineages has been explored in vascular regenerative medicine. However, in the case of smooth muscle cells (SMC), issues exist concerning inefficient rates of differentiation. In stem cells, multiple repressors potentially downregulate myocardin, the potent SRF coactivator induced SMC transcription including Krüppel like zinc finger transcription factor-4 (KLF4). This thesis aimed to explore the role of KLF4 in the regulation of myocardin gene expression in human smooth muscle stem/progenitor cells (hSMSPC), a novel circulating stem cell identified in our laboratory which expresses low levels of myocardin and higher levels of KLF4. hSMSPC cells cultured in SmGM2 1% FBS with TGF-β1 (5 ng/ml “differentiation media”) show limited SMC cell differentiation potential. Furthermore, myocardin transduced hSMSPC cells cultured in differentiation media induced myofilamentous SMC like cells with expression of SM markers. Five potential KLF4 binding sites were identified in silico within 3.9Kb upstream of the translational start site of the human myocardin promoter. Chromatin immunoprecipitation assays verified that endogenous KLF4 binds the human myocardin promoter at -3702bp with Respect to the translation start site (-1). Transduction of lentiviral vectors encoding either myocardin cDNA (LV_myocardin) or KLF4 targeting shRNA (LV_shKLF4 B) induced human myocardin promoter activity in hSMSPCs. Silencing of KLF4 expression in differentiation media induced smooth muscle like morphology by day 5 in culture and increased overtime with expression of SMC markers in hSMSPCs. Implantation of silastic tubes into the rat peritoneal cavity induces formation of a tissue capsule structure which may be used as vascular grafts. Rat SMSPCs integrate into, strengthen and enhance the SMC component of such tubular capsules. These data demonstrate that KLF4 directly represses myocardin gene expression in hSMSPCs, which when differentiated, provide a potential source of SMCs in the development of autologous vascular grafts in regenerative medicine.