Sequence-Seeking and Counter Streams: A Model for Information Processing in the Cortex

This paper presents a model for the general flow in the neocortex. The basic process, called "sequence-seeking," is a search for a sequence of mappings or transformations, linking source and target representations. The search is bi-directional, "bottom-up" as well as "top-down," and it explores in parallel a large numbe rof alternative sequences. This operation is implemented in a structure termed "counter streams," in which multiple sequences are explored along two separate, complementary pathways which seeking to meet. The first part of the paper discusses the general sequence-seeking scheme and a number of related processes, such as the learning of successful sequences, context effects, and the use of "express lines" and partial matches. The second part discusses biological implications of the model in terms of connections within and between cortical areas. The model is compared with existing data, and a number of new predictions are proposed.

Sparsely Faceted Arrays: A Mechanism Supporting Parallel Allocation, Communication, and Garbage Collection

Conventional parallel computer architectures do not provide support for non-uniformly distributed objects. In this thesis, I introduce sparsely faceted arrays (SFAs), a new low-level mechanism for naming regions of memory, or facets, on different processors in a distributed, shared memory parallel processing system. Sparsely faceted arrays address the disconnect between the global distributed arrays provided by conventional architectures (e.g. the Cray T3 series), and the requirements of high-level parallel programming methods that wish to use objects that are distributed over only a subset of processing elements. A sparsely faceted array names a virtual globally-distributed array, but actual facets are lazily allocated. By providing simple semantics and making efficient use of memory, SFAs enable efficient implementation of a variety of non-uniformly distributed data structures and related algorithms. I present example applications which use SFAs, and describe and evaluate simple hardware mechanisms for implementing SFAs. Keeping track of which nodes have allocated facets for a particular SFA is an important task that suggests the need for automatic memory management, including garbage collection. To address this need, I first argue that conventional tracing techniques such as mark/sweep and copying GC are inherently unscalable in parallel systems. I then present a parallel memory-management strategy, based on reference-counting, that is capable of garbage collecting sparsely faceted arrays. I also discuss opportunities for hardware support of this garbage collection strategy. I have implemented a high-level hardware/OS simulator featuring hardware support for sparsely faceted arrays and automatic garbage collection. I describe the simulator and outline a few of the numerous details associated with a "real" implementation of SFAs and SFA-aware garbage collection. Simulation results are used throughout this thesis in the evaluation of hardware support mechanisms.

Adaptive Neural Models of Queuing and Timing in Fluent Action

Temporal structure in skilled, fluent action exists at several nested levels. At the largest scale considered here, short sequences of actions that are planned collectively in prefrontal cortex appear to be queued for performance by a cyclic competitive process that operates in concert with a parallel analog representation that implicitly specifies the relative priority of elements of the sequence. At an intermediate scale, single acts, like reaching to grasp, depend on coordinated scaling of the rates at which many muscles shorten or lengthen in parallel. To ensure success of acts such as catching an approaching ball, such parallel rate scaling, which appears to be one function of the basal ganglia, must be coupled to perceptual variables, such as time-to-contact. At a fine scale, within each act, desired rate scaling can be realized only if precisely timed muscle activations first accelerate and then decelerate the limbs, to ensure that muscle length changes do not under- or over-shoot the amounts needed for the precise acts. Each context of action may require a much different timed muscle activation pattern than similar contexts. Because context differences that require different treatment cannot be known in advance, a formidable adaptive engine-the cerebellum-is needed to amplify differences within, and continuosly search, a vast parallel signal flow, in order to discover contextual "leading indicators" of when to generate distinctive parallel patterns of analog signals. From some parts of the cerebellum, such signals controls muscles. But a recent model shows how the lateral cerebellum, such signals control muscles. But a recent model shows how the lateral cerebellum may serve the competitive queuing system (in frontal cortex) as a repository of quickly accessed long-term sequence memories. Thus different parts of the cerebellum may use the same adaptive engine system design to serve the lowest and the highest of the three levels of temporal structure treated. If so, no one-to-one mapping exists between levels of temporal structure and major parts of the brain. Finally, recent data cast doubt on network-delay models of cerebellar adaptive timing.

The role of bacterial interspecies communication in polymicrobial infection of the cystic fibrosis lung

There is an increasing appreciation of the polymicrobial nature of bacterial infections associated with Cystic Fibrosis (CF) and of the important role for interactions in influencing bacterial virulence and response to therapy. Patients with CF are co-infected with Pseudomonas aeruginosa, Burkholderia cenocepacia and Stenotrophomonas maltophilia. These latter bacteria produce signal molecules of the diffusible signal factor (DSF) family, which are cis-2-unsaturated fatty acids. Previous studies showed that DSF from S. maltophilia leads to altered biofilm formation and increased tolerance to antibiotics in P. aeruginosa and that these responses require the P. aeruginosa sensor kinase PA1396. The work in this thesis aims of further elucidate the influence and mechanism of DSF signalling on P. aeruginosa and examine the role that such interspecies signalling play in infection of the CF airway. Next generation sequencing technologies targeting the 16S ribosomal RNA gene were applied to DNA and RNA isolated from sputum taken from cohorts of CF and non-CF subjects to characterise the bacterial community. In parallel, metabolomics analysis of sputum provided insight into the environment of the CF airway. This analysis revealed a number of observations including; that differences in metabolites occur in sputum taken from clinically stable CF patients and those with exacerbation and DNA- and RNA-based methods suggested that a strong relationship existed between the abundance of specific strict anaerobes and fluctuations in the level of metabolites during exacerbation. DSF family signals were also detected in the sputum and a correlation with the presence of DSFproducing organisms was observed. To examine the signal transduction mechanisms used by P. aeruginosa, bioinformatics with site directed mutagenesis were employed to identify signalling partners for PA1396. A pathway suggesting a role for a number of proteins in the regulation of several factors following DSF recognition by PA1396 were observed.

Functional imaging of numerical processing in adults and 4-y-old children.

Adult humans, infants, pre-school children, and non-human animals appear to share a system of approximate numerical processing for non-symbolic stimuli such as arrays of dots or sequences of tones. Behavioral studies of adult humans implicate a link between these non-symbolic numerical abilities and symbolic numerical processing (e.g., similar distance effects in accuracy and reaction-time for arrays of dots and Arabic numerals). However, neuroimaging studies have remained inconclusive on the neural basis of this link. The intraparietal sulcus (IPS) is known to respond selectively to symbolic numerical stimuli such as Arabic numerals. Recent studies, however, have arrived at conflicting conclusions regarding the role of the IPS in processing non-symbolic, numerosity arrays in adulthood, and very little is known about the brain basis of numerical processing early in development. Addressing the question of whether there is an early-developing neural basis for abstract numerical processing is essential for understanding the cognitive origins of our uniquely human capacity for math and science. Using functional magnetic resonance imaging (fMRI) at 4-Tesla and an event-related fMRI adaptation paradigm, we found that adults showed a greater IPS response to visual arrays that deviated from standard stimuli in their number of elements, than to stimuli that deviated in local element shape. These results support previous claims that there is a neurophysiological link between non-symbolic and symbolic numerical processing in adulthood. In parallel, we tested 4-y-old children with the same fMRI adaptation paradigm as adults to determine whether the neural locus of non-symbolic numerical activity in adults shows continuity in function over development. We found that the IPS responded to numerical deviants similarly in 4-y-old children and adults. To our knowledge, this is the first evidence that the neural locus of adult numerical cognition takes form early in development, prior to sophisticated symbolic numerical experience. More broadly, this is also, to our knowledge, the first cognitive fMRI study to test healthy children as young as 4 y, providing new insights into the neurophysiology of human cognitive development.

Molecular mapping of movement-associated areas in the avian brain: a motor theory for vocal learning origin.

Vocal learning is a critical behavioral substrate for spoken human language. It is a rare trait found in three distantly related groups of birds-songbirds, hummingbirds, and parrots. These avian groups have remarkably similar systems of cerebral vocal nuclei for the control of learned vocalizations that are not found in their more closely related vocal non-learning relatives. These findings led to the hypothesis that brain pathways for vocal learning in different groups evolved independently from a common ancestor but under pre-existing constraints. Here, we suggest one constraint, a pre-existing system for movement control. Using behavioral molecular mapping, we discovered that in songbirds, parrots, and hummingbirds, all cerebral vocal learning nuclei are adjacent to discrete brain areas active during limb and body movements. Similar to the relationships between vocal nuclei activation and singing, activation in the adjacent areas correlated with the amount of movement performed and was independent of auditory and visual input. These same movement-associated brain areas were also present in female songbirds that do not learn vocalizations and have atrophied cerebral vocal nuclei, and in ring doves that are vocal non-learners and do not have cerebral vocal nuclei. A compilation of previous neural tracing experiments in songbirds suggests that the movement-associated areas are connected in a network that is in parallel with the adjacent vocal learning system. This study is the first global mapping that we are aware for movement-associated areas of the avian cerebrum and it indicates that brain systems that control vocal learning in distantly related birds are directly adjacent to brain systems involved in movement control. Based upon these findings, we propose a motor theory for the origin of vocal learning, this being that the brain areas specialized for vocal learning in vocal learners evolved as a specialization of a pre-existing motor pathway that controls movement.

The Voyage of Impressionism in Three Violin Recitals: To See the World in Different Colors

Impressionism serves as the transition between romantic and modern music. This dissertation examines the varying characteristics and colors of Impressionism in the works of late-romantic French composers, French Impressionistic composers, and composers with Impressionistic influence from countries other than France. Violin Sonata in g minor, L. 140 (1917) is the last work composed by Claude Debussy. The impressionistic characters in this work includes the ambiguous yet innovative and variant sonority and form. As a work also written in 1917, Ottorino Respighi's Violin Sonata in b minor is deeply rooted in Italian Romanticism. Some of the Impressionistic characters can be found in the second movement where the harmonies are in parallel motion. César Franck, a forerunner of impressionism, heavily influenced Debussy with the use of cyclic form. The Violin Sonata in A major (1886) is rich in harmonic language. Ernest Chausson's works mark the transition between Franck and Debussy. The Poème portrays a love story, Song of Love Triumphant by Turgenev. The work is a symphonic poem for violin and orchestra. The Mythes, Op. 30 (1915) by Karol Szymanowski is based on Greek mythology. Ravel's Sonata for Violin and Cello (1922), dedicated to Debussy, points to the future with a sophisticated harmonic language extending into atonality, spare texture, and expanded palate of impressionistic colors and techniques. Ernest Bloch's Violin Sonata No. 1 (1920) portrays the feeling of torment. Beneath the soaring cries of the violin, the harmonic sonority of Impressionism are present. Gabriel Fauré's Violin Sonata No. 1 in A major, op. 13 (1876) is the earliest work of this project. The scherzo movement became a prototype for future scherzo movements for Ravel and Debussy. Ravel's Tzigane (1924), at once a paragon of French impressionism, a delightful gypsy-style dance-fantasy, and a breathtaking virtuoso piece, is the perfect conclusion to my dissertation project. The pieces discussed above were presented in three recitals. Compact disc recordings of these recitals are available in the Michelle Smith Performing Arts Library of the Clarice Smith Performing Arts Center at the University of Maryland.

The implementation of an aeronautical CFD flow code onto distributed memory parallel systems

The parallelization of an industrially important in-house computational fluid dynamics (CFD) code for calculating the airflow over complex aircraft configurations using the Euler or Navier–Stokes equations is presented. The code discussed is the flow solver module of the SAUNA CFD suite. This suite uses a novel grid system that may include block-structured hexahedral or pyramidal grids, unstructured tetrahedral grids or a hybrid combination of both. To assist in the rapid convergence to a solution, a number of convergence acceleration techniques are employed including implicit residual smoothing and a multigrid full approximation storage scheme (FAS). Key features of the parallelization approach are the use of domain decomposition and encapsulated message passing to enable the execution in parallel using a single programme multiple data (SPMD) paradigm. In the case where a hybrid grid is used, a unified grid partitioning scheme is employed to define the decomposition of the mesh. The parallel code has been tested using both structured and hybrid grids on a number of different distributed memory parallel systems and is now routinely used to perform industrial scale aeronautical simulations. Copyright © 2000 John Wiley & Sons, Ltd.

Virtual manufacturing and design in the real world - implementation and scalability on HPPC systems

Virtual manufacturing and design assessment increasingly involve the simulation of interacting phenomena, sic. multi-physics, an activity which is very computationally intensive. This chapter describes an attempt to address the parallel issues associated with a multi-physics simulation approach based upon a range of compatible procedures operating on one mesh using a single database - the distinct physics solvers can operate separately or coupled on sub-domains of the whole geometric space. Moreover, the finite volume unstructured mesh solvers use different discretization schemes (and, particularly, different ‘nodal’ locations and control volumes). A two-level approach to the parallelization of this simulation software is described: the code is restructured into parallel form on the basis of the mesh partitioning alone, that is, without regard to the physics. However, at run time, the mesh is partitioned to achieve a load balance, by considering the load per node/element across the whole domain. The latter of course is determined by the problem specific physics at a particular location.

Parallel mesh partitioning on distributed memory systems

The problem of deriving parallel mesh partitioning algorithms for mapping unstructured meshes to parallel computers is discussed in this chapter. In itself this raises a paradox - we seek to find a high quality partition of the mesh, but to compute it in parallel we require a partition of the mesh. In fact, we overcome this difficulty by deriving an optimisation strategy which can find a high quality partition even if the quality of the initial partition is very poor and then use a crude distribution scheme for the initial partition. The basis of this strategy is to use a multilevel approach combined with local refinement algorithms. Three such refinement algorithms are outlined and some example results presented which show that they can produce very high global quality partitions, very rapidly. The results are also compared with a similar multilevel serial partitioner and shown to be almost identical in quality. Finally we consider the impact of the initial partition on the results and demonstrate that the final partition quality is, modulo a certain amount of noise, independent of the initial partition.

Dynamic mesh partitioning and load-balancing for parallel computational mechanics codes

In this Chapter we discuss the load-balancing issues arising in parallel mesh based computational mechanics codes for which the processor loading changes during the run. We briefly touch on geometric repartitioning ideas and then focus on different ways of using a graph both to solve the load-balancing problem and the optimisation problem, both locally and globally. We also briefly discuss whether repartitioning is always valid. Sample illustrative results are presented and we conclude that repartitioning is an attractive option if the load changes are not too dramatic and that there is a certain trade-off between partition quality and volume of data that the underlying application needs to migrate.

Feeding of anchovy Engraulis encrasicolus larvae in the northwestern Adriatic Sea in response to changing hydrobiological conditions

Results from depth integrated and vertically stratified plankton sampling in the northwestern Adriatic Sea were used for comparison of gut contents of larvae of European anchovy Engraulis encrasicolus with composition and concentration of potential prey in the plankton. Sampling was carried out over a grid of stations both before and after a period of increased wind mixing to investigate changes in food availability and larval feeding success. All larvae had empty guts soon after dusk, indicating daytime feeding and rapid gut clearance. With increasing larval length there was a greater percentage of specimens with empty guts, despite suitable food being available in the plankton for these larger larvae; this suggests differential gut evacuation during sampling-possibly related to the degree of gut development. Larval diet was principally the various developmental stages of copepods, especially calanoid and cyclopoid nauplii, which were preferentially selected by larvae, whereas selection was against harpacticoid nauplii. Lamellibranch larvae and Peridinium were generally abundant in the plankton, but were only present in the gut contents in any number when the preferred dietary organisms were present in the plankton at low concentrations. The number of food organisms in the gut contents increased with concentration of the preferred food organisms in the plankton up to a limit of similar to 50 organisms/l. Within the upper 18 m of the water column, there was a reduction in the proportion of larvae with food in their guts with increasing depth, irrespective of the vertical profile of food concentration. Following a period of wind mixing the composition of the plankton changed. This was reflected in the diet of anchovy larvae, which altered in parallel. There was also an overall 41% decrease in concentration of the preferred food particles of larvae in the plankton following the period of wind mixing, but larvae were still able to maintain their food intake. These results show that anchovy larvae can successfully adapt their diet to a changing prey field and suggest that in the conditions observed in the northern Adriatic, quite radical changes in the feeding environment were probably insufficient to affect overall larval mortality.

Can benthic community structure be used to predict the process of bioturbation in real ecosystems

Disentangling the roles of environmental change and natural environmental variability on biologically mediated ecosystem processes is paramount to predict future marine ecosystem functioning. Bioturbation, the biogenic mixing of sediments, has a regulating role in marine biogeochemical processes. However, our understanding of bioturbation as a community level process and of its environmental drivers is still limited by loose use of terminology, and a lack of consensus about what bioturbation is. To help resolve these challenges, this empirical study investigated the links between four different attributes of bioturbation (bioturbation depth, activity and distance, and biodiffusive transport); the ability of an index of bioturbation (BPc) to predict each of them; and their relation to seasonality, in a shallow coastal system – the Western Channel Observatory, UK. Bioturbation distance depended on changes in benthic community structure, while the other three attributes were more directly influenced by seasonality in food availability. In parallel, BPc successfully predicted bioturbation distance but not the other attributes of bioturbation. This study therefore highlights that community bioturbation results from this combination of processes responding to environmental variability at different time-scales. However, community level measurements of bioturbation across environmental variability are still scarce, and BPc is calculated using commonly available data on benthic community structure and the functional classification of invertebrates. Therefore, BPc could be used to support the growth of landscape scale bioturbation research, but future uses of the index need to consider which bioturbation attributes the index actually predicts. As BPc predicts bioturbation distance, estimated here using a random-walk model applicable to community settings, studies using either of the metrics should be directly comparable and contribute to a more integrated future for bioturbation research.

Fgr but not Syk tyrosine kinase is a target for beta2 integrin-induced c-Cbl-mediated ubiquitination in adherent human neutrophils

An early and critical event in beta2 integrin signalling during neutrophil adhesion is activation of Src tyrosine kinases and Syk. In the present study, we report Src kinase-dependent beta2 integrin-induced tyrosine phosphorylation of Cbl occurring in parallel with increased Cbl-associated tyrosine kinase activity. These events concurred with activation of Fgr and, surprisingly, also with dissociation of this Src tyrosine kinase from Cbl. Moreover, the presence of the Src kinase inhibitor PP1 in an in vitro assay had only a limited effect on the Cbl-associated kinase activity. These results suggest that an additional active Src-dependent tyrosine kinase associates with Cbl. The following observations imply that Syk is such a kinase: (i) beta2 integrins activated Syk in a Src-dependent manner, (ii) Syk was associated with Cbl much longer than Fgr was, and (iii) the Syk inhibitor piceatannol (3,4,3´,5´-tetrahydroxy-trans-stilbene) abolished the Cbl-associated kinase activity in an in vitro assay. Effects of the mentioned interactions between these two kinases and Cbl may be related to the finding that Cbl is a ubiquitin E3 ligase. Indeed, we detected beta2 integrin-induced ubiquitination of Fgr that, similar to the phosphorylation of Cbl, was abolished in cells pretreated with PP1. However, the ubiquitination of Fgr did not cause any apparent degradation of the protein. In contrast with Fgr, Syk was not modified by the E3 ligase. Thus Cbl appears to be essential in beta2 integrin signalling, first by serving as a matrix for a subsequent agonist-induced signalling interaction between Fgr and Syk, and then by mediating ubiquitination of Fgr which possibly affects its interaction with Cbl.

Endostatin modulates VEGF-mediated barrier dysfunction in the retinal microvascular endothelium

Recent evidence indicates that the anti-angiogenic peptide endostatin may modulate some of the vasomodulatory effects of vascular endothelial growth factor (VEGF) in the retina, including reduction of blood retinal barrier function although it remains uncertain how endostatin promotes endothelial barrier properties. The current study has sought to examine how physiological levels of endostatin alters VEGF-induced inner BRB function using an in vitro model system and evaluation of occludin and ZO-1 regulatory responses. In addition, the ability of exogenous endostatin to regulate VEGF-mediated retinal vascular permeability in vivo was investigated.

Retinal microvascular endothelial cells (RMEC's) were exposed to various concentrations of endostatin. In parallel studies, RMEC monolayers were treated with vascular endothelial growth factor (VEGF165). Vasopermeability of RMEC monolayers and occludin expression were determined.

Blood retinal barrier integrity was quantified in mouse retina using Evans Blue assay following intravitreal delivery of VEGF165, endostatin or a VEGF/endostatin combination.

Endostatin increased the levels of expression of occludin whilst causing no significant change in FITC-dextran flux across the RMEC monolayer. Endostatin reversed the effects of VEGF165-enhanced permeability between microvascular endothelial cells and induced phosphorylation of occludin. Evans Blue leakage from retinas treated with VEGF was 2.0 fold higher than that of contra-lateral untreated eyes (P<0.05) while leakage of eyes from endostatin treated animals was unchanged. When eyes were injected with a combination of VEGF165 and endostatin there was a significant reduction in retinal vasopermeability when compared to VEGF-injected eyes (P<0.05).

We conclude that endostatin can promote integrity of the retinal endothelial barrier, possibly by preventing VEGF-mediated alteration of tight junction integrity. This suggests that endostatin may be of clinical benefit in ocular disorders where significant retinal vasopermeability changes are present.