Large-Scale Neural Systems for Vision and Cognition

— Consideration of how people respond to the question What is this? has suggested new problem frontiers for pattern recognition and information fusion, as well as neural systems that embody the cognitive transformation of declarative information into relational knowledge. In contrast to traditional classification methods, which aim to find the single correct label for each exemplar (This is a car), the new approach discovers rules that embody coherent relationships among labels which would otherwise appear contradictory to a learning system (This is a car, that is a vehicle, over there is a sedan). This talk will describe how an individual who experiences exemplars in real time, with each exemplar trained on at most one category label, can autonomously discover a hierarchy of cognitive rules, thereby converting local information into global knowledge. Computational examples are based on the observation that sensors working at different times, locations, and spatial scales, and experts with different goals, languages, and situations, may produce apparently inconsistent image labels, which are reconciled by implicit underlying relationships that the network’s learning process discovers. The ARTMAP information fusion system can, moreover, integrate multiple separate knowledge hierarchies, by fusing independent domains into a unified structure. In the process, the system discovers cross-domain rules, inferring multilevel relationships among groups of output classes, without any supervised labeling of these relationships. In order to self-organize its expert system, the ARTMAP information fusion network features distributed code representations which exploit the model’s intrinsic capacity for one-to-many learning (This is a car and a vehicle and a sedan) as well as many-to-one learning (Each of those vehicles is a car). Fusion system software, testbed datasets, and articles are available from http://cns.bu.edu/techlab.

Working Memory Networks for Learning Temporal Order, with Application to 3-D Visual Object Recognition

Working memory neural networks are characterized which encode the invariant temporal order of sequential events. Inputs to the networks, called Sustained Temporal Order REcurrent (STORE) models, may be presented at widely differing speeds, durations, and interstimulus intervals. The STORE temporal order code is designed to enable all emergent groupings of sequential events to be stably learned and remembered in real time, even as new events perturb the system. Such a competence is needed in neural architectures which self-organize learned codes for variable-rate speech perception, sensory-motor planning, or 3-D visual object recognition. Using such a working memory, a self-organizing architecture for invariant 3-D visual object recognition is described. The new model is based on the model of Seibert and Waxman (1990a), which builds a 3-D representation of an object from a temporally ordered sequence of its 2-D aspect graphs. The new model, called an ARTSTORE model, consists of the following cascade of processing modules: Invariant Preprocessor --> ART 2 --> STORE Model --> ART 2 --> Outstar Network.

Statistical properties of first-order bang-bang Pll with nonzero loop delay

A method to solve the stationary state probability is presented for the first-order bang-bang phase-locked loop (BBPLL) with nonzero loop delay. This is based on a delayed Markov chain model and a state How diagram for tracing the state history due to the loop delay. As a result, an eigenequation is obtained, and its closed form solutions are derived for some cases. After obtaining the state probability, statistical characteristics such as mean gain of the binary phase detector and timing error variance are calculated and demonstrated.

Gröbner basis techniques for certain problems in coding and systems theory

There is much common ground between the areas of coding theory and systems theory. Fitzpatrick has shown that a Göbner basis approach leads to efficient algorithms in the decoding of Reed-Solomon codes and in scalar interpolation and partial realization. This thesis simultaneously generalizes and simplifies that approach and presents applications to discrete-time modeling, multivariable interpolation and list decoding. Gröbner basis theory has come into its own in the context of software and algorithm development. By generalizing the concept of polynomial degree, term orders are provided for multivariable polynomial rings and free modules over polynomial rings. The orders are not, in general, unique and this adds, in no small way, to the power and flexibility of the technique. As well as being generating sets for ideals or modules, Gröbner bases always contain a element which is minimal with respect tot the corresponding term order. Central to this thesis is a general algorithm, valid for any term order, that produces a Gröbner basis for the solution module (or ideal) of elements satisfying a sequence of generalized congruences. These congruences, based on shifts and homomorphisms, are applicable to a wide variety of problems, including key equations and interpolations. At the core of the algorithm is an incremental step. Iterating this step lends a recursive/iterative character to the algorithm. As a consequence, not all of the input to the algorithm need be available from the start and different "paths" can be taken to reach the final solution. The existence of a suitable chain of modules satisfying the criteria of the incremental step is a prerequisite for applying the algorithm.

Quantum behavior in mesoscopic systems

In this thesis I present the work done during my PhD. The Thesis is divided into two parts; in the first one I present the study of mesoscopic quantum systems whereas in the second one I address the problem of the definition of Markov regime for quantum system dynamics. The first work presented is the study of vortex patterns in (quasi) two dimensional rotating Bose Einstein condensates (BECs). I consider the case of an anisotropy trapping potential and I shall show that the ground state of the system hosts vortex patterns that are unstable. In a second work I designed an experimental scheme to transfer entanglement from two entangled photons to two BECs. This work is meant to propose a feasible experimental set up to bring entanglement from microscopic to macroscopic systems for both the study of fundamental questions (quantum to classical transition) and technological applications. In the last work of the first part another experimental scheme is presented in order to detect coherences of a mechanical oscillator which is assumed to have been previously cooled down to the quantum regime. In this regime in fact the system can rapidly undergo decoherence so that new techniques have to be employed in order to detect and manipulate their states. In the scheme I propose a micro-mechanical oscillator is coupled to a BEC and the detection is performed by monitoring the BEC with a negligible back-action on the cantilever. In the second part of the thesis I give a definition of Markov regime for open quantum dynamics. The importance of such definition comes from both the mathematical description of the system dynamics and from the understanding of the role played by the environment in the evolution of an open system. In the Markov regime the mathematical description can be simplified and the role of the environment is a passive one.

Differential and numerical models of hysteretic systems with stochastic and deterministic inputs

Many deterministic models with hysteresis have been developed in the areas of economics, finance, terrestrial hydrology and biology. These models lack any stochastic element which can often have a strong effect in these areas. In this work stochastically driven closed loop systems with hysteresis type memory are studied. This type of system is presented as a possible stochastic counterpart to deterministic models in the areas of economics, finance, terrestrial hydrology and biology. Some price dynamics models are presented as a motivation for the development of this type of model. Numerical schemes for solving this class of stochastic differential equation are developed in order to examine the prototype models presented. As a means of further testing the developed numerical schemes, numerical examination is made of the behaviour near equilibrium of coupled ordinary differential equations where the time derivative of the Preisach operator is included in one of the equations. A model of two phenotype bacteria is also presented. This model is examined to explore memory effects and related hysteresis effects in the area of biology. The memory effects found in this model are similar to that found in the non-ideal relay. This non-ideal relay type behaviour is used to model a colony of bacteria with multiple switching thresholds. This model contains a Preisach type memory with a variable Preisach weight function. Shown numerically for this multi-threshold model is a pattern formation for the distribution of the phenotypes among the available thresholds.

Novel ingredients from brewers' spent grain - bioactivity in cell culture model systems and bioactivity retention in fortified food products

Functional food ingredients, with scientifically proven and validated bioactive effects, present an effective means of inferring physiological health benefits to consumers to reduce the risk of certain diseases. The search for novel bioactive compounds for incorporation into functional foods is particularly active, with brewers’ spent grain (BSG, a brewing industry co-product) representing a unique source of potentially bioactive compounds. The DNA protective, antioxidant and immunomodulatory effects of phenolic extracts from both pale (P1 - P4) and black (B1 – B4) BSG were examined. Black BSG extracts significantly (P < 0.05) protected against DNA damage induced by hydrogen peroxide (H2O2) and extracts with the highest total phenolic content (TPC) protected against 3-morpholinosydnonimine hydrochloride (SIN-1)-induced oxidative DNA damage, measured by the comet assay. Cellular antioxidant activity assays were used to measured antioxidant potential in the U937 cell line. Extracts P1 – P3 and B2 - B4 demonstrated significant (P < 0.05) antioxidant activity, measured by the superoxide dismutase (SOD) activity, catalase (CAT) activity and gluatathione (GSH) content assays. Phenolic extracts P2 and P3 from pale BSG possess anti-inflammatory activity measured in concanavalin-A (conA) stimulated Jurkat T cells by an enzyme-linked immunosorbent assay (ELISA); significantly (P < 0.05) reducing production of interleukin-2 (IL-2), interleukin-4 (IL-4, P2 only), interleukin-10 (IL-10) and interferon-γ (IFN-γ). Black BSG phenolic extracts did not exhibit anti-inflammatory effects in vitro. Hydroxycinnamic acids (HA) have previously been shown to be the phenolic acids present at highest concentration in BSG; therefore the HA profile of the phenolic extracts used in this research, the original barley (before brewing) and whole BSG was characterised and quantified using high performance liquid chromatography (HPLC). The concentration of HA present in the samples was in the order of ferulic acid (FA) > p-coumaric acid (p-CA) derivatives > FA derivatives > p-CA > caffeic acid (CA) > CA derivatives. Results suggested that brewing and roasting decreased the HA content. Protein hydrolysates from BSG were also screened for their antioxidant and anti-inflammatory potential. A total of 34 BSG protein samples were tested. Initial analyses of samples A – J found the protein samples did not exert DNA protective effects (except hydrolysate H) or antioxidant effects by the comet and SOD assays, respectively. Samples D, E, F and J selectively reduced IFN-γ production (P < 0.05) in Jurkat T cells, measured using enzyme linked immunosorbent assay (ELISA). Further testing of hydrolysates K – W, including fractionated hydrolysates with molecular weight < 3, < 5 and > 5 kDa, found that higher molecular weight (> 5 kDa) and unfractionated hydrolysates demonstrate greatest anti-inflammatory effects, while fractionated hydrolysates were also shown to have antioxidant activity, by the SOD activity assay. A commercially available yogurt drink (Actimel) and snack-bar and chocolate-drink formulations were fortified with the most bioactive phenolic and protein samples – P2, B2, W, W < 3 kDa, W < 5 kDa, W > 5 kDa. All fortified foods were subjected to a simulated gastrointestinal in vitro digestion procedure and bioactivity retention in the digestates was determined using the comet and ELISA assays. Yogurt fortified with B2 digestate significantly (P < 0.05) protected against H2O2-induced DNA damage in Caco-2 cells. Greatest immunomodulatory activity was demonstrated by the snack-bar formulation, significantly (P < 0.05) reducing IFN-γ production in con-A stimulated Jurkat T cells. Hydrolysate W significantly (P < 0.05) increased the IFN-γ reducing capacity of the snack-bar. Addition of fractionated hydrolysate W < 3 kDa and W < 5 kDa to yogurt also reduced IL-2 production to a greater extent than the unfortified yogurt (P < 0.05).

Artefact detection and removal algorithms for EEG diagnostic systems

The electroencephalogram (EEG) is a medical technology that is used in the monitoring of the brain and in the diagnosis of many neurological illnesses. Although coarse in its precision, the EEG is a non-invasive tool that requires minimal set-up times, and is suitably unobtrusive and mobile to allow continuous monitoring of the patient, either in clinical or domestic environments. Consequently, the EEG is the current tool-of-choice with which to continuously monitor the brain where temporal resolution, ease-of- use and mobility are important. Traditionally, EEG data are examined by a trained clinician who identifies neurological events of interest. However, recent advances in signal processing and machine learning techniques have allowed the automated detection of neurological events for many medical applications. In doing so, the burden of work on the clinician has been significantly reduced, improving the response time to illness, and allowing the relevant medical treatment to be administered within minutes rather than hours. However, as typical EEG signals are of the order of microvolts (μV ), contamination by signals arising from sources other than the brain is frequent. These extra-cerebral sources, known as artefacts, can significantly distort the EEG signal, making its interpretation difficult, and can dramatically disimprove automatic neurological event detection classification performance. This thesis therefore, contributes to the further improvement of auto- mated neurological event detection systems, by identifying some of the major obstacles in deploying these EEG systems in ambulatory and clinical environments so that the EEG technologies can emerge from the laboratory towards real-world settings, where they can have a real-impact on the lives of patients. In this context, the thesis tackles three major problems in EEG monitoring, namely: (i) the problem of head-movement artefacts in ambulatory EEG, (ii) the high numbers of false detections in state-of-the-art, automated, epileptiform activity detection systems and (iii) false detections in state-of-the-art, automated neonatal seizure detection systems. To accomplish this, the thesis employs a wide range of statistical, signal processing and machine learning techniques drawn from mathematics, engineering and computer science. The first body of work outlined in this thesis proposes a system to automatically detect head-movement artefacts in ambulatory EEG and utilises supervised machine learning classifiers to do so. The resulting head-movement artefact detection system is the first of its kind and offers accurate detection of head-movement artefacts in ambulatory EEG. Subsequently, addtional physiological signals, in the form of gyroscopes, are used to detect head-movements and in doing so, bring additional information to the head- movement artefact detection task. A framework for combining EEG and gyroscope signals is then developed, offering improved head-movement arte- fact detection. The artefact detection methods developed for ambulatory EEG are subsequently adapted for use in an automated epileptiform activity detection system. Information from support vector machines classifiers used to detect epileptiform activity is fused with information from artefact-specific detection classifiers in order to significantly reduce the number of false detections in the epileptiform activity detection system. By this means, epileptiform activity detection which compares favourably with other state-of-the-art systems is achieved. Finally, the problem of false detections in automated neonatal seizure detection is approached in an alternative manner; blind source separation techniques, complimented with information from additional physiological signals are used to remove respiration artefact from the EEG. In utilising these methods, some encouraging advances have been made in detecting and removing respiration artefacts from the neonatal EEG, and in doing so, the performance of the underlying diagnostic technology is improved, bringing its deployment in the real-world, clinical domain one step closer.

Control of the orientational order and nonlinear optical response of the "push-pull" chromophore RuPZn via specific incorporation into densely packed monolayer ensembles of an amphiphilic four-helix bundle peptide: characterization of the peptide-chromophore complexes.

"Push-pull" chromophores based on extended pi-electron systems have been designed to exhibit exceptionally large molecular hyperpolarizabilities. We have engineered an amphiphilic four-helix bundle peptide to vectorially incorporate such hyperpolarizable chromophores having a metalloporphyrin moiety, with high specificity into the interior core of the bundle. The amphiphilic exterior of the bundle facilitates the formation of densely packed monolayer ensembles of the vectorially oriented peptide-chromophore complexes at the liquid-gas interface. Chemical specificity designed into the ends of the bundle facilitates the subsequent covalent attachment of these monolayer ensembles onto the surface of an inorganic substrate. In this article, we describe the structural characterization of these monolayer ensembles at each stage of their fabrication for one such peptide-chromophore complex designated as AP0-RuPZn. In the accompanying article, we describe the characterization of their macroscopic nonlinear optical properties.

Predictions of the Pt(8)Ti phase in unexpected systems.

The binary A(8)B phase (prototype Pt(8)Ti) has been experimentally observed in 11 systems. A high-throughput search over all the binary transition intermetallics, however, reveals 59 occurrences of the A(8)B phase: Au(8)Zn(dagger), Cd(8)Sc(dagger), Cu(8)Ni(dagger), Cu(8)Zn(dagger), Hg(8)La, Ir(8)Os(dagger), Ir(8)Re, Ir(8)Ru(dagger), Ir(8)Tc, Ir(8)W(dagger), Nb(8)Os(dagger), Nb(8)Rh(dagger), Nb(8)Ru(dagger), Nb(8)Ta(dagger), Ni(8)Fe, Ni(8)Mo(dagger)*, Ni(8)Nb(dagger)*, Ni(8)Ta*, Ni(8)V*, Ni(8)W, Pd(8)Al(dagger), Pd(8)Fe, Pd(8)Hf, Pd(8)Mn, Pd(8)Mo*, Pd(8)Nb, Pd(8)Sc, Pd(8)Ta, Pd(8)Ti, Pd(8)V*, Pd(8)W*, Pd(8)Zn, Pd(8)Zr, Pt(8)Al(dagger), Pt(8)Cr*, Pt(8)Hf, Pt(8)Mn, Pt(8)Mo, Pt(8)Nb, Pt(8)Rh(dagger), Pt(8)Sc, Pt(8)Ta, Pt(8)Ti*, Pt(8)V*, Pt(8)W, Pt(8)Zr*, Rh(8)Mo, Rh(8)W, Ta(8)Pd, Ta(8)Pt, Ta(8)Rh, V(8)Cr(dagger), V(8)Fe(dagger), V(8)Ir(dagger), V(8)Ni(dagger), V(8)Pd, V(8)Pt, V(8)Rh, and V(8)Ru(dagger) ((dagger) = metastable, * = experimentally observed). This is surprising for the wealth of new occurrences that are predicted, especially in well-characterized systems (e.g., Cu-Zn). By verifying all experimental results while offering additional predictions, our study serves as a striking demonstration of the power of the high-throughput approach. The practicality of the method is demonstrated in the Rh-W system. A cluster-expansion-based Monte Carlo model reveals a relatively high order-disorder transition temperature.

A pll based frequency synthesizer in 0.13 um sige bicmos for mb-ofdm uwb systems

With the growing demand for high-speed and high-quality short-range communication, multi-band orthogonal frequency division multiplexing ultra-wide band (MB-OFDM UWB) systems have recently garnered considerable interest in industry and in academia. To achieve a low-cost solution, highly integrated transceivers with small die area and minimum power consumption are required. The key building block of the transceiver is the frequency synthesizer. A frequency synthesizer comprised of two PLLs and one multiplexer is presented in this thesis. Ring oscillators are adopted for PLL implementation in order to drastically reduce the die area of the frequency synthesizer. The poor spectral purity appearing in the frequency synthesizers involving mixers is greatly improved in this design. Based on the specifications derived from application standards, a design methodology is presented to obtain the parameters of building blocks. As well, the simulation results are provided to verify the performance of proposed design.

Specialized motor-driven dusp1 expression in the song systems of multiple lineages of vocal learning birds.

Mechanisms for the evolution of convergent behavioral traits are largely unknown. Vocal learning is one such trait that evolved multiple times and is necessary in humans for the acquisition of spoken language. Among birds, vocal learning is evolved in songbirds, parrots, and hummingbirds. Each time similar forebrain song nuclei specialized for vocal learning and production have evolved. This finding led to the hypothesis that the behavioral and neuroanatomical convergences for vocal learning could be associated with molecular convergence. We previously found that the neural activity-induced gene dual specificity phosphatase 1 (dusp1) was up-regulated in non-vocal circuits, specifically in sensory-input neurons of the thalamus and telencephalon; however, dusp1 was not up-regulated in higher order sensory neurons or motor circuits. Here we show that song motor nuclei are an exception to this pattern. The song nuclei of species from all known vocal learning avian lineages showed motor-driven up-regulation of dusp1 expression induced by singing. There was no detectable motor-driven dusp1 expression throughout the rest of the forebrain after non-vocal motor performance. This pattern contrasts with expression of the commonly studied activity-induced gene egr1, which shows motor-driven expression in song nuclei induced by singing, but also motor-driven expression in adjacent brain regions after non-vocal motor behaviors. In the vocal non-learning avian species, we found no detectable vocalizing-driven dusp1 expression in the forebrain. These findings suggest that independent evolutions of neural systems for vocal learning were accompanied by selection for specialized motor-driven expression of the dusp1 gene in those circuits. This specialized expression of dusp1 could potentially lead to differential regulation of dusp1-modulated molecular cascades in vocal learning circuits.

Localization in systems of non-identical oscillators

A singular perturbation method is applied to a non-conservative system of two weakly coupled strongly nonlinear non-identical oscillators. For certain parameters, localized solutions exist for which the amplitude of one oscillator is an order of magnitude smaller than the other. It is shown that these solutions are described by coupled equations for the phase difference and scaled amplitudes. Three types of localized solutions are obtained as solutions to these equations which correspond to phase locking, phase drift, and phase entrainment. Quantitative results for the phases and amplitudes of the oscillators and the stability of these phenomena are expressed in terms of the parameters of the model.

Neutron quasi-elastic scattering in disordered solids: a Monte Carlo study of metal-hydrogen systems

The dynamic structure factor of neutron quasi-elastic scattering has been calculated by Monte Carlo methods for atoms diffusing on a disordered lattice. The disorder includes not only variation in the distances between neighbouring atomic sites but also variation in the hopping rate associated with each site. The presence of the disorder, particularly the hopping rate disorder, causes changes in the time-dependent intermediate scattering function which translate into a significant increase in the intensity in the wings of the quasi-elastic spectrum as compared with the Lorentzian form. The effect is particularly marked at high values of the momentum transfer and at site occupancies of the order of unity. The MC calculations demonstrate how the degree of disorder may be derived from experimental measurements of the quasi-elastic scattering. The model structure factors are compared with the experimental quasi-elastic spectrum of an amorphous metal-hydrogen alloy.

The development of a CFD based simulator for water mist suppression systems: the development of the fire submodel

The FIRE Detection and Suppression Simulation (FIREDASS) project was concerned with the development of water misting systems as a possible replacement for halon based fire suppression systems currently used in aircraft cargo holds and ship engine rooms. As part of this program of work, a computational model was developed to assist engineers optimize the design of water mist suppression systems. The model is based on Computational Fluid Dynamics (CFD) and comprised of the following components: fire model; mist model; two-phase radiation model; suppression model; detector/activation model. In this paper the FIREDASS software package is described and the theory behind the fire and radiation sub-models is detailed. The fire model uses prescribed release rates for heat and gaseous combustion products to represent the fire load. Typical release rates have been determined through experimentation. The radiation model is a six-flux model coupled to the gas (and mist) phase. As part of the FIREDASS project, a detailed series of fire experiments were conducted in order to validate the fire model. Model predictions are compared with data from these experiments and good agreement is found.