Electro-mass olfactory multi-sensor (EMMS)

For an olfactory sensor or electronic nose, the task is not only to detect the object concentration, but also to recognize it. It is well known that all the elements can be identified by their charge to mass ratio e(+)/m. We tried to imitate this principle for molecular recognition. Two kinds of sensors are used simultaneously in testing. One is quartz crystal microbalance (QCM) for detecting the change in mass, the other is interdigital electrode (IE) for detecting the change in conduction, as an electro-mass multi-sensor (EMMS). in this paper, the principle and the feasibility of this method are discussed. The preliminary results on the recognition of alcohol by EMMS coated with lipids are presented. Meanwhile, the multi-sensor can also be used as an instrument for research on some physico-chemistry problems. The change in conduction of coated membrane caused by one absorbed molecule is reported. It is found that when a QCM is coated with membrane, it still obeys the relationship Delta F (frequency change of QCM) = K Delta m (mass change of absorbed substance) and the proportional coefficient, K, depends not only on quartz properties but also on membrane characteristics as well. (C) 2000 Elsevier Science S.A. All rights reserved.

CfLGBP, a pattern recognition receptor in Chlamys farreri involved in the immune response against various bacteria

Lipopolysaccharide and beta-1, 3-glucan binding protein (LGBP) is a kind of pattern recognition receptor, which can recognize and bind LPS and beta-1, 3-glucan, and plays curial roles in the innate immune defense against Gram-negative bacteria and fungi. In this study, the functions of LGBP from Zhikong scallop Chlamys farreri performed in innate immunity were analyzed. Firstly, the mRNA expression of CfLGBP in hemocytes toward three typical PAMPS stimulation was examined by realtime PCR. It was up-regulated extremely (P < 0.01) post stimulation of LPS and beta-glucan, and also exhibited a moderate up-regulation (P < 0.01) after PGN injection. Further PAMPs binding assay with the polyclonal antibody specific for CfLGBP proved that the recombinant CfLGBP (designated as rCfLGBP) could bind not only LPS and beta-glucan, but also PGN in vitro. More importantly, rCfLGBP exhibited obvious agglutination activity towards Gram-negative bacteria Escherichia coil, Gram-positive bacteria Bacillus subtilis and fungi Pichia pastoris. Taking the results of immunofluorescence assay into account, which displayed CfLGBP was expressed specifically in the immune cells (hemocytes) and vulnerable organ (gill and mantle), we believed that LGBP in C farreri, serving as a multi-functional PRR, not only involved in the immune response against Gram-negative and fungi as LGBP in other invertebrates, but also played significant role in the event of anti-Gram-positive bacteria infection. As the first functional research of LGBP in mollusks, our study provided new implication into the innate immune defense mechanisms of C. farreri and mollusks. (C) 2010 Elsevier Ltd. All rights reserved.

An Active Pattern Recognition Architecture for Mobile Robots

An active, attentionally-modulated recognition architecture is proposed for object recognition and scene analysis. The proposed architecture forms part of navigation and trajectory planning modules for mobile robots. Key characteristics of the system include movement planning and execution based on environmental factors and internal goal definitions. Real-time implementation of the system is based on space-variant representation of the visual field, as well as an optimal visual processing scheme utilizing separate and parallel channels for the extraction of boundaries and stimulus qualities. A spatial and temporal grouping module (VWM) allows for scene scanning, multi-object segmentation, and featural/object priming. VWM is used to modulate a tn~ectory formation module capable of redirecting the focus of spatial attention. Finally, an object recognition module based on adaptive resonance theory is interfaced through VWM to the visual processing module. The system is capable of using information from different modalities to disambiguate sensory input.

Fusion Artmap: A Neural Network Architecture for Multi-Channel Data Fusion and Classification

Fusion ARTMAP is a self-organizing neural network architecture for multi-channel, or multi-sensor, data fusion. Single-channel Fusion ARTMAP is functionally equivalent to Fuzzy ART during unsupervised learning and to Fuzzy ARTMAP during supervised learning. The network has a symmetric organization such that each channel can be dynamically configured to serve as either a data input or a teaching input to the system. An ART module forms a compressed recognition code within each channel. These codes, in turn, become inputs to a single ART system that organizes the global recognition code. When a predictive error occurs, a process called paraellel match tracking simultaneously raises vigilances in multiple ART modules until reset is triggered in one of them. Parallel match tracking hereby resets only that portion of the recognition code with the poorest match, or minimum predictive confidence. This internally controlled selective reset process is a type of credit assignment that creates a parsimoniously connected learned network. Fusion ARTMAP's multi-channel coding is illustrated by simulations of the Quadruped Mammal database.

Fusion ARTMAP: An Adaptive Fuzzy Network for Multi-Channel Classification

Fusion ARTMAP is a self-organizing neural network architecture for multi-channel, or multi-sensor, data fusion. Fusion ARTMAP generalizes the fuzzy ARTMAP architecture in order to adaptively classify multi-channel data. The network has a symmetric organization such that each channel can be dynamically configured to serve as either a data input or a teaching input to the system. An ART module forms a compressed recognition code within each channel. These codes, in turn, beco1ne inputs to a single ART system that organizes the global recognition code. When a predictive error occurs, a process called parallel match tracking simultaneously raises vigilances in multiple ART modules until reset is triggered in one of thmn. Parallel match tracking hereby resets only that portion of the recognition code with the poorest match, or minimum predictive confidence. This internally controlled selective reset process is a type of credit assignment that creates a parsimoniously connected learned network.

Multi-sensor classification of tennis strokes

In this work, we investigate tennis stroke recognition using a single inertial measuring unit attached to a player’s forearm during a competitive match. This paper evaluates the best approach for stroke detection using either accelerometers, gyroscopes or magnetometers, which are embedded into the inertial measuring unit. This work concludes what is the optimal training data set for stroke classification and proves that classifiers can perform well when tested on players who were not used to train the classifier. This work provides a significant step forward for our overall goal, which is to develop next generation sports coaching tools using both inertial and visual sensors in an instrumented indoor sporting environment.

Evidence of mass failure in the Hess Deep Rift from multi-resolutional bathymetry data

New regional swath and near-bottom bathymetric data provide constraints on shallow structures at the Hess Deep Rift, an oceanic rift that exposes the crust and upper mantle of fast-spreading oceanic lithosphere created at the East Pacific Rise. These data reveal the presence of a lobate structure with a length of ~ 4 km and a width of ~ 6 km south of an Intrarift Ridge, north of Hess Deep. The lobe consists of a series of concentric benches that are widest in the center of the lobe and narrower at the edges, with a dominant bench separating two distinct morphologic regions in the lobe. There are two end-member possible interpretations of this feature: 1) the lobate structure represents a mass failure with little translation that contains coherent blocks that preserve rift-related lineaments; or 2) it represents degraded tectonic structures, and the lobate form is accounted for by, for example, two intersecting faults. We favor the slump interpretation because it more readily accounts for the lobate form of the feature and the curved benches and based on the presence of other similar lobes in this region. In the slump model, secondary structures within the benches may indicate radial spreading during or after failure. The large lobate structure we identify south of the Intrarift Ridge in Hess Deep is one of the first features of its kind identified in an oceanic rift, and illustrates that mass failure may be a significant process in these settings, consistent with the recognition of their importance in mid-ocean ridges, oceanic islands, and continental rifts. Understanding the structure of the Hess Deep Rift is also important for reconstructing the section of fast-spreading oceanic crust exposed here.

Image segmentation based on multi-scan constraint satisfaction neural network

A novel image segmentation method based on a constraint satisfaction neural network (CSNN) is presented. The new method uses CSNN-based relaxation but with a modified scanning scheme of the image. The pixels are visited with more distant intervals and wider neighborhoods in the first level of the algorithm. The intervals between pixels and their neighborhoods are reduced in the following stages of the algorithm. This method contributes to the formation of more regular segments rapidly and consistently. A cluster validity index to determine the number of segments is also added to complete the proposed method into a fully automatic unsupervised segmentation scheme. The results are compared quantitatively by means of a novel segmentation evaluation criterion. The results are promising.

An Investigation Into Features For Multi-View Lipreading

For the first time in this paper we present results showing the effect of speaker head pose angle on automatic lip-reading performance over a wide range of closely spaced angles. We analyse the effect head pose has upon the features themselves and show that by selecting coefficients with minimum variance w.r.t. pose angle, recognition performance can be improved when train-test pose angles differ. Experiments are conducted using the initial phase of a unique multi view Audio-Visual database designed specifically for research and development of pose-invariant lip-reading systems. We firstly show that it is the higher order horizontal spatial frequency components that become most detrimental as the pose deviates. Secondly we assess the performance of different feature selection masks across a range of pose angles including a new mask based on Minimum Cross-Pose Variance coefficients. We report a relative improvement of 50% in Word Error Rate when using our selection mask over a common energy based selection during profile view lip-reading.

An Event Driven Fusion Approach for Enjoyment Recognition in Real-time

Social signals and interpretation of carried information is of high importance in Human Computer Interaction. Often used for affect recognition, the cues within these signals are displayed in various modalities. Fusion of multi-modal signals is a natural and interesting way to improve automatic classification of emotions transported in social signals. Throughout most present studies, uni-modal affect recognition as well as multi-modal fusion, decisions are forced for fixed annotation segments across all modalities. In this paper, we investigate the less prevalent approach of event driven fusion, which indirectly accumulates asynchronous events in all modalities for final predictions. We present a fusion approach, handling short-timed events in a vector space, which is of special interest for real-time applications. We compare results of segmentation based uni-modal classification and fusion schemes to the event driven fusion approach. The evaluation is carried out via detection of enjoyment-episodes within the audiovisual Belfast Story-Telling Corpus.

A multi-attribute ranking solutions confirmation procedure

Ranking problems arise from the knowledge of several binary relations defined on a set of alternatives, which we intend to rank. In a previous work, the authors introduced a tool to confirm the solutions of multi-attribute ranking problems as linear extensions of a weighted sum of preference relations. An extension of this technique allows the recognition of critical preference pairs of alternatives, which are often caused by inconsistencies. Herein, a confirmation procedure is introduced and applied to confirm the results obtained by a multi-attribute decision methodology on a tender for the supply of buses to the Porto Public Transport Operator. © 2005 Springer Science + Business Media, Inc.

Object categorisations using templates constructed from multi-scale line and edge representations

Object categorisation is linked to detection, segregation and recognition. In the visual system, these processes are achieved in the ventral \what"and dorsal \where"pathways [3], with bottom-up feature extractions in areas V1, V2, V4 and IT (what) in parallel with top-down attention from PP via MT to V2 and V1 (where). The latter is steered by object templates in memory, i.e. in prefrontal cortex with a what component in PF46v and a where component in PF46d.

Multi-scale cortical keypoint representation for attention and object detection

Keypoints (junctions) provide important information for focus-of-attention (FoA) and object categorization/recognition. In this paper we analyze the multi-scale keypoint representation, obtained by applying a linear and quasi-continuous scaling to an optimized model of cortical end-stopped cells, in order to study its importance and possibilities for developing a visual, cortical architecture.We show that keypoints, especially those which are stable over larger scale intervals, can provide a hierarchically structured saliency map for FoA and object recognition. In addition, the application of non-classical receptive field inhibition to keypoint detection allows to distinguish contour keypoints from texture (surface) keypoints.

Face normalization using multi-scale cortical keypoints

Empirical studies concerning face recognition suggest that faces may be stored in memory by a few canonical representations. Models of visual perception are based on image representations in cortical area V1 and beyond, which contain many cell layers for feature extractions. Simple, complex and end-stopped cells tuned to different spatial frequencies (scales) and/or orientations provide input for line, edge and keypoint detection. This yields a rich, multi-scale object representation that can be stored in memory in order to identify objects. The multi-scale, keypoint-based saliency maps for Focus-of-Attention can be explored to obtain face detection and normalization, after which face recognition can be achieved using the line/edge representation. In this paper, we focus only on face normalization, showing that multi-scale keypoints can be used to construct canonical representations of faces in memory.

Cortical object segregation and categorization by multi-scale line and edge coding

In this paper we present an improved scheme for line and edge detection in cortical area V1, based on responses of simple and complex cells, truly multi-scale with no free parameters. We illustrate the multi-scale representation for visual reconstruction, and show how object segregation can be achieved with coarse-to-finescale groupings. A two-level object categorization scenario is tested in which pre-categorization is based on coarse scales only, and final categorization on coarse plus fine scales. Processing schemes are discussed in the framework of a complete cortical architecture.