Multi-level Input Fusion in multi-modal systems

Context-aware multimodal interactive systems aim to adapt to the needs and behavioural patterns of users and offer a way forward for enhancing the efficacy and quality of experience (QoE) in human-computer interaction. The various modalities that constribute to such systems each provide a specific uni-modal response that is integratively presented as a multi-modal interface capable of interpretation of multi-modal user input and appropriately responding to it through dynamically adapted multi-modal interactive flow management , This paper presents an initial background study in the context of the first phase of a PhD research programme in the area of optimisation of data fusion techniques to serve multimodal interactivite systems, their applications and requirements.

The postfusion structure of baculovirus gp64 supports a unified view of viral fusion machines

Viral fusion proteins mediate the merger of host and viral membranes during cell entry for all enveloped viruses. Baculovirus glycoprotein gp64 (gp64) is unusual in promoting entry into both insect and mammalian cells and is distinct from established class I and class II fusion proteins. We report the crystal structure of its postfusion form, which explains a number of gp64's biological properties including its cellular promiscuity, identifies the fusion peptides and shows it to be the third representative of a new class (III) of fusion proteins with unexpected structural homology with vesicular stomatitis virus G and herpes simplex virus type 1 gB proteins. We show that domains of class III proteins have counterparts in both class I and II proteins, suggesting that all these viral fusion machines are structurally more related than previously thought.

Protein-disulfide isomerase-mediated reduction of two disulfide bonds of HIV envelope glycoprotein 120 occurs post-CXCR4 binding and is required for fusion

The human immunodeficiency virus (HIV) envelope (Env) glycoprotein (gp) 120 is a highly disulfide-bonded molecule that attaches HIV to the lymphocyte surface receptors CD4 and CXCR4. Conformation changes within gp120 result from binding and trigger HIV/cell fusion. Inhibition of lymphocyte surface-associated protein-disulfide isomerase (PDI) blocks HIV/cell fusion, suggesting that redox changes within Env are required. Using a sensitive assay based on a thiol reagent, we show that (i) the thiol content of gp120, either secreted by mammalian cells or bound to a lymphocyte surface enabling CD4 but not CXCR4 binding, was 0.5-1 pmol SH/pmol gp120 (SH/gp120), whereas that of gp120 after its interaction with a surface enabling both CD4 and CXCR4 binding was raised to 4 SH/gp120; (ii) PDI inhibitors prevented this change; and (iii) gp120 displaying 2 SH/gp120 exhibited CD4 but not CXCR4 binding capacity. In addition, PDI inhibition did not impair gp120 binding to receptors. We conclude that on average two of the nine disulfides of gp120 are reduced during interaction with the lymphocyte surface after CXCR4 binding prior to fusion and that cell surface PDI catalyzes this process. Disulfide bond restructuring within Env may constitute the molecular basis of the post-receptor binding conformational changes that induce fusion competence.

Pharmacological analysis of a dopamine D-2Short: G(alpha o) fusion protein expressed in Sf9 cells

A dopamine D-2Short receptor:G(alphao) fusion protein was expressed in Sf9 cells using the baculovirus expression system. [H-3]Spiperone bound to D-2Short:G(alphao) with a pK(d) approximate to 10. Dopamine stimulated the binding of [S-35]guanosine-5'-O-(3-thio)triphosphate (GTPgammaS) to D-2Short:G(alphao) expressed with Gbeta(1)gamma(2) (E-max > 460%; pEC(50) 5.43 +/- 0.06). Most of the putative D-2 antagonists behaved as inverse agonists (suppressing basal [S-35]GTPgammaS binding) at D-2Short:G(alphao)/Gbeta(1)gamma(2) although (-)-suipiride and ziprasidone were neutral antagonists. Competition of [H-3]spiperone binding by dopamine and 10,11-dihydroxy-N-n-propylnorapo-morphine revealed two, binding sites of different affinities, even in the presence of GTP (100 muM). The D-2Short:G(alphao) fusion protein is therefore a good model for characterising D-2 receptors. (C) 2003 Published by Elsevier Science B.V. on behalf of the Federation of European Biochemical Societies.

Amino terminal interaction in the prion protein identified using fusion to green fluorescent protein

In contrast to the well-characterized carboxyl domain, the amino terminal half of the mature cellular prion protein has no defined structure. Here, following fusion of mouse prion protein fragments to green fluorescence protein as a reporter of protein stability, we report extreme variability in fluorescence level that is dependent on the prion fragment expressed. In particular, exposure of the extreme amino terminus in the context of a truncated prion protein molecule led to rapid degradation, whereas the loss of only six amino terminal residues rescued high level fluorescence. Study of the precise endpoints and residue identity associated with high fluorescence suggested a domain within the amino terminal half of the molecule defined by a long-range intramolecular interaction between 23KKRPKP28 and 143DWED146 and dependent upon the anti-parallel beta-sheet ending at residue 169 and normally associated with the structurally defined carboxyl terminal domain. This previously unreported interaction may be significant for understanding prion bioactivity and for structural studies aimed at the complete prion structure.

HAWAIIAN SKIRT: an F-box gene that regulates organ fusion and growth in arabidopsis

A fast neutron-mutagenized population of Arabidopsis ( Arabidopsis thaliana) Columbia-0 wild-type plants was screened for floral phenotypes and a novel mutant, termed hawaiian skirt ( hws), was identified that failed to shed its reproductive organs. The mutation is the consequence of a 28 bp deletion that introduces a premature amber termination codon into the open reading frame of a putative F-box protein ( At3g61590). The most striking anatomical characteristic of hws plants is seen in flowers where individual sepals are fused along the lower part of their margins. Crossing of the abscission marker, Pro(PGAZAT):beta-glucuronidase, into the mutant reveals that while floral organs are retained it is not the consequence of a failure of abscission zone cells to differentiate. Anatomical analysis indicates that the fusion of sepal margins precludes shedding even though abscission, albeit delayed, does occur. Spatial and temporal characterization, using Pro(HWS):beta-glucuronidase or Pro(HWS):green fluorescent protein fusions, has identified HWS expression to be restricted to the stele and lateral root cap, cotyledonary margins, tip of the stigma, pollen, abscission zones, and developing seeds. Comparative phenotypic analyses performed on the hws mutant, Columbia-0 wild type, and Pro(35S):HWS ectopically expressing lines has revealed that loss of HWS results in greater growth of both aerial and below-ground organs while overexpressing the gene brings about a converse effect. These observations are consistent with HWS playing an important role in regulating plant growth and development.

Results of applying sensor fusion to a control system using optic flow

The results from applying a sensor fusion process to an adaptive controller used to balance all inverted pendulum axe presented. The goal of the sensor fusion process was to replace some of the four mechanical measurements, which are known to be sufficient inputs for a linear state feedback controller to balance the system, with optic flow variables. Results from research into the psychology of the sense of balance in humans were the motivation for the investigation of this new type of controller input. The simulated model of the inverted pendulum and the virtual reality environments used to provide the optical input are described. The successful introduction of optical information is found to require the preservation of at least two of the traditional input types and entail increased training till-le for the adaptive controller and reduced performance (measured as the time the pendulum remains upright)

Adaptive modelling, estimation and fusion from data: a neurofuzzy approach

In a world of almost permanent and rapidly increasing electronic data availability, techniques of filtering, compressing, and interpreting this data to transform it into valuable and easily comprehensible information is of utmost importance. One key topic in this area is the capability to deduce future system behavior from a given data input. This book brings together for the first time the complete theory of data-based neurofuzzy modelling and the linguistic attributes of fuzzy logic in a single cohesive mathematical framework. After introducing the basic theory of data-based modelling, new concepts including extended additive and multiplicative submodels are developed and their extensions to state estimation and data fusion are derived. All these algorithms are illustrated with benchmark and real-life examples to demonstrate their efficiency. Chris Harris and his group have carried out pioneering work which has tied together the fields of neural networks and linguistic rule-based algortihms. This book is aimed at researchers and scientists in time series modeling, empirical data modeling, knowledge discovery, data mining, and data fusion.

Image fusion based on median filters and SOFM neural networks: a three-step scheme

This paper presents a new image data fusion scheme by combining median filtering with self-organizing feature map (SOFM) neural networks. The scheme consists of three steps: (1) pre-processing of the images, where weighted median filtering removes part of the noise components corrupting the image, (2) pixel clustering for each image using self-organizing feature map neural networks, and (3) fusion of the images obtained in Step (2), which suppresses the residual noise components and thus further improves the image quality. It proves that such a three-step combination offers an impressive effectiveness and performance improvement, which is confirmed by simulations involving three image sensors (each of which has a different noise structure).

Adjuvant-free immunization with hemagglutinin-Fc fusion proteins as an approach to influenza vaccines

The hemagglutinins (HAs) of human H1 and H3 influenza viruses and avian H5 influenza virus were produced as recombinant fusion proteins with the human immunoglobulin Fc domain. Recombinant HA-human immunoglobulin Fc domain (HA-HuFc) proteins were secreted from baculovirus-infected insect cells as glycosylated oligomer HAs of the anticipated molecular mass, agglutinated red blood cells, were purified on protein A, and were used to immunize mice in the absence of adjuvant. Immunogenicity was demonstrated for all subtypes, with the serum samples demonstrating subtype-specific hemagglutination inhibition, epitope specificity similar to that seen with virus infection, and neutralization. HuFc-tagged HAs are potential candidates for gene-to-vaccine approaches to influenza vaccination.

A simple analysis of thermodynamic properties for classical plasmas: I. theory

By eliminating the short range negative divergence of the Debye–Hückel pair distribution function, but retaining the exponential charge screening known to operate at large interparticle separation, the thermodynamic properties of one-component plasmas of point ions or charged hard spheres can be well represented even in the strong coupling regime. Predicted electrostatic free energies agree within 5% of simulation data for typical Coulomb interactions up to a factor of 10 times the average kinetic energy. Here, this idea is extended to the general case of a uniform ionic mixture, comprising an arbitrary number of components, embedded in a rigid neutralizing background. The new theory is implemented in two ways: (i) by an unambiguous iterative algorithm that requires numerical methods and breaks the symmetry of cross correlation functions; and (ii) by invoking generalized matrix inverses that maintain symmetry and yield completely analytic solutions, but which are not uniquely determined. The extreme computational simplicity of the theory is attractive when considering applications to complex inhomogeneous fluids of charged particles.