Incremental Linear Discriminant Analysis Using Sufficient Spanning Sets and Its Applications

This paper presents an incremental learning solution for Linear Discriminant Analysis (LDA) and its applications to object recognition problems. We apply the sufficient spanning set approximation in three steps i.e. update for the total scatter matrix, between-class scatter matrix and the projected data matrix, which leads an online solution which closely agrees with the batch solution in accuracy while significantly reducing the computational complexity. The algorithm yields an efficient solution to incremental LDA even when the number of classes as well as the set size is large. The incremental LDA method has been also shown useful for semi-supervised online learning. Label propagation is done by integrating the incremental LDA into an EM framework. The method has been demonstrated in the task of merging large datasets which were collected during MPEG standardization for face image retrieval, face authentication using the BANCA dataset, and object categorisation using the Caltech101 dataset. © 2010 Springer Science+Business Media, LLC.

Synchronization in climate dynamics and other extended systems

Synchronization is now well established as representing coherent behaviour between two or more otherwise autonomous nonlinear systems subject to some degree of coupling. Such behaviour has mainly been studied to date, however, in relatively low-dimensional discrete systems or networks. But the possibility of similar kinds of behaviour in continuous or extended spatiotemporal systems has many potential practical implications, especially in various areas of geophysics. We review here a range of cyclically varying phenomena within the Earth's climate system for which there may be some evidence or indication of the possibility of synchronized behaviour, albeit perhaps imperfect or highly intermittent. The exploitation of this approach is still at a relatively early stage within climate science and dynamics, in which the climate system is regarded as a hierarchy of many coupled sub-systems with complex nonlinear feedbacks and forcings. The possibility of synchronization between climate oscillations (global or local) and a predictable external forcing raises important questions of how models of such phenomena can be validated and verified, since the resulting response may be relatively insensitive to the details of the model being synchronized. The use of laboratory analogues may therefore have an important role to play in the study of natural systems that can only be observed and for which controlled experiments are impossible. We go on to demonstrate that synchronization can be observed in the laboratory, even in weakly coupled fluid dynamical systems that may serve as direct analogues of the behaviour of major components of the Earth's climate system. The potential implications and observability of these effects in the long-term climate variability of the Earth is further discussed. © 2010 Springer-Verlag Berlin Heidelberg.

Derivative Kernels for Noise Robust ASR

Recently there has been interest in combined gen- erative/discriminative classifiers. In these classifiers features for the discriminative models are derived from generative kernels. One advantage of using generative kernels is that systematic approaches exist how to introduce complex dependencies beyond conditional independence assumptions. Furthermore, by using generative kernels model-based compensation/adaptation tech- niques can be applied to make discriminative models robust to noise/speaker conditions. This paper extends previous work with combined generative/discriminative classifiers in several directions. First, it introduces derivative kernels based on context- dependent generative models. Second, it describes how derivative kernels can be incorporated in continuous discriminative models. Third, it addresses the issues associated with large number of classes and parameters when context-dependent models and high- dimensional features of derivative kernels are used. The approach is evaluated on two noise-corrupted tasks: small vocabulary AURORA 2 and medium-to-large vocabulary AURORA 4 task.

Derivative kernels for noise robust ASR

Recently there has been interest in combining generative and discriminative classifiers. In these classifiers features for the discriminative models are derived from the generative kernels. One advantage of using generative kernels is that systematic approaches exist to introduce complex dependencies into the feature-space. Furthermore, as the features are based on generative models standard model-based compensation and adaptation techniques can be applied to make discriminative models robust to noise and speaker conditions. This paper extends previous work in this framework in several directions. First, it introduces derivative kernels based on context-dependent generative models. Second, it describes how derivative kernels can be incorporated in structured discriminative models. Third, it addresses the issues associated with large number of classes and parameters when context-dependent models and high-dimensional feature-spaces of derivative kernels are used. The approach is evaluated on two noise-corrupted tasks: small vocabulary AURORA 2 and medium-to-large vocabulary AURORA 4 task. © 2011 IEEE.

Dynamic programming solutions for decentralized state-feedback LQG problems with communication delays

This paper presents explicit solutions for a class of decentralized LQG problems in which players communicate their states with delays. A method for decomposing the Bellman equation into a hierarchy of independent subproblems is introduced. Using this decomposition, all of the gains for the optimal controller are computed from the solution of a single algebraic Riccati equation. © 2012 AACC American Automatic Control Council).

Gaussian Process Vine Copulas for Multivariate Dependence

Copulas allow to learn marginal distributions separately from the multivariate dependence structure (copula) that links them together into a density function. Vine factorizations ease the learning of high-dimensional copulas by constructing a hierarchy of conditional bivariate copulas. However, to simplify inference, it is common to assume that each of these conditional bivariate copulas is independent from its conditioning variables. In this paper, we relax this assumption by discovering the latent functions that specify the shape of a conditional copula given its conditioning variables We learn these functions by following a Bayesian approach based on sparse Gaussian processes with expectation propagation for scalable, approximate inference. Experiments on real-world datasets show that, when modeling all conditional dependencies, we obtain better estimates of the underlying copula of the data.

Electrostatic effects in filamentous protein aggregation.

Electrostatic forces play a key role in mediating interactions between proteins. However, gaining quantitative insights into the complex effects of electrostatics on protein behavior has proved challenging, due to the wide palette of scenarios through which both cations and anions can interact with polypeptide molecules in a specific manner or can result in screening in solution. In this article, we have used a variety of biophysical methods to probe the steady-state kinetics of fibrillar protein self-assembly in a highly quantitative manner to detect how it is modulated by changes in solution ionic strength. Due to the exponential modulation of the reaction rate by electrostatic forces, this reaction represents an exquisitely sensitive probe of these effects in protein-protein interactions. Our approach, which involves a combination of experimental kinetic measurements and theoretical analysis, reveals a hierarchy of electrostatic effects that control protein aggregation. Furthermore, our results provide a highly sensitive method for the estimation of the magnitude of binding of a variety of ions to protein molecules.

Slowness and sparseness lead to place, head-direction, and spatial-view cells.

We present a model for the self-organized formation of place cells, head-direction cells, and spatial-view cells in the hippocampal formation based on unsupervised learning on quasi-natural visual stimuli. The model comprises a hierarchy of Slow Feature Analysis (SFA) nodes, which were recently shown to reproduce many properties of complex cells in the early visual system []. The system extracts a distributed grid-like representation of position and orientation, which is transcoded into a localized place-field, head-direction, or view representation, by sparse coding. The type of cells that develops depends solely on the relevant input statistics, i.e., the movement pattern of the simulated animal. The numerical simulations are complemented by a mathematical analysis that allows us to accurately predict the output of the top SFA layer.

Fibers with integrated mechanochemical switches: minimalistic design principles derived from fibronectin.

Inspired by molecular mechanisms that cells exploit to sense mechanical forces and convert them into biochemical signals, chemists dream of designing mechanochemical switches integrated into materials. Using the adhesion protein fibronectin, whose multiple repeats essentially display distinct molecular recognition motifs, we derived a computational model to explain how minimalistic designs of repeats translate into the mechanical characteristics of their fibrillar assemblies. The hierarchy of repeat-unfolding within fibrils is controlled not only by their relative mechanical stabilities, as found for single molecules, but also by the strength of cryptic interactions between adjacent molecules that become activated by stretching. The force-induced exposure of cryptic sites furthermore regulates the nonlinearity of stress-strain curves, the strain at which such fibers break, and the refolding kinetics and fraction of misfolded repeats. Gaining such computational insights at the mesoscale is important because translating protein-based concepts into novel polymer designs has proven difficult.

Generating Options for Active Risk Control (GO-ARC): introducing a novel technique.

BACKGROUND: After investing significant amounts of time and money in conducting formal risk assessments, such as root cause analysis (RCA) or failure mode and effects analysis (FMEA), healthcare workers are left to their own devices in generating high-quality risk control options. They often experience difficulty in doing so, and tend toward an overreliance on administrative controls (the weakest category in the hierarchy of risk controls). This has important implications for patient safety and the cost effectiveness of risk management operations. This paper describes a before and after pilot study of the Generating Options for Active Risk Control (GO-ARC) technique, a novel tool to improve the quality of the risk control options generation process. OUTCOME MEASURES: The quantity, quality (using the three-tiered hierarchy of risk controls), variety, and novelty of risk controls generated. RESULTS: Use of the GO-ARC technique was associated with improvement on all measures. CONCLUSIONS: While this pilot study has some notable limitations, it appears that the GO-ARC technique improved the risk control options generation process. Further research is needed to confirm this finding. It is also important to note that improved risk control options are a necessary, but not sufficient, step toward the implementation of more robust risk controls.