Bayesian and L1 Approaches to Sparse Unsupervised Learning

The use of L1 regularisation for sparse learning has generated immense research interest, with successful application in such diverse areas as signal acquisition, image coding, genomics and collaborative filtering. While existing work highlights the many advantages of L1 methods, in this paper we find that L1 regularisation often dramatically underperforms in terms of predictive performance when compared with other methods for inferring sparsity. We focus on unsupervised latent variable models, and develop L1 minimising factor models, Bayesian variants of "L1", and Bayesian models with a stronger L0-like sparsity induced through spike-and-slab distributions. These spike-and-slab Bayesian factor models encourage sparsity while accounting for uncertainty in a principled manner and avoiding unnecessary shrinkage of non-zero values. We demonstrate on a number of data sets that in practice spike-and-slab Bayesian methods outperform L1 minimisation, even on a computational budget. We thus highlight the need to re-assess the wide use of L1 methods in sparsity-reliant applications, particularly when we care about generalising to previously unseen data, and provide an alternative that, over many varying conditions, provides improved generalisation performance.

Exploiting variable-width features in large vocabulary speech recognition

The use of variable-width features (prosodics, broad structural information etc.) in large vocabulary speech recognition systems is discussed. Although the value of this sort of information has been recognized in the past, previous approaches have not been widely used in speech systems because either they have not been robust enough for realistic, large vocabulary tasks or they have been limited to certain recognizer architectures. A framework for the use of variable-width features is presented which employs the N-Best algorithm with the features being applied in a post-processing phase. The framework is flexible and widely applicable, giving greater scope for exploitation of the features than previous approaches. Large vocabulary speech recognition experiments using TIMIT show that the application of variable-width features has potential benefits.

Gaussian mixture modeling with Gaussian process latent variable models

Density modeling is notoriously difficult for high dimensional data. One approach to the problem is to search for a lower dimensional manifold which captures the main characteristics of the data. Recently, the Gaussian Process Latent Variable Model (GPLVM) has successfully been used to find low dimensional manifolds in a variety of complex data. The GPLVM consists of a set of points in a low dimensional latent space, and a stochastic map to the observed space. We show how it can be interpreted as a density model in the observed space. However, the GPLVM is not trained as a density model and therefore yields bad density estimates. We propose a new training strategy and obtain improved generalisation performance and better density estimates in comparative evaluations on several benchmark data sets. © 2010 Springer-Verlag.

An evaluation of volumetric interest points

This paper presents the first performance evaluation of interest points on scalar volumetric data. Such data encodes 3D shape, a fundamental property of objects. The use of another such property, texture (i.e. 2D surface colouration), or appearance, for object detection, recognition and registration has been well studied; 3D shape less so. However, the increasing prevalence of depth sensors and the diminishing returns to be had from appearance alone have seen a surge in shape-based methods. In this work we investigate the performance of several detectors of interest points in volumetric data, in terms of repeatability, number and nature of interest points. Such methods form the first step in many shape-based applications. Our detailed comparison, with both quantitative and qualitative measures on synthetic and real 3D data, both point-based and volumetric, aids readers in selecting a method suitable for their application. © 2011 IEEE.

Variable repetition frequency femtosecond-pulse surface emitting semiconductor laser

We report a femtosecond-pulse vertical-external-cavity surface-emitting laser with a continuous repetition frequency tuning range of 8 near 1 GHz. A constant average output power of 56 ± 1 mW and near-transform-limited pulse duration of 450 ± 20 fs were observed across the entire tuning range. © 2011 American Institute of Physics.

Effect of organophosphate, diazinon on some immunophysiological, haematological and histological variable of Rutilus frisii kutum (Kamensky,1901)

The acute toxicity and effects of diazinon on some haematological parameters of kutum (Rutilus frisii kutum, Kamensky, 1901) weighing 613.33 g±157.06 g were studied under static water quality conditions at 15°C ± 2ºC in winter and spring 2009. The effective physical and chemical parameters of water were pH= 7-8.2, dh= 300mg/L (caco3), DO= 7 ppm and T= 15°C±2ºC. The first test was primarily to determine the effects of acute toxicity (LC5096 h) of the agricultural toxicant diazinon (emulsion 60%) on kutum male brood stocks. For this purpose, 4 treatments were used to test toxicity; each treatment was repeated in 3 tanks with 9 fish per treatment and with 180 litres water capacity. After obtaining the final results, the information was analysed statistically with Probit version 1.5 (USEPA, 1985), and we determined the LC10, LC50 and LC90 values at 24 hours, 48 hours, 72 hours and 96 hours; the maximum allowable concentration value (LC5096 h divided by 10) (TRC, 1984); and the degree of toxicity. The second stage of testing consists of four treatments: LC0= 0 as experimental treatment, treatment A with a concentration of LC1= 0.107 mg/L, treatment B with concentration of LC5= 0.157 mg/L, treatment C with concentration of MAC value= 0.04 mg/L. Male brood stocks of kutum were treated with these concentrations for 45 days. Experiments were carried out under static conditions based on the standard TRC, 1984 method over 45 days. Our results show that long-term exposure to diazinon causes a decrease in the erythrocyte count (RBC), haemoglobin (Hb), haematocrit (PCV), mean corpuscular volume (MCV), mean corpuscular haemoglobin (MCH), mean corpuscular haemoglobin concentration (MCHC), leucocyte count (WBC), lymphocyte, testosterone, iron (Fe), sodium (Na), lactate dehydrogenase (LDH), and cholinesterase (CHeS). In addition, diazinon also causes an increase in prolymphocyte, aspartate aminotransferase (AST), cholesterol, alkaline phosphatase (ALP) and adrenaline (P<0.05). There are no significant effects on monocyte, eosinophil, magnesium (Mg), chloride (Cl), glucose (BS), urea (BUN), uric acid (U.A), triglyceride (TG), calcium (Ca), albumin (Alb), total protein (TP), cortisol, noradrenaline and high density lipoprotein (HDL) levels in kutum male brood stocks (P>0.05). Pathology results showed toxin diazinon no effect on average weight and fish body length, the average weight of heart, brain, spleen, liver, kidney and liver index but caueses decrease of gonad weigth and gonad index and also, cause complications of tissue necrosis, vascular congestion, inflammation in the liver, a sharp reduction in the number of glomeruli, necrosis, vascular congestion and haemorage in the kidney, capsule thickening and fibrosis, atrophy, vascular congestion, macrophages release increased, increasing sediment Hemosiderine and thickening of artery walls in the spleen, atrophy, fibrosis and necrosis in testis , vascular congestion, increased distance between the myocardium and fibrous string in heart and neuronal loss, vascular congestion and edema in the brain of kutum male brood stocks.

QM/MM simulation of liquid water with an adaptive quantum region.

The simulation of complex chemical systems often requires a multi-level description, in which a region of special interest is treated using a computationally expensive quantum mechanical (QM) model while its environment is described by a faster, simpler molecular mechanical (MM) model. Furthermore, studying dynamic effects in solvated systems or bio-molecules requires a variable definition of the two regions, so that atoms or molecules can be dynamically re-assigned between the QM and MM descriptions during the course of the simulation. Such reassignments pose a problem for traditional QM/MM schemes by exacerbating the errors that stem from switching the model at the boundary. Here we show that stable, long adaptive simulations can be carried out using density functional theory with the BLYP exchange-correlation functional for the QM model and a flexible TIP3P force field for the MM model without requiring adjustments of either. Using a primary benchmark system of pure water, we investigate the convergence of the liquid structure with the size of the QM region, and demonstrate that by using a sufficiently large QM region (with radius 6 Å) it is possible to obtain radial and angular distributions that, in the QM region, match the results of fully quantum mechanical calculations with periodic boundary conditions, and, after a smooth transition, also agree with fully MM calculations in the MM region. The key ingredient is the accurate evaluation of forces in the QM subsystem which we achieve by including an extended buffer region in the QM calculations. We also show that our buffered-force QM/MM scheme is transferable by simulating the solvated Cl(-) ion.

Robust variable horizon MPC with move blocking

This paper introduces a new formulation of variable horizon model predictive control (VH-MPC) that utilises move blocking for reducing computational complexity. Various results pertaining to move blocking are derived, following which, a generalised blocked VH-MPC controller is formulated for linear discrete-time systems. Robustness to bounded disturbances is ensured through the use of tightened constraints. The resulting time-varying control scheme is shown to guarantee robust recursive feasibility and finite-time completion. An example is then presented for a particular choice of blocking regime, as would be applicable to vehicle manœuvring problems. Simulations demonstrate the efficacy of the formulation. © 2012 Elsevier B.V. All rights reserved.