Notes on PCA, Regularization, Sparsity and Support Vector Machines

We derive a new representation for a function as a linear combination of local correlation kernels at optimal sparse locations and discuss its relation to PCA, regularization, sparsity principles and Support Vector Machines. We first review previous results for the approximation of a function from discrete data (Girosi, 1998) in the context of Vapnik"s feature space and dual representation (Vapnik, 1995). We apply them to show 1) that a standard regularization functional with a stabilizer defined in terms of the correlation function induces a regression function in the span of the feature space of classical Principal Components and 2) that there exist a dual representations of the regression function in terms of a regularization network with a kernel equal to a generalized correlation function. We then describe the main observation of the paper: the dual representation in terms of the correlation function can be sparsified using the Support Vector Machines (Vapnik, 1982) technique and this operation is equivalent to sparsify a large dictionary of basis functions adapted to the task, using a variation of Basis Pursuit De-Noising (Chen, Donoho and Saunders, 1995; see also related work by Donahue and Geiger, 1994; Olshausen and Field, 1995; Lewicki and Sejnowski, 1998). In addition to extending the close relations between regularization, Support Vector Machines and sparsity, our work also illuminates and formalizes the LFA concept of Penev and Atick (1996). We discuss the relation between our results, which are about regression, and the different problem of pattern classification.

University Logo in Vector and Raster

This is a selection of University of Southampton Logos in both vector (svg) and raster (png) formats. These are suitable for use on the web or in small documents and posters. You can open the SVG files using inkscape (http://inkscape.org/download/?lang=en) and edit them directly. The University logo should not be modified and attention should be paid to the branding guidelines found here: http://www.edshare.soton.ac.uk/10481 You must always leave a space the width of an capital O in Southampton on all 4 edges of the logo. The negative space makes it appear more prominently on the page.

University Logo in Vector and Raster (Smoother Version)

These are a range of logos created in the same way as Mr Patrick McSweeny http://www.edshare.soton.ac.uk/11157. The logo has been extracted from PDF documents and is smoother and accurate to the original logo design. Many thanks to to McSweeny for publishing the logo, in SVG originally, I struggled to find it anywhere else. Files are in Inkscape SVG, PDF and PNG. From Mr Patrick McSweeney: This is a selection of University of Southampton Logos in both vector (svg) and raster (png) formats. These are suitable for use on the web or in small documents and posters. You can open the SVG files using inkscape (http://inkscape.org/download/?lang=en) and edit them directly. The University logo should not be modified and attention should be paid to the branding guidelines found here: http://www.edshare.soton.ac.uk/10481 You must always leave a space the width of an capital O in Southampton on all 4 edges of the logo. The negative space makes it appear more prominently on the page.

Interactive Vector Field Feature Identification

We introduce a flexible technique for interactive exploration of vector field data through classification derived from user-specified feature templates. Our method is founded on the observation that, while similar features within the vector field may be spatially disparate, they share similar neighborhood characteristics. Users generate feature-based visualizations by interactively highlighting well-accepted and domain specific representative feature points. Feature exploration begins with the computation of attributes that describe the neighborhood of each sample within the input vector field. Compilation of these attributes forms a representation of the vector field samples in the attribute space. We project the attribute points onto the canonical 2D plane to enable interactive exploration of the vector field using a painting interface. The projection encodes the similarities between vector field points within the distances computed between their associated attribute points. The proposed method is performed at interactive rates for enhanced user experience and is completely flexible as showcased by the simultaneous identification of diverse feature types.

Pion: space-like structure

The scalar form factor describes modifications induced by the pion over the quark condensate. Assuming that representations produced by chiral perturbation theory can be pushed to high values of negative-t, a region in configuration space is reached (r < R similar to 0.5 fm) where the form factor changes sign, indicating that the condensate has turned into empty space. A simple model for the pion incorporates this feature into density functions. When supplemented by scalar-meson excitations, it yields predictions close to empirical values for the mean square radius (< r(2)>(pi)(S) = 0.59 fm(2)) and for one of the low energy constants ((l) over bar (4) = 4.3), with no adjusted parameters.

NEW CHARACTERIZATIONS OF COMPLETE SPACELIKE SUBMANIFOLDS IN SEMI-RIEMANNIAN SPACE FORMS

In this paper we study n-dimensional complete spacelike submanifolds with constant normalized scalar curvature immersed in semi-Riemannian space forms. By extending Cheng-Yau`s technique to these ambients, we obtain results to such submanifolds satisfying certain conditions on both the squared norm of the second fundamental form and the mean curvature. We also characterize compact non-negatively curved submanifolds in De Sitter space of index p.

Color Segmentation using LVQ-Learning Vector Quantization

This thesis aims to present a color segmentation approach for traffic sign recognition based on LVQ neural networks. The RGB images were converted into HSV color space, and segmented using LVQ depending on the hue and saturation values of each pixel in the HSV color space. LVQ neural network was used to segment red, blue and yellow colors on the road and traffic signs to detect and recognize them. LVQ was effectively applied to 536 sampled images taken from different countries in different conditions with 89% accuracy and the execution time of each image among 31 images was calculated in between 0.726sec to 0.844sec. The method was tested in different environmental conditions and LVQ showed its capacity to reasonably segment color despite remarkable illumination differences. The results showed high robustness.

Bounded solutions of fermions in the background of mixed vector-scalar Poeschl-Teller-like potentials

The problem of a fermion subject to a convenient mixing of vector and scalar potentials in a two-dimensional space-time is mapped into a Sturm-Liouville problem. For a specific case which gives rise to an exactly solvable effective modified Poschl-Teller potential in the Sturm-Liouville problem, bound-state solutions are found. The behaviour of the upper and lower components of the Dirac spinor is discussed in detail and some unusual results are revealed. The Dirac delta potential as a limit of the modified Poschl-Teller potential is also discussed. The problem is also shown to be mapped into that of massless fermions subject to classical topological scalar and pseudoscalar potentials. Copyright (C) EPLA, 2007.

Confinement of spinless particles by Coulomb potentials in two-dimensional space-time

The problem of confinement of spinless particles in 1 + 1 dimensions is approached with a linear potential by considering a mixing of Lorentz vector and scalar couplings. Analytical bound-states solutions are obtained when the scalar coupling is of sufficient intensity compared to the vector coupling. (c) 2005 Elsevier B.V. All rights reserved.

Klein-Gordon particles in mixed vector-scalar inversely linear potentials

The problem of a spinless particle subject to a general mixing of vector and scalar inversely linear potentials in a two-dimensional world is analyzed. Exact bounded solutions are found in closed form by imposing boundary conditions on the eigenfunctions which ensure that the effective Hamiltonian is Hermitian for all the points of the space. The nonrelativistic limit of our results adds a new support to the conclusion that even-parity solutions to the nonrelativistic one-dimensional hydrogen atom do not exist. (c) 2005 Elsevier B.V. All rights reserved.

On the nonminimal vector coupling in the Duffin-Kemmer-Petiau theory and the confinement of massive bosons by a linear potential

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Spinless bosons embedded in a vector Duffin-Kemmer-Petiau oscillator

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

On the hardy space H¹ on products of half-spaces

We show that the Hardy space H¹ anal (R2+ x R2+) can be identified with the class of functions f such that f and all its double and partial Hubert transforms Hk f belong to L¹ (R2). A basic tool used in the proof is the bisubharmonicity of |F|q, where F is a vector field that satisfies a generalized conjugate system of Cauchy-Riemann type.

Sliding Vector Fields via Slow-Fast Systems

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Electromagnetic form factor of the pion in the space- and time-like regions within the front-form dynamics

The pion electromagnetic form factor is calculated in the space- and time-like regions from -10 (GeV/c)2 up to 10 (GeV/c)2, within a front-form model. The dressed photon vertex where a photon decays in a quark-antiquark pair is depicted generalizing the vector meson dominance ansatz, by means of the vector meson vertex functions. An important feature of our model is the description of the on-mass-shell vertex functions in the valence sector, for the pion and the vector mesons, through the front-form wave functions obtained within a realistic quark model. The theoretical results show an excellent agreement with the data in the space-like region, while in the time-like region the description is quite encouraging. © 2003 Elsevier B.V. All rights reserved.