Generalized power method for sparse principal component analysis

In this paper we develop a new approach to sparse principal component analysis (sparse PCA). We propose two single-unit and two block optimization formulations of the sparse PCA problem, aimed at extracting a single sparse dominant principal component of a data matrix, or more components at once, respectively. While the initial formulations involve nonconvex functions, and are therefore computationally intractable, we rewrite them into the form of an optimization program involving maximization of a convex function on a compact set. The dimension of the search space is decreased enormously if the data matrix has many more columns (variables) than rows. We then propose and analyze a simple gradient method suited for the task. It appears that our algorithm has best convergence properties in the case when either the objective function or the feasible set are strongly convex, which is the case with our single-unit formulations and can be enforced in the block case. Finally, we demonstrate numerically on a set of random and gene expression test problems that our approach outperforms existing algorithms both in quality of the obtained solution and in computational speed. © 2010 Michel Journée, Yurii Nesterov, Peter Richtárik and Rodolphe Sepulchre.

Broadband terahertz time-domain spectroscopy of drugs-of-abuse and the use of principal component analysis

EPSRC, the European Community IST FP6 Integrated, etc

Evaluation of a combined wavelet and a combined principal component analysis classification system for BCG diagnostic problem

Heart disease is one of the main factor causing death in the developed countries. Over several decades, variety of electronic and computer technology have been developed to assist clinical practices for cardiac performance monitoring and heart disease diagnosis. Among these methods, Ballistocardiography (BCG) has an interesting feature that no electrodes are needed to be attached to the body during the measurement. Thus, it is provides a potential application to asses the patients heart condition in the home. In this paper, a comparison is made for two neural networks based BCG signal classification models. One system uses a principal component analysis (PCA) method, and the other a discrete wavelet transform, to reduce the input dimensionality. It is indicated that the combined wavelet transform and neural network has a more reliable performance than the combined PCA and neural network system. Moreover, the wavelet transform requires no prior knowledge of the statistical distribution of data samples and the computation complexity and training time are reduced.

A New Principal Curve Algorithm for Nonlinear Principal Component Analysis

This paper emerged from work supported by EPSRC grant GR/S84354/01 and proposes a method of determining principal curves, using spline functions, in principal component analysis (PCA) for the representation of non-linear behaviour in process monitoring. Although principal curves are well established, they are difficult to implement in practice if a large number of variables are analysed. The significant contribution of this paper is that the proposed method has minimal complexity, assuming simple spline geometry, thus enabling efficient computation. The paper provides a foundation for further work where multiple curves may be required to represent underlying non-linear information in complex data.

Principal Component Analysis of Wide Area Phasor Measurements for Islanding Detection – A Geometric View

This paper presents a new technique for the detectionof islanding conditions in electrical power systems. This problem isespecially prevalent in systems with significant penetrations of distributedrenewable generation. The proposed technique is based onthe application of principal component analysis (PCA) to data setsof wide-area frequency measurements, recorded by phasor measurementunits. The PCA approach was able to detect islandingaccurately and quickly when compared with conventional RoCoFtechniques, as well as with the frequency difference and change-ofangledifference methods recently proposed in the literature. Thereliability and accuracy of the proposed PCA approach is demonstratedby using a number of test cases, which consider islandingand nonislanding events. The test cases are based on real data,recorded from several phasor measurement units located in theU.K. power system.