Validation based sparse Gaussian processes for ordinal regression

This paper proposes a sparse modeling approach to solve ordinal regression problems using Gaussian processes (GP). Designing a sparse GP model is important from training time and inference time viewpoints. We first propose a variant of the Gaussian process ordinal regression (GPOR) approach, leave-one-out GPOR (LOO-GPOR). It performs model selection using the leave-one-out cross-validation (LOO-CV) technique. We then provide an approach to design a sparse model for GPOR. The sparse GPOR model reduces computational time and storage requirements. Further, it provides faster inference. We compare the proposed approaches with the state-of-the-art GPOR approach on some benchmark data sets. Experimental results show that the proposed approaches are competitive.

Validation-Based Sparse Gaussian Process Classifier Design

Gaussian processes (GPs) are promising Bayesian methods for classification and regression problems. Design of a GP classifier and making predictions using it is, however, computationally demanding, especially when the training set size is large. Sparse GP classifiers are known to overcome this limitation. In this letter, we propose and study a validation-based method for sparse GP classifier design. The proposed method uses a negative log predictive (NLP) loss measure, which is easy to compute for GP models. We use this measure for both basis vector selection and hyperparameter adaptation. The experimental results on several real-world benchmark data sets show better orcomparable generalization performance over existing methods.

Characterization of unitary processes with independent and stationary increments

This is a continuation of the earlier work (Publ. Res. Inst. Math. Sci. 45 (2009) 745-785) to characterize unitary stationary independent increment Gaussian processes. The earlier assumption of uniform continuity is replaced by weak continuity and with technical assumptions on the domain of the generator, unitary equivalence of the process to the solution of an appropriate Hudson-Parthasarathy equation is proved.

Semi-Supervised Classification Using Sparse Gaussian Process Regression

Gaussian Processes (GPs) are promising Bayesian methods for classification and regression problems. They have also been used for semi-supervised learning tasks. In this paper, we propose a new algorithm for solving semi-supervised binary classification problem using sparse GP regression (GPR) models. It is closely related to semi-supervised learning based on support vector regression (SVR) and maximum margin clustering. The proposed algorithm is simple and easy to implement. It gives a sparse solution directly unlike the SVR based algorithm. Also, the hyperparameters are estimated easily without resorting to expensive cross-validation technique. Use of sparse GPR model helps in making the proposed algorithm scalable. Preliminary results on synthetic and real-world data sets demonstrate the efficacy of the new algorithm.

Probabilistic least squares approach to ordinal regression

This paper proposes a novel approach to solve the ordinal regression problem using Gaussian processes. The proposed approach, probabilistic least squares ordinal regression (PLSOR), obtains the probability distribution over ordinal labels using a particular likelihood function. It performs model selection (hyperparameter optimization) using the leave-one-out cross-validation (LOO-CV) technique. PLSOR has conceptual simplicity and ease of implementation of least squares approach. Unlike the existing Gaussian process ordinal regression (GPOR) approaches, PLSOR does not use any approximation techniques for inference. We compare the proposed approach with the state-of-the-art GPOR approaches on some synthetic and benchmark data sets. Experimental results show the competitiveness of the proposed approach.

Residence time distribution for a class of Gaussian Markov processes

We study the distribution of residence time or equivalently that of "mean magnetization" for a family of Gaussian Markov processes indexed by a positive parameter alpha. The persistence exponent for these processes is simply given by theta=alpha but the residence time distribution is nontrivial. The shape of this distribution undergoes a qualitative change as theta increases, indicating a sharp change in the ergodic properties of the process. We develop two alternate methods to calculate exactly but recursively the moments of the distribution for arbitrary alpha. For some special values of alpha, we obtain closed form expressions of the distribution function. [S1063-651X(99)03306-1].

Analysis of randomly time varying systems by gaussian closure technique

The Gaussian probability closure technique is applied to study the random response of multidegree of freedom stochastically time varying systems under non-Gaussian excitations. Under the assumption that the response, the coefficient and the excitation processes are jointly Gaussian, deterministic equations are derived for the first two response moments. It is further shown that this technique leads to the best Gaussian estimate in a minimum mean square error sense. An example problem is solved which demonstrates the capability of this technique for handling non-linearity, stochastic system parameters and amplitude limited responses in a unified manner. Numerical results obtained through the Gaussian closure technique compare well with the exact solutions.

The diffusion and relaxation of Gaussian chains in narrow rectangular slits

The confinement of a polymer to volumes whose characteristic linear dimensions are comparable to or smaller than its bulk radius of gyration R-G,R-bulk can produce significant changes in its static and dynamic properties, with important implications for the understanding of single-molecule processes in biology and chemistry. In this paper, we present calculations of the effects of a narrow rectangular slit of thickness d on the scaling behavior of the diffusivity D and relaxation time tau(r) of a Gaussian chain of polymerization index N and persistence length l(0). The calculations are based on the Rouse-Zimm model of chain dynamics, with the pre-averaged hydrodynamic interaction being obtained from the solutions to Stokes equations for an incompressible fluid in a parallel plate geometry in the limit of small d. They go beyond de Gennes' purely phenomenological analysis of the problem based on blobs, which has so far been the only analytical route to the determination of chain scaling behavior for this particular geometry. The present model predicts that D similar to dN(-1) ln(N/d(2)) and tau(r) similar to N(2)d(-1) ln(N/d(2))(-1) in the regime of moderate confinement, where l(0) << d < R-G,R-bulk. The corresponding results for the blob model have exactly the same power law behavior, but contain no logarithmic corrections; the difference suggests that segments within a blob may actually be partially draining and not non-draining as generally assumed.

The diffusion and relaxation of Gaussian chains in narrow rectangular slits

The confinement of a polymer to volumes whose characteristic linear dimensions are comparable to or smaller than its bulk radius of gyration R-G,R-bulk can produce significant changes in its static and dynamic properties, with important implications for the understanding of single-molecule processes in biology and chemistry. In this paper, we present calculations of the effects of a narrow rectangular slit of thickness d on the scaling behavior of the diffusivity D and relaxation time tau(r) of a Gaussian chain of polymerization index N and persistence length l(0). The calculations are based on the Rouse-Zimm model of chain dynamics, with the pre-averaged hydrodynamic interaction being obtained from the solutions to Stokes equations for an incompressible fluid in a parallel plate geometry in the limit of small d. They go beyond de Gennes' purely phenomenological analysis of the problem based on blobs, which has so far been the only analytical route to the determination of chain scaling behavior for this particular geometry. The present model predicts that D similar to dN(-1) ln(N/d(2)) and tau(r) similar to N(2)d(-1) ln(N/d(2))(-1) in the regime of moderate confinement, where l(0) << d < R-G,R-bulk. The corresponding results for the blob model have exactly the same power law behavior, but contain no logarithmic corrections; the difference suggests that segments within a blob may actually be partially draining and not non-draining as generally assumed. (C) 2013 AIP Publishing LLC.

Determinantal point processes in the plane from products of random matrices

We show that the density of eigenvalues for three classes of random matrix ensembles is determinantal. First we derive the density of eigenvalues of product of k independent n x n matrices with i.i.d. complex Gaussian entries with a few of matrices being inverted. In second example we calculate the same for (compatible) product of rectangular matrices with i.i.d. Gaussian entries and in last example we calculate for product of independent truncated unitary random matrices. We derive exact expressions for limiting expected empirical spectral distributions of above mentioned ensembles.

Study of the processes occurring when sputtering YBa2Cu3O7-x in pure oxygen

The sputter deposition of YBa2Cu3O7-x in a de-diode was performed in pure oxygen medium and an optical spectroscopic study of the resultant discharge revealed strong emissions from both metal atoms and oxygen ions. Emission intensities were studied in pressure range from 0.5 to 3 mbar, with substrate temperatures from 150 to 850 degrees C. Raising the substrate temperature to 850 degrees C increased the number of positive ions and excited neutral atoms. Raising the pressure decreased the emission intensities of excited neutral and ionic species. The results have been compared with those obtained from Langmuir probe measurements. The rise in emission intensities of excited neutrals and ions with temperature suggested the possibility of chemically enhanced physical sputtering of YBa2Cu3O7-x. The effect of process conditions on film composition and quality is also discussed.

Twist phase in Gaussian-beam optics

The recently discovered twist phase is studied in the context of the full ten-parameter family of partially coherent general anisotropic Gaussian Schell-model beams. It is shown that the nonnegativity requirement on the cross-spectral density of the beam demands that the strength of the twist phase be bounded from above by the inverse of the transverse coherence area of the beam. The twist phase as a two-point function is shown to have the structure of the generalized Huygens kernel or Green's function of a first-order system. The ray-transfer matrix of this system is exhibited. Wolf-type coherent-mode decomposition of the twist phase is carried out. Imposition of the twist phase on an otherwise untwisted beam is shown to result in a linear transformation in the ray phase space of the Wigner distribution. Though this transformation preserves the four-dimensional phase-space volume, it is not symplectic and hence it can, when impressed on a Wigner distribution, push it out of the convex set of all bona fide Wigner distributions unless the original Wigner distribution was sufficiently deep into the interior of the set.

Influence of friction during forming processes-a study using a numerical simulation technique

Friction has an important influence in metal forming operations, as it contributes to the success or otherwise of the process. In the present investigation, the effect of friction on metal forming was studied by simulating compression tests on cylindrical Al-Mg alloy using the finite element method (FEM) technique. Three kinds of compression tests were considered wherein a constant coefficient of friction was employed at the upper die-work-piece interface. However, the coefficient of friction between the lower die-work-piece interfaces was varied in the tests. The simulation results showed that a difference in metal flow occurs near the interfaces owing to the differences in the coefficient of friction. It was concluded that the variations in the coefficient of friction between the dies and the work-piece directly affect the stress distribution and shape of the work-piece, having implications on the microstructure of the material being processed.

Thermal Degradation Processes in Poly(xylylene sulfides) Investigated by Comparative Direct Pyrolysis MS and Flash Pyrolysis GC/MS Experiments

The thermal degradation processes of two sulfur polymers, poly(xylylene sulfide) (PXM) and poly(xylylene disulfide) (PXD), were investigated in parallel by direct pyrolysis mass spectrometry (DPMS) and flash pyrolysis GC/MS (Py-GC/MS). Thermogravimetric data showed that these polymers decompose with two separate steps in the temperature ranges of 250-280 and 600-650 degrees C, leaving a high amount of residue (about 50% at 800 degrees C). The pyrolysis products detected by DPMS in the first degradation step of PXM and PXD were terminated by three types of end groups, -CH3, -CH2SH, and -CH=S, originating from thermal cleavage reactions involving a series of homolytic chain scissions followed by hydrogen transfer reactions, generating several oligomers containing some intact xylylene sulfide repeating units. The presence of pyrolysis compounds containing some stilbene-like units in the first degradation step has also been observed. Their formation has been accounted for with a parallel cleavage involving the elimination of H2S from the PXM main chains. These unsaturated units can undergo cross-linking at higher temperatures, producing the high amount of char residue observed. The thermal degradation compounds detected by DPMS in the second decomposition step at about 600-650 degrees C were constituted of condensed aromatic molecules containing dihydrofenanthrene and fenanthrene units. These compounds might be generated from the polymer chains containing stilbene units, by isomerization and dehydrogenation reactions. The pyrolysis products obtained in the Py-GC/MS of PXM and PXD at 610 degrees C are almost identical. The relative abundance in the pyrolysate and the spectral properties of the main pyrolysis products were found to be in generally good agreement with those obtained by DPMS. Polycyclic aromatic hydrocarbons (PAHs) were also detected by Py-GC/MS but in minor amounts with respect to DPMS. This apparent discrepancy was due to the simultaneous detection of PAHs together with all pyrolysis products in the Py-GC/MS, whereas in DPMS they were detected in the second thermal degradation step without the greatest part of pyrolysis compounds generated in the first degradation step. The results obtained by DPMS and PSI-GC/MS experiments showed complementary data for the degradation of PXM and PXD and, therefore, allowed the unequivocal formulation of the thermal degradation mechanism for these sulfur-containing polymers.

Gaussian Schell-model beams and general shape invariance

We present two six-parameter families of anisotropic Gaussian Schell-model beams that propagate in a shape-invariant manner, with the intensity distribution continuously twisting about the beam axis. The two families differ in the sense or helicity of this beam twist. The propagation characteristics of these shape-invariant beams are studied, and the restrictions on the beam parameters that arise from the optical uncertainty principle are brought out. Shape invariance is traced to a fundamental dynamical symmetry that underlies these beams. This symmetry is the product of spatial rotation and fractional Fourier transformation.