Variational studies and replica symmetry breaking in the generalization problem of the binary perceptron

We analyze the average performance of a general class of learning algorithms for the nondeterministic polynomial time complete problem of rule extraction by a binary perceptron. The examples are generated by a rule implemented by a teacher network of similar architecture. A variational approach is used in trying to identify the potential energy that leads to the largest generalization in the thermodynamic limit. We restrict our search to algorithms that always satisfy the binary constraints. A replica symmetric ansatz leads to a learning algorithm which presents a phase transition in violation of an information theoretical bound. Stability analysis shows that this is due to a failure of the replica symmetric ansatz and the first step of replica symmetry breaking (RSB) is studied. The variational method does not determine a unique potential but it allows construction of a class with a unique minimum within each first order valley. Members of this class improve on the performance of Gibbs algorithm but fail to reach the Bayesian limit in the low generalization phase. They even fail to reach the performance of the best binary, an optimal clipping of the barycenter of version space. We find a trade-off between a good low performance and early onset of perfect generalization. Although the RSB may be locally stable we discuss the possibility that it fails to be the correct saddle point globally. ©2000 The American Physical Society.

Analytical functions for the calculation of hyperspherical potential curves of atomic systems

We present angular basis functions for the Schrödinger equation of two-electron systems in hyperspherical coordinates. By using the hyperspherical adiabatic approach, the wave functions of two-electron systems are expanded in analytical functions, which generalizes the Jacobi polynomials. We show that these functions, obtained by selecting the diagonal terms of the angular equation, allow efficient diagonalization of the Hamiltonian for all values of the hyperspherical radius. The method is applied to the determination of the 1S e energy levels of the Li + and we show that the precision can be improved in a systematic and controllable way. ©2000 The American Physical Society.

Variational calculation of positronium-helium-atom scattering length

A basis-set calculation scheme for S-waves Ps-He elastic scattering below the lowest inelastic threshold was formulated using a variational expression for the transition matrix. The scheme was illustrated numerically by calculating the scattering length in the electronic doublet state: a=1.0±0.1 a.u.

Estimates of covariance functions for growth from birth to 630 days of age in Nelore cattle

Weight records of Brazilian Nelore cattle, from birth to 630 d of age, recorded every 3 mo, were analyzed using random regression models. Independent variables were Legendre polynomials of age at recording. The model of analysis included contemporary groups as fixed effects and age of dam as a linear and quadratic covariable. Mean trends were modeled through a cubic regression on orthogonal polynomials of age. Up to four sets of random regression coefficients were fitted for animals' direct and maternal, additive genetic, and permanent environmental effects. Changes in measurement error variances with age were modeled through a variance function. Orders of polyno-mial fit from three to six were considered, resulting in up to 77 parameters to be estimated. Models fitting random regressions modeled the pattern of variances in the data adequately, with estimates similar to those from corresponding univariate analysis. Direct heritability estimates decreased after birth and tended to be lowest at ages at which maternal effect estimates tended to be highest. Maternal heritability estimates increased after birth to a peak around 110 to 120 d of age and decreased thereafter. Additive genetic direct correlation estimates between weights at standard ages (birth, weaning, yearling, and final weight) were moderate to high and maternal genetic and environmental correlations were consistently high. © 2001 American Society of Animal Science. All rights reserved.

Nonnegative trigonometric polynomials

An extremal problem for the coefficients of sine polynomials, which are nonnegative in [0,π] , posed and discussed by Rogosinski and Szego is under consideration. An analog of the Fejér-Riesz representation of nonnegative general trigonometric and cosine polynomials is proved for nonnegative sine polynomials. Various extremal sine polynomials for the problem of Rogosinski and Szego are obtained explicitly. Associated cosine polynomials k n (θ) are constructed in such a way that { k n (θ) } are summability kernels. Thus, the L p , pointwise and almost everywhere convergence of the corresponding convolutions, is established. © 2002 Springer-Verlag New York Inc.

On the two point Padé table for a distribution

Some additional recurrence relations for the denominator polynomials of two point Padé approximants are derived. An example in which the coefficients of one of the two series, from which the Padé approximants are derived, are moments of a distribution is considered. For this example, properties of the denominator polynomials, and their zeros, are described.

PI Stabilization of a Class of Time Delay Systems

In this paper we use the Hermite-Biehler theorem to establish results for the design of proportional plus integral (PI) controllers for a class of time delay systems. We extend results of the polynomial case to quasipolynomials using the property of interlacing in high frequencies of the class of time delay systems considered. A signature for the quasipolynomials in this class is derived and used in the proposed approach which yields the complete set of the stabilizing PI controllers.

Orthogonal polynomials associated with related measures and Sobolev orthogonal polynomials

Connection between two sequences of orthogonal polynomials, where the associated measures are related to each other by a first degree polynomial multiplication (or division), are looked at. The results are applied to obtain information regarding Sobolev orthogonal polynomials associated with certain pairs of measures.

Behavioural Analysis of a Nonlinear Mechanical System Using Transient Trajectories

This work aims at a better comprehension of the features of the solution surface of a dynamical system presenting a numerical procedure based on transient trajectories. For a given set of initial conditions an analysis is made, similar to that of a return map, looking for the new configuration of this set in the first Poincaré sections. The mentioned set of I.C. will result in a curve that can be fitted by a polynomial, i.e. an analytical expression that will be called initial function in the undamped case and transient function in the damped situation. Thus, it is possible to identify using analytical methods the main stable regions of the phase portrait without a long computational time, making easier a global comprehension of the nonlinear dynamics and the corresponding stability analysis of its solutions. This strategy allows foreseeing the dynamic behavior of the system close to the region of fundamental resonance, providing a better visualization of the structure of its phase portrait. The application chosen to present this methodology is a mechanical pendulum driven through a crankshaft that moves horizontally its suspension point.

Estimates of covariance functions for growth of Nelore cattle applying a parametric correlation structure to model within-animal correlations

A total of 20,065 weights recorded on 3016 Nelore animals were used to estimate covariance functions for growth from birth to 630 days of age, assuming a parametric correlation structure to model within-animal correlations. The model of analysis included fixed effects of contemporary groups and age of dam as quadratic covariable. Mean trends were taken into account by a cubic regression on orthogonal polynomials of animal age. Genetic effects of the animal and its dam and maternal permanent environmental effects were modelled by random regressions on Legendre polynomials of age at recording. Changes in direct permanent environmental effect variances were modelled by a polynomial variance function, together with a parametric correlation function to account for correlations between ages. Stationary and nonstationary models were used to model within-animal correlations between different ages. Residual variances were considered homogeneous or heterogeneous, with changes modelled by a step or polynomial function of age at recording. Based on Bayesian information criterion, a model with a cubic variance function combined with a nonstationary correlation function for permanent environmental effects, with 49 parameters to be estimated, fitted best. Modelling within-animal correlations through a parametric correlation structure can describe the variation pattern adequately. Moreover, the number of parameters to be estimated can be decreased substantially compared to a model fitting random regression on Legendre polynomial of age. © 2004 Elsevier B.V. All rights reserved.

Alocação de zeros aplicada a sistemas de controle via LMI

A systematic procedure of zero placement to design control systems is proposed. A state feedback controller with vector gain K is used to perform the pole placement. An estimator with vector gain L is also designed for output feedback control. A new systematic method of zero assignment to reduce the effect of the undesirable poles of the plant and also to increase the velocity error constant is presented. The methodology places the zeros in a specific region and it is based on Linear Matrix Inequalities (LMIs) framework, which is a new approach to solve this problem. Three examples illustrate the effectiveness of the proposed method.

Third-body perturbation in the case of elliptic orbits for the disturbing body

In the present work it is presented a semi-analytical and a numerical study of the perturbation caused in a spacecraft by a third body using a double averaged analytical model with the disturbing function expanded in Legendre polynomials up to the second-order. The important reason for this procedure is to eliminate the terms due to the short time periodic motion of the spacecraft and to show smooth curves for the evolution of the mean orbital elements for a long time period. The aim of this study is to calculate the effect of lunar perturbations on the orbits of spacecrafts that are traveling around the Earth. It is presented an analysis of the stability of a near-circular orbit and a study to know under which conditions this orbit remains near-circular. A study of the equatorial orbits is also performed.

Sharp Turán inequalities via very hyperbolic polynomials

We present new sharp inequalities for the Maclaurin coefficients of an entire function from the Laguerre-Pólya class. They are obtained by a new technique involving the so-called very hyperbolic polynomials. The results may be considered as extensions of the classical Turán inequalities. © 2010 Elsevier Inc.

Kernel polynomials from L-orthogonal polynomials

A positive measure ψ defined on [a,b] such that its moments μn=∫a btndψ(t) exist for n=0,±1,±2,⋯, is called a strong positive measure on [a,b]. If 0≤aof (monic) polynomials {Qn}, defined by ∫a bt-n+sQn(t)dψ(t)=0, s=0,1,⋯,n-1, is known to exist. We refer to these polynomials as the L-orthogonal polynomials with respect to the strong positive measure ψ. The purpose of this manuscript is to consider some properties of the kernel polynomials associated with these L-orthogonal polynomials. As applications, we consider the quadrature rules associated with these kernel polynomials. Associated eigenvalue problems and numerical evaluation of the nodes and weights of such quadrature rules are also considered. © 2010 IMACS. Published by Elsevier B.V. All rights reserved.

Multivariate sobolev-type orthogonal polynomials

Multivariate orthogonal polynomials associated with a Sobolev-type inner product, that is, an inner product defined by adding to a measure the evaluation of the gradients in a fixed point, are studied. Orthogonal polynomials and kernel functions associated with this new inner product can be explicitly expressed in terms of those corresponding with the original measure. We apply our results to the particular case of the classical orthogonal polynomials on the unit ball, and we obtain the asymptotics of the kernel functions. © 2011 Universidad de Jaén.