Variational studies and replica symmetry breaking in the generalization problem of the binary perceptron

We analyze the average performance of a general class of learning algorithms for the nondeterministic polynomial time complete problem of rule extraction by a binary perceptron. The examples are generated by a rule implemented by a teacher network of similar architecture. A variational approach is used in trying to identify the potential energy that leads to the largest generalization in the thermodynamic limit. We restrict our search to algorithms that always satisfy the binary constraints. A replica symmetric ansatz leads to a learning algorithm which presents a phase transition in violation of an information theoretical bound. Stability analysis shows that this is due to a failure of the replica symmetric ansatz and the first step of replica symmetry breaking (RSB) is studied. The variational method does not determine a unique potential but it allows construction of a class with a unique minimum within each first order valley. Members of this class improve on the performance of Gibbs algorithm but fail to reach the Bayesian limit in the low generalization phase. They even fail to reach the performance of the best binary, an optimal clipping of the barycenter of version space. We find a trade-off between a good low performance and early onset of perfect generalization. Although the RSB may be locally stable we discuss the possibility that it fails to be the correct saddle point globally. ©2000 The American Physical Society.

Variational calculation of positronium-helium-atom scattering length

A basis-set calculation scheme for S-waves Ps-He elastic scattering below the lowest inelastic threshold was formulated using a variational expression for the transition matrix. The scheme was illustrated numerically by calculating the scattering length in the electronic doublet state: a=1.0±0.1 a.u.

Confined systems through variational supersymmetric quantum mechanics

The energy states of the confined harmonic oscillator and the Hulthén potentials are evaluated using the Variational Method associated to Supersymmetric Quantum Mechanics.

An unproblematic method to solve economic and emission dispatch

This paper proposes a method to determine the output of all online units with minimum total cost when the amount of emission is reasonable. A joint economic and emission dispatch is proposed in order to get a significant compromise between costs and emission such that real power supply-demand equilibrium is satisfied. In order to have a meaningful compromise between costs and emission in the problem formulation, two variables are used, weighting factor and price penalty factor. A case study comprising of a 3-unit power system is employed, where various demand is used. Results for the test system indicate the fastness and effectiveness of proposed method. © 2011 IEEE.

Supervised variational relevance learning, an analytic geometric feature selection with applications to omic datasets

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)