Using the EM Algorithm to Train Neural Networks: Misconceptions and a New Algorithm for Multiclass Classification

The expectation-maximization (EM) algorithm has been of considerable interest in recent years as the basis for various algorithms in application areas of neural networks such as pattern recognition. However, there exists some misconceptions concerning its application to neural networks. In this paper, we clarify these misconceptions and consider how the EM algorithm can be adopted to train multilayer perceptron (MLP) and mixture of experts (ME) networks in applications to multiclass classification. We identify some situations where the application of the EM algorithm to train MLP networks may be of limited value and discuss some ways of handling the difficulties. For ME networks, it is reported in the literature that networks trained by the EM algorithm using iteratively reweighted least squares (IRLS) algorithm in the inner loop of the M-step, often performed poorly in multiclass classification. However, we found that the convergence of the IRLS algorithm is stable and that the log likelihood is monotonic increasing when a learning rate smaller than one is adopted. Also, we propose the use of an expectation-conditional maximization (ECM) algorithm to train ME networks. Its performance is demonstrated to be superior to the IRLS algorithm on some simulated and real data sets.

Solution of the dual reflection equation for A(n-1)((1)) solid-on-solid model

We obtain a diagonal solution of the dual reflection equation for the elliptic A(n-1)((1)) solid-on-solid model. The isomorphism between the solutions of the reflection equation and its dual is studied. (C) 2004 American Institute of Physics.

Partial regularity of minimizers of a functional involving forms and maps

We discuss the partial regularity of minimizers of energy functionals such as (1)/(p)integral(Omega)[sigma(u)dA(p) + (1)/(2)delu(2p)]dx, where u is a map from a domain Omega is an element of R-n into the m-dimensional unit sphere of Rm+1 and A is a differential one-form in Omega.

Photodissociation of benzene under collision-free conditions: An ab initio/Rice-Ramsperger-Kassel-Marcus study

The ab initio/Rice-Ramsperger-Kassel-Marcus (RRKM) approach has been applied to investigate the photodissociation mechanism of benzene at various wavelengths upon absorption of one or two UV photons followed by internal conversion into the ground electronic state. Reaction pathways leading to various decomposition products have been mapped out at the G2M level and then the RRKM and microcanonical variational transition state theories have been applied to compute rate constants for individual reaction steps. Relative product yields (branching ratios) for C6H5+H, C6H4+H-2, C4H4+C2H2, C4H2+C2H4, C3H3+C3H3, C5H3+CH3, and C4H3+C2H3 have been calculated subsequently using both numerical integration of kinetic master equations and the steady-state approach. The results show that upon absorption of a 248 nm photon dissociation is too slow to be observable in molecular beam experiments. In photodissociation at 193 nm, the dominant dissociation channel is H atom elimination (99.6%) and the minor reaction channel is H-2 elimination, with the branching ratio of only 0.4%. The calculated lifetime of benzene at 193 nm is about 11 mus, in excellent agreement with the experimental value of 10 mus. At 157 nm, the H loss remains the dominant channel but its branching ratio decreases to 97.5%, while that for H-2 elimination increases to 2.1%. The other channels leading to C3H3+C3H3, C5H3+CH3, C4H4+C2H2, and C4H3+C2H3 play insignificant role but might be observed. For photodissociation upon absorption of two UV photons occurring through the neutral hot benzene mechanism excluding dissociative ionization, we predict that the C6H5+H channel should be less dominant, while the contribution of C6H4+H-2 and the C3H3+C3H3, CH3+C5H3, and C4H3+C2H3 radical channels should significantly increase. (C) 2004 American Institute of Physics.

Merging of low-mass systems and the origin of the Fundamental Plane

We present a new set of dissipationless N-body simulations to examine the feasibility of creating bright ellipticals (following the Kormendy relation, hereafter KR) by hierarchically merging present-day early-type dwarf galaxies, and to study how the encounter parameters affect the location of the end product in the (mu(e))-R-e plane. We investigate the merging of one-component galaxies of both equal and different masses, the merging of two-component galaxy models to explore the effect of dark haloes on the final galaxy characteristics, and the merging of ultracompact dwarf galaxies. We find that the increase of (mu(e)) with R-e is attributable to an increase in the initial orbital energy. The merger remnants shift down in the (mu(e))-R-e plane and fail to reach the KR. Thus, the KR is not reproducible by mergers of dwarf early-type systems, rendering untenable the theory that present-day dwarfs are responsible for even a small fraction of the present-day ellipticals, unless a considerable amount of dissipation is invoked. However, we do find that present-day dwarfs can be formed by the merger of ultracompact dwarfs.

Coherent molecular bound states of bosons and fermions near a Feshback resonance

We analyze molecular bound states of atomic quantum gases near a Feshbach resonance. A simple, renormalizable field theoretic model is shown to have exact solutions in the two-body sector, whose binding energy agrees well with observed experimental results in both Bosonic and Fermionic cases. These solutions, which interpolate between BEC and BCS theories, also provide a more general variational ansatz for resonant superfluidity and related problems.

Three-dimensional solitons in coupled atomic-molecular Bose-Einstein condensates

We present a theoretical analysis of three-dimensional (3D) matter-wave solitons and their stability properties in coupled atomic and molecular Bose-Einstein condensates (BECs). The soliton solutions to the mean-field equations are obtained in an approximate analytical form by means of a variational approach. We investigate soliton stability within the parameter space described by the atom-molecule conversion coupling, the atom-atom s-wave scattering, and the bare formation energy of the molecular species. In terms of ordinary optics, this is analogous to the process of sub- or second-harmonic generation in a quadratic nonlinear medium modified by a cubic nonlinearity, together with a phase mismatch term between the fields. While the possibility of formation of multidimensional spatiotemporal solitons in pure quadratic media has been theoretically demonstrated previously, here we extend this prediction to matter-wave interactions in BEC systems where higher-order nonlinear processes due to interparticle collisions are unavoidable and may not be neglected. The stability of the solitons predicted for repulsive atom-atom interactions is investigated by direct numerical simulations of the equations of motion in a full 3D lattice. Our analysis also leads to a possible technique for demonstrating the ground state of the Schrodinger-Newton and related equations that describe Bose-Einstein condensates with nonlocal interparticle forces.

Existence of solutions to some equilibrium problems

The concept of a monotone family of functions, which need not be countable, and the solution of an equilibrium problem associated with the family are introduced. A fixed-point theorem is applied to prove the existence of solutions to the problem.

On the Schrodinger equation involving a critical Sobolev exponent and magnetic field

We consider the semilinear Schrodinger equation -Delta(A)u + V(x)u = Q(x)vertical bar u vertical bar(2* -2) u. Assuming that V changes sign, we establish the existence of a solution u not equal 0 in the Sobolev space H-A,V(1) + (R-N). The solution is obtained by a min-max type argument based on a topological linking. We also establish certain regularity properties of solutions for a rather general class of equations involving the operator -Delta(A).

Sharp Sobolev inequality involving a critical nonlinearity on a boundary

We consider the solvability of the Neumann problem for the equation -Delta u + lambda u = 0, partial derivative u/partial derivative v = Q(x)vertical bar u vertical bar(q-2)u on partial derivative Omega, where Q is a positive and continuous coefficient on partial derivative Omega, lambda is a parameter and q = 2(N - 1)/(N - 2) is a critical Sobolev exponent for the trace embedding of H-1(Omega) into L-q(partial derivative Omega). We investigate the joint effect of the mean curvature of partial derivative Omega and the shape of the graph of Q on the existence of solutions. As a by product we establish a sharp Sobolev inequality for the trace embedding. In Section 6 we establish the existence of solutions when a parameter lambda interferes with the spectrum of -Delta with the Neumann boundary conditions. We apply a min-max principle based on the topological linking.