Improved conjugate gradient implementation for least squares support vector machines

As a promising method for pattern recognition and function estimation, least squares support vector machines (LS-SVM) express the training in terms of solving a linear system instead of a quadratic programming problem as for conventional support vector machines (SVM). In this paper, by using the information provided by the equality constraint, we transform the minimization problem with a single equality constraint in LS-SVM into an unconstrained minimization problem, then propose reduced formulations for LS-SVM. By introducing this transformation, the times of using conjugate gradient (CG) method, which is a greatly time-consuming step in obtaining the numerical solution, are reduced to one instead of two as proposed by Suykens et al. (1999). The comparison on computational speed of our method with the CG method proposed by Suykens et al. and the first order and second order SMO methods on several benchmark data sets shows a reduction of training time by up to 44%. (C) 2011 Elsevier B.V. All rights reserved.

A New Gradient Descent Approach for Local Learning of Fuzzy Neural Models

The majority of reported learning methods for Takagi-Sugeno-Kang fuzzy neural models to date mainly focus on the improvement of their accuracy. However, one of the key design requirements in building an interpretable fuzzy model is that each obtained rule consequent must match well with the system local behaviour when all the rules are aggregated to produce the overall system output. This is one of the distinctive characteristics from black-box models such as neural networks. Therefore, how to find a desirable set of fuzzy partitions and, hence, to identify the corresponding consequent models which can be directly explained in terms of system behaviour presents a critical step in fuzzy neural modelling. In this paper, a new learning approach considering both nonlinear parameters in the rule premises and linear parameters in the rule consequents is proposed. Unlike the conventional two-stage optimization procedure widely practised in the field where the two sets of parameters are optimized separately, the consequent parameters are transformed into a dependent set on the premise parameters, thereby enabling the introduction of a new integrated gradient descent learning approach. A new Jacobian matrix is thus proposed and efficiently computed to achieve a more accurate approximation of the cost function by using the second-order Levenberg-Marquardt optimization method. Several other interpretability issues about the fuzzy neural model are also discussed and integrated into this new learning approach. Numerical examples are presented to illustrate the resultant structure of the fuzzy neural models and the effectiveness of the proposed new algorithm, and compared with the results from some well-known methods.

Fast-electron self-collimation in a plasma density gradient

A theoretical and numerical study of fast electron transport in solid and compressed fast ignition relevant targets is presented. The principal aim of the study is to assess how localized increases in the target density (e. g., by engineering of the density profile) can enhance magnetic field generation and thus pinching of the fast electron beam through reducing the rate of temperature rise. The extent to which this might benefit fast ignition is discussed. (C) 2012 American Institute of Physics. [http://dx.doi.org/10.1063/1.4729322]

Efficient differentiation into skin cells of bone marrow cells recovered in a pellet after density gradient fractionation

We had previously demonstrated the participation of whole bone marrow cells from adult mice in the reconstitution of skin, including the epidermis and hair follicles. To get an insight into cell populations that give rise to the epithelial components of the reconstituted skin, we fractionated bone marrow cells derived from green fluorescent protein-transgenic mice by density gradient. Unexpectedly, we found that a substantial amount of mononucleated cells (approximately 30%) was recovered in the pellet fraction and that the cells in the pellet fraction preferentially differentiated into epithelial components of skin, rather than the cells in the mononuclear cell fraction. The pellet fraction contained more CD45-negative (thus uncommitted to the hematopoietic cell lineage) cells than the mononuclear cell fraction. These results indicate that density gradient fractionation results in significant loss of specific progenitor cells into the usually discarded pellet fraction.

Improved description of chemical barriers with generalized gradient approximations (GGAs) and meta-GGAs

The performance of exchange and correlation (xc) functionals of the generalized gradient approximation (GGA) type and of the meta-GGA type in the calculation of chemical reactions is related to topological features of the electron density which, in turn, are connected to the orbital structure of chemical bonds within the Kohn-Sham (KS) theory. Seventeen GGA and meta-GGA xc functionals are assessed for 15 hydrogen abstraction reactions and 3 symmetrical S(N)2 reactions. Systems that are problematic for standard GGAs characteristically have enhanced values of the dimensionless gradient argument s(sigma)(2) with local maxima in the bonding region. The origin of this topological feature is the occupation of valence KS orbitals with an antibonding or essentially nonbonding character. The local enhancement of s(sigma)(2) yields too negative exchange-correlation energies with standard GGAs for the transition state of the S(N)2 reaction, which leads to the reduced calculated reaction barriers. The unwarranted localization of the effective xc hole of the standard GGAs, i.e., the nondynamical correlation that is built into them but is spurious in this case, wields its effect by their s(sigma)(2) dependence. Barriers are improved for xc functionals with the exchange functional OPTX as x component, which has a modified dependence on s(sigma)(2). Standard GGAs also underestimate the barriers for the hydrogen abstraction reactions. In this case the barriers are improved by correlation functionals, such as the Laplacian-dependent (LAP3) functional, which has a modified dependence on the Coulomb correlation of the opposite- and like-spin electrons. The best overall performance is established for the combination OLAP3 of OPTX and LAP3.

On the required shape corrections to the local density and generalized gradient approximations to the Kohn-Sham potentials for molecular response calculations of (hyper)polarizabilities and excitation energies

It is well known that shape corrections have to be applied to the local-density (LDA) and generalized gradient (GGA) approximations to the Kohn-Sham exchange-correlation potential in order to obtain reliable response properties in time dependent density functional theory calculations. Here we demonstrate that it is an oversimplified view that these shape corrections concern primarily the asymptotic part of the potential, and that they affect only Rydberg type transitions. The performance is assessed of two shape-corrected Kohn-Sham potentials, the gradient-regulated asymptotic connection procedure applied to the Becke-Perdew potential (BP-GRAC) and the statistical averaging of (model) orbital potentials (SAOP), versus LDA and GGA potentials, in molecular response calculations of the static average polarizability alpha, the Cauchy coefficient S-4, and the static average hyperpolarizability beta. The nature of the distortions of the LDA/GGA potentials is highlighted and it is shown that they introduce many spurious excited states at too low energy which may mix with valence excited states, resulting in wrong excited state compositions. They also lead to wrong oscillator strengths and thus to a wrong spectral structure of properties like the polarizability. LDA, Becke-Lee-Yang-Parr (BLYP), and Becke-Perdew (BP) characteristically underestimate contributions to alpha and S-4 from bound Rydberg-type states and overestimate those from the continuum. Cancellation of the errors in these contributions occasionally produces fortuitously good results. The distortions of the LDA, BLYP, and BP spectra are related to the deficiencies of the LDA/GGA potentials in both the bulk and outer molecular regions. In contrast, both SAOP and BP-GRAC potentials produce high quality polarizabilities for 21 molecules and also reliable Cauchy moments and hyperpolarizabilities for the selected molecules. The analysis for the N-2 molecule shows, that both SAOP and BP-GRAC yield reliable energies omega(i) and oscillator strengths f(i) of individual excitations, so that they reproduce well the spectral structure of alpha and S-4.(C) 2002 American Institute of Physics.