Improved conjugate gradient implementation for least squares support vector machines

As a promising method for pattern recognition and function estimation, least squares support vector machines (LS-SVM) express the training in terms of solving a linear system instead of a quadratic programming problem as for conventional support vector machines (SVM). In this paper, by using the information provided by the equality constraint, we transform the minimization problem with a single equality constraint in LS-SVM into an unconstrained minimization problem, then propose reduced formulations for LS-SVM. By introducing this transformation, the times of using conjugate gradient (CG) method, which is a greatly time-consuming step in obtaining the numerical solution, are reduced to one instead of two as proposed by Suykens et al. (1999). The comparison on computational speed of our method with the CG method proposed by Suykens et al. and the first order and second order SMO methods on several benchmark data sets shows a reduction of training time by up to 44%. (C) 2011 Elsevier B.V. All rights reserved.

A New Gradient Descent Approach for Local Learning of Fuzzy Neural Models

The majority of reported learning methods for Takagi-Sugeno-Kang fuzzy neural models to date mainly focus on the improvement of their accuracy. However, one of the key design requirements in building an interpretable fuzzy model is that each obtained rule consequent must match well with the system local behaviour when all the rules are aggregated to produce the overall system output. This is one of the distinctive characteristics from black-box models such as neural networks. Therefore, how to find a desirable set of fuzzy partitions and, hence, to identify the corresponding consequent models which can be directly explained in terms of system behaviour presents a critical step in fuzzy neural modelling. In this paper, a new learning approach considering both nonlinear parameters in the rule premises and linear parameters in the rule consequents is proposed. Unlike the conventional two-stage optimization procedure widely practised in the field where the two sets of parameters are optimized separately, the consequent parameters are transformed into a dependent set on the premise parameters, thereby enabling the introduction of a new integrated gradient descent learning approach. A new Jacobian matrix is thus proposed and efficiently computed to achieve a more accurate approximation of the cost function by using the second-order Levenberg-Marquardt optimization method. Several other interpretability issues about the fuzzy neural model are also discussed and integrated into this new learning approach. Numerical examples are presented to illustrate the resultant structure of the fuzzy neural models and the effectiveness of the proposed new algorithm, and compared with the results from some well-known methods.

Fast-electron self-collimation in a plasma density gradient

A theoretical and numerical study of fast electron transport in solid and compressed fast ignition relevant targets is presented. The principal aim of the study is to assess how localized increases in the target density (e. g., by engineering of the density profile) can enhance magnetic field generation and thus pinching of the fast electron beam through reducing the rate of temperature rise. The extent to which this might benefit fast ignition is discussed. (C) 2012 American Institute of Physics. [http://dx.doi.org/10.1063/1.4729322]

Efficient differentiation into skin cells of bone marrow cells recovered in a pellet after density gradient fractionation

We had previously demonstrated the participation of whole bone marrow cells from adult mice in the reconstitution of skin, including the epidermis and hair follicles. To get an insight into cell populations that give rise to the epithelial components of the reconstituted skin, we fractionated bone marrow cells derived from green fluorescent protein-transgenic mice by density gradient. Unexpectedly, we found that a substantial amount of mononucleated cells (approximately 30%) was recovered in the pellet fraction and that the cells in the pellet fraction preferentially differentiated into epithelial components of skin, rather than the cells in the mononuclear cell fraction. The pellet fraction contained more CD45-negative (thus uncommitted to the hematopoietic cell lineage) cells than the mononuclear cell fraction. These results indicate that density gradient fractionation results in significant loss of specific progenitor cells into the usually discarded pellet fraction.

Improved description of chemical barriers with generalized gradient approximations (GGAs) and meta-GGAs

The performance of exchange and correlation (xc) functionals of the generalized gradient approximation (GGA) type and of the meta-GGA type in the calculation of chemical reactions is related to topological features of the electron density which, in turn, are connected to the orbital structure of chemical bonds within the Kohn-Sham (KS) theory. Seventeen GGA and meta-GGA xc functionals are assessed for 15 hydrogen abstraction reactions and 3 symmetrical S(N)2 reactions. Systems that are problematic for standard GGAs characteristically have enhanced values of the dimensionless gradient argument s(sigma)(2) with local maxima in the bonding region. The origin of this topological feature is the occupation of valence KS orbitals with an antibonding or essentially nonbonding character. The local enhancement of s(sigma)(2) yields too negative exchange-correlation energies with standard GGAs for the transition state of the S(N)2 reaction, which leads to the reduced calculated reaction barriers. The unwarranted localization of the effective xc hole of the standard GGAs, i.e., the nondynamical correlation that is built into them but is spurious in this case, wields its effect by their s(sigma)(2) dependence. Barriers are improved for xc functionals with the exchange functional OPTX as x component, which has a modified dependence on s(sigma)(2). Standard GGAs also underestimate the barriers for the hydrogen abstraction reactions. In this case the barriers are improved by correlation functionals, such as the Laplacian-dependent (LAP3) functional, which has a modified dependence on the Coulomb correlation of the opposite- and like-spin electrons. The best overall performance is established for the combination OLAP3 of OPTX and LAP3.

On the required shape corrections to the local density and generalized gradient approximations to the Kohn-Sham potentials for molecular response calculations of (hyper)polarizabilities and excitation energies

It is well known that shape corrections have to be applied to the local-density (LDA) and generalized gradient (GGA) approximations to the Kohn-Sham exchange-correlation potential in order to obtain reliable response properties in time dependent density functional theory calculations. Here we demonstrate that it is an oversimplified view that these shape corrections concern primarily the asymptotic part of the potential, and that they affect only Rydberg type transitions. The performance is assessed of two shape-corrected Kohn-Sham potentials, the gradient-regulated asymptotic connection procedure applied to the Becke-Perdew potential (BP-GRAC) and the statistical averaging of (model) orbital potentials (SAOP), versus LDA and GGA potentials, in molecular response calculations of the static average polarizability alpha, the Cauchy coefficient S-4, and the static average hyperpolarizability beta. The nature of the distortions of the LDA/GGA potentials is highlighted and it is shown that they introduce many spurious excited states at too low energy which may mix with valence excited states, resulting in wrong excited state compositions. They also lead to wrong oscillator strengths and thus to a wrong spectral structure of properties like the polarizability. LDA, Becke-Lee-Yang-Parr (BLYP), and Becke-Perdew (BP) characteristically underestimate contributions to alpha and S-4 from bound Rydberg-type states and overestimate those from the continuum. Cancellation of the errors in these contributions occasionally produces fortuitously good results. The distortions of the LDA, BLYP, and BP spectra are related to the deficiencies of the LDA/GGA potentials in both the bulk and outer molecular regions. In contrast, both SAOP and BP-GRAC potentials produce high quality polarizabilities for 21 molecules and also reliable Cauchy moments and hyperpolarizabilities for the selected molecules. The analysis for the N-2 molecule shows, that both SAOP and BP-GRAC yield reliable energies omega(i) and oscillator strengths f(i) of individual excitations, so that they reproduce well the spectral structure of alpha and S-4.(C) 2002 American Institute of Physics.

The failure of generalized gradient approximations (GGAs) and meta-GGAs for the two-center three-electron bonds in He-2(+), (H2O)(2)(+), and (NH3)(2)(+)

The radical cations He-2(+) (H2O)(2)(+), and (NH3)(2)(+) with two-center three-electron A-A bonds are investigated at the configuration interaction (CI), accurate Kohn-Sham (KS), generalized gradient approximation (GGA), and meta-GGA levels. Assessment of seven different GGA and six meta-GGA methods shows that the A(2)(+) systems remain a difficult case for density functional theory (DFT). All methods tested consistently overestimate the stability of A(2)(+): the corresponding D-e errors decrease for more diffuse valence densities in the series He-2(+) > (H2O)(2)(+) > (NH3)(2)(+). Upon comparison to the energy terms of the accurate Kohn-Sham solutions, the approximate exchange functionals are found to be responsible for the errors of GGA-type methods, which characteristically overestimate the exchange in A(2)(+). These so-called exchange functionals implicitly use localized holes. Such localized holes do occur if there is left-right correlation, i.e., the exchange functionals then also describe nondynamical correlation. However, in the hemibonded A(2)(+) systems the typical molecular (left-right, nondynamical) correlation of the two-electron pair bond is absent. The nondynamical correlation built into the exchange functionals is then spurious and yields too low energies.

Shape corrections to exchange-correlation potentials by gradient-regulated seamless connection of model potentials for inner and outer region

Shape corrections to the standard approximate Kohn-Sham exchange-correlation (xc) potentials are considered with the aim to improve the excitation energies (especially for higher excitations) calculated with time-dependent density functional perturbation theory. A scheme of gradient-regulated connection (GRAC) of inner to outer parts of a model potential is developed. Asymptotic corrections based either on the potential of Fermi and Amaldi or van Leeuwen and Baerends (LB) are seamlessly connected to the (shifted) xc potential of Becke and Perdew (BP) with the GRAC procedure, and are employed to calculate the vertical excitation energies of the prototype molecules N-2, CO, CH2O, C2H4, C5NH5, C6H6, Li-2, Na-2, K-2. The results are compared with those of the alternative interpolation scheme of Tozer and Handy as well as with the results of the potential obtained with the statistical averaging of (model) orbital potentials. Various asymptotically corrected potentials produce high quality excitation energies, which in quite a few cases approach the benchmark accuracy of 0.1 eV for the electronic spectra. Based on these results, the potential BP-GRAC-LB is proposed for molecular response calculations, which is a smooth potential and a genuine "local" density functional with an analytical representation. (C) 2001 American Institute of Physics.

Identifying appropriate sampling and modelling approaches for analysing distributional patterns of Antarctic terrestrial arthropods along the Victoria Land latitudinal gradient

Biotic communities in Antarctic terrestrial ecosystems are relatively simple and often lack higher trophic levels (e. g. predators); thus, it is often assumed that species' distributions are mainly affected by abiotic factors such as climatic conditions, which change with increasing latitude, altitude and/or distance from the coast. However, it is becoming increasingly apparent that factors other than geographical gradients affect the distribution of organisms with low dispersal capability such as the terrestrial arthropods. In Victoria Land (East Antarctica) the distribution of springtail (Collembola) and mite (Acari) species vary at scales that range from a few square centimetres to regional and continental. Different species show different scales of variation that relate to factors such as local geological and glaciological history, and biotic interactions, but only weakly with latitudinal/altitudinal gradients. Here, we review the relevant literature and outline more appropriate sampling designs as well as suitable modelling techniques (e. g. linear mixed models and eigenvector mapping), that will more adequately address and identify the range of factors responsible for the distribution of terrestrial arthropods in Antarctica.

Inorganic species of arsenic in soil solution determined by microcartridges and ferrihydrite-based diffusive gradient in thin films

The bioavailability of soil arsenic (As) is determined by its speciation in soil solution, i.e., arsenite [As(III)] or arsenate [As(V)]. Soil bioavailability studies require suitable methods to cope with small volumes of soil solution that can be speciated directly after sampling, and thereby minimise any As speciation change during sample collection. In this study, we tested a self-made microcartridge to separate both As species and compared it to a commercially available cartridge. In addition, the diffusive gradient in thin films technique (DGT), in combination with the microcartridges, was applied to synthetic solutions and to a soil spiked with As. This combination was used to improve the assessment of available inorganic As species with ferrihydrite(FH)-DGT, in order to validate the technique for environmental analysis, mainly in soils. The self-made microcartridge was effective in separating As(III) from As(V) in solution with detection by inductively coupled plasma optical emission spectrometry (ICP-OES) in volumes of only 3 ml. The DGT study also showed that the FH-based binding gels are effective for As(III) and As(V) assessment, in solutions with As and P concentrations and ionic strength commonly found in soils. The FH-DGT was tested on flooded and unflooded As spiked soils and recoveries of As(III) and As(V) were 85–104% of the total dissolved As. This study shows that the DGT with FH-based binding gel is robust for assessing inorganic species of As in soils.

Mean shift based gradient vector flow for image segmentation

In recent years, gradient vector flow (GVF) based algorithms have been successfully used to segment a variety of 2-D and 3-D imagery. However, due to the compromise of internal and external energy forces within the resulting partial differential equations, these methods may lead to biased segmentation results. In this paper, we propose MSGVF, a mean shift based GVF segmentation algorithm that can successfully locate the correct borders. MSGVF is developed so that when the contour reaches equilibrium, the various forces resulting from the different energy terms are balanced. In addition, the smoothness constraint of image pixels is kept so that over- or under-segmentation can be reduced. Experimental results on publicly accessible datasets of dermoscopic and optic disc images demonstrate that the proposed method effectively detects the borders of the objects of interest.

Graded/Gradient Porous Biomaterials

Biomaterials include bioceramics, biometals, biopolymers and biocomposites and they play important roles in the replacement and regeneration of human tissues. However, dense bioceramics and dense biometals pose the problem of stress shielding due to their high Young's moduli compared to those of bones. On the other hand, porous biomaterials exhibit the potential of bone ingrowth, which will depend on porous parameters such as pore size, pore interconnectivity, and porosity. Unfortunately, a highly porous biomaterial results in poor mechanical properties. To optimise the mechanical and the biological properties, porous biomaterials with graded/gradient porosity, pores size, and/or composition have been developed. Graded/gradient porous biomaterials have many advantages over graded/gradient dense biomaterials and uniform or homogenous porous biomaterials. The internal pore surfaces of graded/gradient porous biomaterials can be modified with organic, inorganic, or biological coatings and the internal pores themselves can also be filled with biocompatible and biodegradable materials or living cells. However, graded/gradient porous biomaterials are generally more difficult to fabricate than uniform or homogenous porous biomaterials. With the development of cost-effective processing techniques, graded/gradient porous biomaterials can find wide applications in bone defect filling, implant fixation, bone replacement, drug delivery, and tissue engineering.