Combining meta-learning and search techniques to select parameters for support vector machines

Support Vector Machines (SVMs) have achieved very good performance on different learning problems. However, the success of SVMs depends on the adequate choice of the values of a number of parameters (e.g., the kernel and regularization parameters). In the current work, we propose the combination of meta-learning and search algorithms to deal with the problem of SVM parameter selection. In this combination, given a new problem to be solved, meta-learning is employed to recommend SVM parameter values based on parameter configurations that have been successfully adopted in previous similar problems. The parameter values returned by meta-learning are then used as initial search points by a search technique, which will further explore the parameter space. In this proposal, we envisioned that the initial solutions provided by meta-learning are located in good regions of the search space (i.e. they are closer to optimum solutions). Hence, the search algorithm would need to evaluate a lower number of candidate solutions when looking for an adequate solution. In this work, we investigate the combination of meta-learning with two search algorithms: Particle Swarm Optimization and Tabu Search. The implemented hybrid algorithms were used to select the values of two SVM parameters in the regression domain. These combinations were compared with the use of the search algorithms without meta-learning. The experimental results on a set of 40 regression problems showed that, on average, the proposed hybrid methods obtained lower error rates when compared to their components applied in isolation.

STOCHASTIC MODEL FOR SIMULATING MAIZE YIELD

Maize is one of the most important crops in the world. The products generated from this crop are largely used in the starch industry, the animal and human nutrition sector, and biomass energy production and refineries. For these reasons, there is much interest in figuring the potential grain yield of maize genotypes in relation to the environment in which they will be grown, as the productivity directly affects agribusiness or farm profitability. Questions like these can be investigated with ecophysiological crop models, which can be organized according to different philosophies and structures. The main objective of this work is to conceptualize a stochastic model for predicting maize grain yield and productivity under different conditions of water supply while considering the uncertainties of daily climate data. Therefore, one focus is to explain the model construction in detail, and the other is to present some results in light of the philosophy adopted. A deterministic model was built as the basis for the stochastic model. The former performed well in terms of the curve shape of the above-ground dry matter over time as well as the grain yield under full and moderate water deficit conditions. Through the use of a triangular distribution for the harvest index and a bivariate normal distribution of the averaged daily solar radiation and air temperature, the stochastic model satisfactorily simulated grain productivity, i.e., it was found that 10,604 kg ha(-1) is the most likely grain productivity, very similar to the productivity simulated by the deterministic model and for the real conditions based on a field experiment.

Reforming of a model biogas on Ni and Rh-Ni catalysts: Effect of adding La

Ni catalysts supported on gamma-Al2O3 modified by Rh and La were prepared and evaluated on the reforming of a model biogas. The catalysts were characterized by EDS, XRD, TPR, XANES and surface area estimation (BET). The results showed that in the original Ni catalyst, the Ni interacted strongly with the alumina support, exhibiting high reduction temperatures in TPR tests. In the catalytic tests, the addition of Rh on Ni catalysts improved CH4 conversion but also increased carbon deposition, possible by causing the segregation of Ni species under the reaction conditions. The presence of La on Ni catalysts reduced the carbon deposition by favoring the gasification of carbon species. Addition of synthetic air to the process improved the CH4 conversion and also decreased the carbon formation. The catalysts Ni, Rh-NiLa, and Rh showed good results in the conversion of model sulfur-free biogas, which suggests that they are promising catalysts to be tested in conversion of real biogas. (C) 2012 Elsevier B.V. All rights reserved.

Stochastic competitive learning in complex networks

Competitive learning is an important machine learning approach which is widely employed in artificial neural networks. In this paper, we present a rigorous definition of a new type of competitive learning scheme realized on large-scale networks. The model consists of several particles walking within the network and competing with each other to occupy as many nodes as possible, while attempting to reject intruder particles. The particle's walking rule is composed of a stochastic combination of random and preferential movements. The model has been applied to solve community detection and data clustering problems. Computer simulations reveal that the proposed technique presents high precision of community and cluster detections, as well as low computational complexity. Moreover, we have developed an efficient method for estimating the most likely number of clusters by using an evaluator index that monitors the information generated by the competition process itself. We hope this paper will provide an alternative way to the study of competitive learning.

A Chaotic Approach of Differential Evolution Optimization Applied to Loudspeaker Design Problem

Over the past few years, the field of global optimization has been very active, producing different kinds of deterministic and stochastic algorithms for optimization in the continuous domain. These days, the use of evolutionary algorithms (EAs) to solve optimization problems is a common practice due to their competitive performance on complex search spaces. EAs are well known for their ability to deal with nonlinear and complex optimization problems. Differential evolution (DE) algorithms are a family of evolutionary optimization techniques that use a rather greedy and less stochastic approach to problem solving, when compared to classical evolutionary algorithms. The main idea is to construct, at each generation, for each element of the population a mutant vector, which is constructed through a specific mutation operation based on adding differences between randomly selected elements of the population to another element. Due to its simple implementation, minimum mathematical processing and good optimization capability, DE has attracted attention. This paper proposes a new approach to solve electromagnetic design problems that combines the DE algorithm with a generator of chaos sequences. This approach is tested on the design of a loudspeaker model with 17 degrees of freedom, for showing its applicability to electromagnetic problems. The results show that the DE algorithm with chaotic sequences presents better, or at least similar, results when compared to the standard DE algorithm and other evolutionary algorithms available in the literature.

Stochastic gravito-inertial modes discovered by CoRoT in the hot Be star HD51452

Context. Be stars are rapidly rotating stars with a circumstellar decretion disk. They usually undergo pressure and/or gravity pulsation modes excited by the kappa-mechanism, i.e. an effect of the opacity of iron-peak elements in the envelope of the star. In the Milky Way, p-modes are observed in stars that are hotter than or equal to the B3 spectral type, while g-modes are observed at the B2 spectral type and cooler. Aims. We observed a B0IVe star, HD51452, with the high-precision, high-cadence photometric CoRoT satellite and high-resolution, ground-based HARPS and SOPHIE spectrographs to study its pulsations in great detail. We also used the lower resolution spectra available in the BeSS database. Methods. We analyzed the CoRoT and spectroscopic data with several methods: CLEAN-NG, FREQFIND, and a sliding window method. We also analyzed spectral quantities, such as the violet over red (V/R) emission variations, to obtain information about the variation in the circumstellar environment. We calculated a stellar structure model with the ESTER code to test the various interpretation of the results. Results. We detect 189 frequencies of variations in the CoRoT light curve in the range between 0 and 4.5 c d(-1). The main frequencies are also recovered in the spectroscopic data. In particular we find that HD51452 undergoes gravito-inertial modes that are not in the domain of those excited by the kappa-mechanism. We propose that these are stochastic modes excited in the convective zones and that at least some of them are a multiplet of r-modes (i.e. subinertial modes mainly driven by the Coriolis acceleration). Stochastically excited gravito-inertial modes had never been observed in any star, and theory predicted that their very low amplitudes would be undetectable even with CoRoT. We suggest that the amplitudes are enhanced in HD51452 because of the very rapid stellar rotation. In addition, we find that the amplitude variations of these modes are related to the occurrence of minor outbursts. Conclusions. Thanks to CoRoT data, we have detected a new kind of pulsations in HD51452, which are stochastically excited gravito-inertial modes, probably due to its very rapid rotation. These modes are probably also present in other rapidly rotating hot Be stars.

Network-based stochastic semisupervised learning

Semisupervised learning is a machine learning approach that is able to employ both labeled and unlabeled samples in the training process. In this paper, we propose a semisupervised data classification model based on a combined random-preferential walk of particles in a network (graph) constructed from the input dataset. The particles of the same class cooperate among themselves, while the particles of different classes compete with each other to propagate class labels to the whole network. A rigorous model definition is provided via a nonlinear stochastic dynamical system and a mathematical analysis of its behavior is carried out. A numerical validation presented in this paper confirms the theoretical predictions. An interesting feature brought by the competitive-cooperative mechanism is that the proposed model can achieve good classification rates while exhibiting low computational complexity order in comparison to other network-based semisupervised algorithms. Computer simulations conducted on synthetic and real-world datasets reveal the effectiveness of the model.

PERFORMANCE EVALUATION OF RESOURCE-AWARE BUSINESS PROCESSES USING STOCHASTIC AUTOMATA NETWORKS

In this work, we study the performance evaluation of resource-aware business process models. We define a new framework that allows the generation of analytical models for performance evaluation from business process models annotated with resource management information. This framework is composed of a new notation that allows the specification of resource management constraints and a method to convert a business process specification and its resource constraints into Stochastic Automata Networks (SANs). We show that the analysis of the generated SAN model provides several performance indices, such as average throughput of the system, average waiting time, average queues size, and utilization rate of resources. Using the BP2SAN tool - our implementation of the proposed framework - and a SAN solver (such as the PEPS tool) we show through a simple use-case how a business specialist with no skills in stochastic modeling can easily obtain performance indices that, in turn, can help to identify bottlenecks on the model, to perform workload characterization, to define the provisioning of resources, and to study other performance related aspects of the business process.

Particle Acceleration in Turbulence and Weakly Stochastic Reconnection

In this Letter we analyze the energy distribution evolution of test particles injected in three dimensional (3D) magnetohydrodynamic (MHD) simulations of different magnetic reconnection configurations. When considering a single Sweet-Parker topology, the particles accelerate predominantly through a first-order Fermi process, as predicted in [3] and demonstrated numerically in [8]. When turbulence is included within the current sheet, the acceleration rate is highly enhanced, because reconnection becomes fast and independent of resistivity [4,11] and allows the formation of a thick volume filled with multiple simultaneously reconnecting magnetic fluxes. Charged particles trapped within this volume suffer several head-on scatterings with the contracting magnetic fluctuations, which significantly increase the acceleration rate and results in a first-order Fermi process. For comparison, we also tested acceleration in MHD turbulence, where particles suffer collisions with approaching and receding magnetic irregularities, resulting in a reduced acceleration rate. We argue that the dominant acceleration mechanism approaches a second order Fermi process in this case.

Strategy and model building in the fourth dimension: a null model for genotype × age interaction as a Gaussian stationary stochastic process

Abstract Background Using univariate and multivariate variance components linkage analysis methods, we studied possible genotype × age interaction in cardiovascular phenotypes related to the aging process from the Framingham Heart Study. Results We found evidence for genotype × age interaction for fasting glucose and systolic blood pressure. Conclusions There is polygenic genotype × age interaction for fasting glucose and systolic blood pressure and quantitative trait locus × age interaction for a linkage signal for systolic blood pressure phenotypes located on chromosome 17 at 67 cM.

Effect of parametric uncertainties on the performance of a piezoelectric energy harvesting device

The use of piezoelectric materials for the development of electromechanical devices for the harvesting or scavenging of ambient vibrations has been extensively studied over the last decade. The energy conversion from mechanical (vibratory) to electrical energy is provided by the electromechanical coupling between mechanical strains/stresses and electric charges/voltages in the piezoelectric material. The majority of the studies found in the open literature present a tip-mass cantilever piezoelectric device tuned on the operating frequency. Although recent results show that these devices can be quite effective for harvesting small amounts of electrical energy, little has been published on the robustness of these devices or on the effect of parametric uncertainties on the energy harvested. This work focuses on a cantilever plate with bonded piezoelectric patches and a tip-mass serving as an energy harvesting device. The rectifier and storage electric circuit was replaced by a resistive circuit (R). In addition, an alternative to improve the harvesting performance by adding an inductance in series to the harvesting circuit, thus leading to a resonant circuit (RL), is considered. A coupled finite element model leading to mechanical (displacements) and electrical (charges at electrodes) degrees of freedom is considered. An analysis of the effect of parametric uncertainties of the device on the electric output is performed. Piezoelectric and dielectric constants of the piezoelectric active layers and electric circuit equivalent inductance are considered as stochastic parameters. Mean and confidence intervals of the electric output are evaluated.

Stochastic lattice model describing a vector-borne disease

We employ the approach of stochastic dynamics to describe the dissemination of vector-borne diseases such as dengue, and we focus our attention on the characterization of the threshold of the epidemic. The coexistence space comprises two representative spatial structures for both human and mosquito populations. The human population has its evolution described by a process that is similar to the Susceptible-Infected-Recovered (SIR) dynamics. The population of mosquitoes follows a dynamic of the type of the Susceptible Infected-Susceptible (SIS) model. The coexistence space is a bipartite lattice constituted by two structures representing the human and mosquito populations. We develop a truncation scheme to solve the evolution equations for the densities and the two-site correlations from which we get the threshold of the disease and the reproductive ratio. We present a precise deØnition of the reproductive ratio which reveals the importance of the correlations developed in the early stage of the disease. According to our deØnition, the reproductive rate is directed related to the conditional probability of the occurrence of a susceptible human (mosquito) given the presence in the neighborhood of an infected mosquito (human). The threshold of the epidemic as well as the phase transition between the epidemic and the non-epidemic states are also obtained by performing Monte Carlo simulations. References: [1] David R. de Souza, T^ania Tom∂e, , Suani R. T. Pinho, Florisneide R. Barreto and M∂ario J. de Oliveira, Phys. Rev. E 87, 012709 (2013). [2] D. R. de Souza, T. Tom∂e and R. M. ZiÆ, J. Stat. Mech. P03006 (2011).

A stochastic spatially structured epidemic model with diffusive processes

We developed a stochastic lattice model to describe the vector-borne disease (like yellow fever or dengue). The model is spatially structured and its dynamical rules take into account the diffusion of vectors. We consider a bipartite lattice, forming a sub-lattice of human and another occupied by mosquitoes. At each site of lattice we associate a stochastic variable that describes the occupation and the health state of a single individual (mosquito or human). The process of disease transmission in the human population follows a similar dynamic of the Susceptible-Infected-Recovered model (SIR), while the disease transmission in the mosquito population has an analogous dynamic of the Susceptible-Infected-Susceptible model (SIS) with mosquitos diffusion. The occurrence of an epidemic is directly related to the conditional probability of occurrence of infected mosquitoes (human) in the presence of susceptible human (mosquitoes) on neighborhood. The probability of diffusion of mosquitoes can facilitate the formation of pairs Susceptible-Infected enabling an increase in the size of the epidemic. Using an asynchronous dynamic update, we study the disease transmission in a population initially formed by susceptible individuals due to the introduction of a single mosquito (human) infected. We find that this model exhibits a continuous phase transition related to the existence or non-existence of an epidemic. By means of mean field approximations and Monte Carlo simulations we investigate the epidemic threshold and the phase diagram in terms of the diffusion probability and the infection probability.

Stochastic quantization of the spherical model and supersymmetry.

In this work, we reported some results about the stochastic quantization of the spherical model. We started by reviewing some basic aspects of this method with emphasis in the connection between the Langevin equation and the supersymmetric quantum mechanics, aiming at the application of the corresponding connection to the spherical model. An intuitive idea is that when applied to the spherical model this gives rise to a supersymmetric version that is identified with one studied in Phys. Rev. E 85, 061109, (2012). Before investigating in detail this aspect, we studied the stochastic quantization of the mean spherical model that is simpler to implement than the one with the strict constraint. We also highlight some points concerning more traditional methods discussed in the literature like canonical and path integral quantization. To produce a supersymmetric version, grounded in the Nicolai map, we investigated the stochastic quantization of the strict spherical model. We showed in fact that the result of this process is an off-shell supersymmetric extension of the quantum spherical model (with the precise supersymmetric constraint structure). That analysis establishes a connection between the classical model and its supersymmetric quantum counterpart. The supersymmetric version in this way constructed is a more natural one and gives further support and motivations to investigate similar connections in other models of the literature.

Stochastic gravito-inertial modes discovered by CoRoT in the hot Be star HD51452

Context. Be stars are rapidly rotating stars with a circumstellar decretion disk. They usually undergo pressure and/or gravity pulsation modes excited by the κ-mechanism, i.e. an effect of the opacity of iron-peak elements in the envelope of the star. In the Milky Way, p-modes are observed in stars that are hotter than or equal to the B3 spectral type, while g-modes are observed at the B2 spectral type and cooler. Aims. We observed a B0IVe star, HD51452, with the high-precision, high-cadence photometric CoRoT satellite and high-resolution, ground-based HARPS and SOPHIE spectrographs to study its pulsations in great detail. We also used the lower resolution spectra available in the BeSS database. Methods. We analyzed the CoRoT and spectroscopic data with several methods: Clean-NG, FreqFind, and a sliding window method. We also analyzed spectral quantities, such as the violet over red (V/R) emission variations, to obtain information about the variation in the circumstellar environment. We calculated a stellar structure model with the ESTER code to test the various interpretation of the results. Results. We detect 189 frequencies of variations in the CoRoT light curve in the range between 0 and 4.5 c d−1. The main frequencies are also recovered in the spectroscopic data. In particular we find that HD51452 undergoes gravito-inertial modes that are not in the domain of those excited by the κ-mechanism. We propose that these are stochastic modes excited in the convective zones and that at least some of them are a multiplet of r-modes (i.e. subinertial modes mainly driven by the Coriolis acceleration). Stochastically excited gravito-inertial modes had never been observed in any star, and theory predicted that their very low amplitudes would be undetectable even with CoRoT. We suggest that the amplitudes are enhanced in HD51452 because of the very rapid stellar rotation. In addition, we find that the amplitude variations of these modes are related to the occurrence of minor outbursts. Conclusions. Thanks to CoRoT data, we have detected a new kind of pulsations in HD51452, which are stochastically excited gravito-inertial modes, probably due to its very rapid rotation. These modes are probably also present in other rapidly rotating hot Be stars.