Regularized logistic regression and multi-objective variable selection for classifying MEG data

This paper addresses the question of maximizing classifier accuracy for classifying task-related mental activity from Magnetoencelophalography (MEG) data. We propose the use of different sources of information and introduce an automatic channel selection procedure. To determine an informative set of channels, our approach combines a variety of machine learning algorithms: feature subset selection methods, classifiers based on regularized logistic regression, information fusion, and multiobjective optimization based on probabilistic modeling of the search space. The experimental results show that our proposal is able to improve classification accuracy compared to approaches whose classifiers use only one type of MEG information or for which the set of channels is fixed a priori.

Simulation tools for statistical model comparison: an application to unobserved componenet models versus dynamic regression models

Aplicación de simulación de Monte Carlo y técnicas de Análisis de la Varianza (ANOVA) a la comparación de modelos estocásticos dinámicos para accidentes de tráfico.

Robust regression applied to fractal/multifractal analysis.

Fractal and multifractal are concepts that have grown increasingly popular in recent years in the soil analysis, along with the development of fractal models. One of the common steps is to calculate the slope of a linear fit commonly using least squares method. This shouldn?t be a special problem, however, in many situations using experimental data the researcher has to select the range of scales at which is going to work neglecting the rest of points to achieve the best linearity that in this type of analysis is necessary. Robust regression is a form of regression analysis designed to circumvent some limitations of traditional parametric and non-parametric methods. In this method we don?t have to assume that the outlier point is simply an extreme observation drawn from the tail of a normal distribution not compromising the validity of the regression results. In this work we have evaluated the capacity of robust regression to select the points in the experimental data used trying to avoid subjective choices. Based on this analysis we have developed a new work methodology that implies two basic steps: ? Evaluation of the improvement of linear fitting when consecutive points are eliminated based on R pvalue. In this way we consider the implications of reducing the number of points. ? Evaluation of the significance of slope difference between fitting with the two extremes points and fitted with the available points. We compare the results applying this methodology and the common used least squares one. The data selected for these comparisons are coming from experimental soil roughness transect and simulated based on middle point displacement method adding tendencies and noise. The results are discussed indicating the advantages and disadvantages of each methodology.

Regression analysis of top of descent location for idle-thrust descents

In this paper, multiple regression analysis is used to model the top of descent (TOD) location of user-preferred descent trajectories computed by the flight management system (FMS) on over 1000 commercial flights into Melbourne, Australia. In addition to recording TOD, the cruise altitude, final altitude, cruise Mach, descent speed, wind, and engine type were also identified for use as the independent variables in the regression analysis. Both first-order and second-order models are considered, where cross-validation, hypothesis testing, and additional analysis are used to compare models. This identifies the models that should give the smallest errors if used to predict TOD location for new data in the future. A model that is linear in TOD altitude, final altitude, descent speed, and wind gives an estimated standard deviation of 3.9 nmi for TOD location given the trajectory parame- ters, which means about 80% of predictions would have error less than 5 nmi in absolute value. This accuracy is better than demonstrated by other ground automation predictions using kinetic models. Furthermore, this approach would enable online learning of the model. Additional data or further knowledge of algorithms is necessary to conclude definitively that no second-order terms are appropriate. Possible applications of the linear model are described, including enabling arriving aircraft to fly optimized descents computed by the FMS even in congested airspace.

Regression models with MoPs Bayesian networks

We present a model of Bayesian network for continuous variables, where densities and conditional densities are estimated with B-spline MoPs. We use a novel approach to directly obtain conditional densities estimation using B-spline properties. In particular we implement naive Bayes and wrapper variables selection. Finally we apply our techniques to the problem of predicting neurons morphological variables from electrophysiological ones.

Enhancing regression models for complex systems using evolutionary techniques for feature engineering

This work proposes an automatic methodology for modeling complex systems. Our methodology is based on the combination of Grammatical Evolution and classical regression to obtain an optimal set of features that take part of a linear and convex model. This technique provides both Feature Engineering and Symbolic Regression in order to infer accurate models with no effort or designer's expertise requirements. As advanced Cloud services are becoming mainstream, the contribution of data centers in the overall power consumption of modern cities is growing dramatically. These facilities consume from 10 to 100 times more power per square foot than typical office buildings. Modeling the power consumption for these infrastructures is crucial to anticipate the effects of aggressive optimization policies, but accurate and fast power modeling is a complex challenge for high-end servers not yet satisfied by analytical approaches. For this case study, our methodology minimizes error in power prediction. This work has been tested using real Cloud applications resulting on an average error in power estimation of 3.98%. Our work improves the possibilities of deriving Cloud energy efficient policies in Cloud data centers being applicable to other computing environments with similar characteristics.

System failure prediction through rare-events elastic-net logistic regression

Predicting failures in a distributed system based on previous events through logistic regression is a standard approach in literature. This technique is not reliable, though, in two situations: in the prediction of rare events, which do not appear in enough proportion for the algorithm to capture, and in environments where there are too many variables, as logistic regression tends to overfit on this situations; while manually selecting a subset of variables to create the model is error- prone. On this paper, we solve an industrial research case that presented this situation with a combination of elastic net logistic regression, a method that allows us to automatically select useful variables, a process of cross-validation on top of it and the application of a rare events prediction technique to reduce computation time. This process provides two layers of cross- validation that automatically obtain the optimal model complexity and the optimal mode l parameters values, while ensuring even rare events will be correctly predicted with a low amount of training instances. We tested this method against real industrial data, obtaining a total of 60 out of 80 possible models with a 90% average model accuracy.

Polynomial regression using a perceptron with axo-axonic connections

Social behavior is mainly based on swarm colonies, in which each individual shares its knowledge about the environment with other individuals to get optimal solutions. Such co-operative model differs from competitive models in the way that individuals die and are born by combining information of alive ones. This paper presents the particle swarm optimization with differential evolution algorithm in order to train a neural network instead the classic back propagation algorithm. The performance of a neural network for particular problems is critically dependant on the choice of the processing elements, the net architecture and the learning algorithm. This work is focused in the development of methods for the evolutionary design of artificial neural networks. This paper focuses in optimizing the topology and structure of connectivity for these networks

Age regression from soft aligned face images using low computational resources

The initial step in most facial age estimation systems consists of accurately aligning a model to the output of a face detector (e.g. an Active Appearance Model). This fitting process is very expensive in terms of computational resources and prone to get stuck in local minima. This makes it impractical for analysing faces in resource limited computing devices. In this paper we build a face age regressor that is able to work directly on faces cropped using a state-of-the-art face detector. Our procedure uses K nearest neighbours (K-NN) regression with a metric based on a properly tuned Fisher Linear Discriminant Analysis (LDA) projection matrix. On FG-NET we achieve a state-of-the-art Mean Absolute Error (MAE) of 5.72 years with manually aligned faces. Using face images cropped by a face detector we get a MAE of 6.87 years in the same database. Moreover, most of the algorithms presented in the literature have been evaluated on single database experiments and therefore, they report optimistically biased results. In our cross-database experiments we get a MAE of roughly 12 years, which would be the expected performance in a real world application.

Conditional switching of vascular endothelial growth factor (VEGF) expression in tumors: Induction of endothelial cell shedding and regression of hemangioblastoma-like vessels by VEGF withdrawal

We have recently shown that VEGF functions as a survival factor for newly formed vessels during developmental neovascularization, but is not required for maintenance of mature vessels. Reasoning that expanding tumors contain a significant fraction of newly formed and remodeling vessels, we examined whether abrupt withdrawal of VEGF will result in regression of preformed tumor vessels. Using a tetracycline-regulated VEGF expression system in xenografted C6 glioma cells, we showed that shutting off VEGF production leads to detachment of endothelial cells from the walls of preformed vessels and their subsequent death by apoptosis. Vascular collapse then leads to hemorrhages and extensive tumor necrosis. These results suggest that enforced withdrawal of vascular survival factors can be applied to target preformed tumor vasculature in established tumors. The system was also used to examine phenotypes resulting from over-expression of VEGF. When expression of the transfected VEGF cDNA was continuously “on,” tumors became hyper-vascularized with abnormally large vessels, presumably arising from excessive fusions. Tumors were significantly less necrotic, suggesting that necrosis in these tumors is the result of insufficient angiogenesis.

Interleukin 12 and B7-1 costimulatory molecule expressed by an adenovirus vector act synergistically to facilitate tumor regression

Stimulation of antitumor immune mechanisms is the primary goal of cancer immunotherapy, and accumulating evidence suggests that effective alteration of the host–tumor relationship involves immunomodulating cytokines and also the presence of costimulatory molecules. To examine the antitumor effect of direct in vivo gene transfer of murine interleukin 12 (IL-12) and B7-1 into tumors, we developed an adenovirus (Ad) vector, AdIL12–B7-1, that encodes the two IL-12 subunits in early region 1 (E1) and the B7-1 gene in E3 under control of the murine cytomegalovirus promoter. This vector expressed high levels of IL-12 and B7-1 in infected murine and human cell lines and in primary murine tumor cells. In mice bearing tumors derived from a transgenic mouse mammary adenocarcinoma, a single intratumoral injection with a low dose (2.5 × 107 pfu/mouse) of AdIL12–B7-1 mediated complete regression in 70% of treated animals. By contrast, administration of a similar dose of recombinant virus encoding IL-12 or B7-1 alone resulted in only a delay in tumor growth. Interestingly, coinjection of two different viruses expressing either IL-12 or B7-1 induced complete tumor regression in only 30% of animals treated at this dose. Significantly, cured animals remained tumor free after rechallenge with fresh tumor cells, suggesting that protective immunity had been induced by treatment with AdIL12–B7-1. These results support the use of Ad vectors as a highly efficient delivery system for synergistically acting molecules and show that the combination of IL-12 and B7-1 within a single Ad vector might be a promising approach for in vivo cancer therapy.

Interferon-β gene therapy inhibits tumor formation and causes regression of established tumors in immune-deficient mice

Despite the potential of type 1 interferons (IFNs) for the treatment of cancer, clinical experience with IFN protein therapy of solid tumors has been disappointing. IFN-β has potent antiproliferative activity against most human tumor cells in vitro in addition to its known immunomodulatory activities. The antiproliferative effect, however, relies on IFN-β concentrations that cannot be achieved by parenteral protein administration because of rapid protein clearance and systemic toxicities. We demonstrate here that ex vivo IFN-β gene transduction by a replication-defective adenovirus in as few as 1% of implanted cells blocked tumor formation. Direct in vivo IFN-β gene delivery into established tumors generated high local concentrations of IFN-β, inhibited tumor growth, and in many cases caused complete tumor regression. Because the mice were immune-deficient, it is likely that the anti-tumor effect was primarily through direct inhibition of tumor cell proliferation and survival. Based on these studies, we argue that local IFN-β gene therapy with replication-defective adenoviral vectors might be an effective treatment for some solid tumors.

Time-dependent vascular regression and permeability changes in established human tumor xenografts induced by an anti-vascular endothelial growth factor/vascular permeability factor antibody

The hyperpermeability of tumor vessels to macromolecules, compared with normal vessels, is presumably due to vascular endothelial growth factor/vascular permeability factor (VEGF/VPF) released by neoplastic and/or host cells. In addition, VEGF/VPF is a potent angiogenic factor. Removal of this growth factor may reduce the permeability and inhibit tumor angiogenesis. To test these hypotheses, we transplanted a human glioblastoma (U87), a human colon adenocarcinoma (LS174T), and a human melanoma (P-MEL) into two locations in immunodeficient mice: the cranial window and the dorsal skinfold chamber. The mice bearing vascularized tumors were treated with a bolus (0.2 ml) of either a neutralizing antibody (A4.6.1) (492 μg/ml) against VEGF/VPF or PBS (control). We found that tumor vascular permeability to albumin in antibody-treated groups was lower than in the matched controls and that the effect of the antibody was time-dependent and influenced by the mode of injection. Tumor vascular permeability did not respond to i.p. injection of the antibody until 4 days posttreatment. However, the permeability was reduced within 6 h after i.v. injection of the same amount of antibody. In addition to the reduction in vascular permeability, the tumor vessels became smaller in diameter and less tortuous after antibody injections and eventually disappeared from the surface after four consecutive treatments in U87 tumors. These results demonstrate that tumor vascular permeability can be reduced by neutralization of endogenous VEGF/VPF and suggest that angiogenesis and the maintenance of integrity of tumor vessels require the presence of VEGF/VPF in the tissue microenvironment. The latter finding reveals a new mechanism of tumor vessel regression—i.e., blocking the interactions between VEGF/VPF and endothelial cells or inhibiting VEGF/VPF synthesis in solid tumors causes dramatic reduction in vessel diameter, which may block the passage of blood elements and thus lead to vascular regression.