Efficient Optimization Algorithms for Nonlinear Data Analysis

Identification of low-dimensional structures and main sources of variation from multivariate data are fundamental tasks in data analysis. Many methods aimed at these tasks involve solution of an optimization problem. Thus, the objective of this thesis is to develop computationally efficient and theoretically justified methods for solving such problems. Most of the thesis is based on a statistical model, where ridges of the density estimated from the data are considered as relevant features. Finding ridges, that are generalized maxima, necessitates development of advanced optimization methods. An efficient and convergent trust region Newton method for projecting a point onto a ridge of the underlying density is developed for this purpose. The method is utilized in a differential equation-based approach for tracing ridges and computing projection coordinates along them. The density estimation is done nonparametrically by using Gaussian kernels. This allows application of ridge-based methods with only mild assumptions on the underlying structure of the data. The statistical model and the ridge finding methods are adapted to two different applications. The first one is extraction of curvilinear structures from noisy data mixed with background clutter. The second one is a novel nonlinear generalization of principal component analysis (PCA) and its extension to time series data. The methods have a wide range of potential applications, where most of the earlier approaches are inadequate. Examples include identification of faults from seismic data and identification of filaments from cosmological data. Applicability of the nonlinear PCA to climate analysis and reconstruction of periodic patterns from noisy time series data are also demonstrated. Other contributions of the thesis include development of an efficient semidefinite optimization method for embedding graphs into the Euclidean space. The method produces structure-preserving embeddings that maximize interpoint distances. It is primarily developed for dimensionality reduction, but has also potential applications in graph theory and various areas of physics, chemistry and engineering. Asymptotic behaviour of ridges and maxima of Gaussian kernel densities is also investigated when the kernel bandwidth approaches infinity. The results are applied to the nonlinear PCA and to finding significant maxima of such densities, which is a typical problem in visual object tracking.

Multivariate analysis of the energy cycle of the South American rainy season

The South American (SA) rainy season is studied in this paper through the application of a multivariate Empirical Orthogonal Function (EOF) analysis to a SA gridded precipitation analysis and to the components of Lorenz Energy Cycle (LEC) derived from the National Centers for Environmental Prediction (NCEP) reanalysis. The EOF analysis leads to the identification of patterns of the rainy season and the associated mechanisms in terms of their energetics. The first combined EOF represents the northwest-southeast dipole of the precipitation between South and Central America, the South American Monsoon System (SAMS). The second combined EOF represents a synoptic pattern associated with the SACZ (South Atlantic convergence zone) and the third EOF is in spatial quadrature to the second EOF. The phase relationship of the EOFs, as computed from the principal components (PCs), suggests a nonlinear transition from the SACZ to the fully developed SAMS mode by November and between both components describing the SACZ by September-October (the rainy season onset). According to the LEC, the first mode is dominated by the eddy generation term at its maximum, the second by both baroclinic and eddy generation terms and the third by barotropic instability previous to the connection to the second mode by September-October. The predominance of the different LEC components at each phase of the SAMS can be used as an indicator of the onset of the rainy season in terms of physical processes, while the existence of the outstanding spectral peaks in the time dependence of the EOFs at the intraseasonal time scale could be used for monitoring purposes. Copyright (C) 2009 Royal Meteorological Society

Multivariate analysis of the effects of soil parameters and environmental factors on the flavonoid content of leaves of Passiflora incarnata L., Passifloraceae

The aim of the present study was to evaluate the effect of soil characteristics (pH, macro- and micro-nutrients), environmental factors (temperature, humidity, period of the year and time of day of collection) and meteorological conditions (rain, sun, cloud and cloud/rain) on the flavonoid content of leaves of Passiflora incarnata L., Passifloraceae. The total flavonoid contents of leaf samples harvested from plants cultivated or collected under different conditions were quantified by high-performance liquid chromatography with ultraviolet detection (HPLC-UV/PAD). Chemometric treatment of the data by principal component (PCA) and hierarchic cluster analyses (HCA) showed that the samples did not present a specific classification in relation to the environmental and soil variables studied, and that the environmental variables were not significant in describing the data set. However, the levels of the elements Fe, B and Cu present in the soil showed an inverse correlation with the total flavonoid contents of the leaves of P. incarnata.

Estimation of hexenuronic acids and kappa number in kraft pulps of Eucalyptus globulus by Fourier transform near infrared spectroscopy and multivariate analysis

Fourier transform near infrared (FT-NIR) spectroscopy was evaluated as an analytical too[ for monitoring residual Lignin, kappa number and hexenuronic acids (HexA) content in kraft pulps of Eucalyptus globulus. Sets of pulp samples were prepared under different cooking conditions to obtain a wide range of compound concentrations that were characterised by conventional wet chemistry analytical methods. The sample group was also analysed using FT-NIR spectroscopy in order to establish prediction models for the pulp characteristics. Several models were applied to correlate chemical composition in samples with the NIR spectral data by means of PCR or PLS algorithms. Calibration curves were built by using all the spectral data or selected regions. Best calibration models for the quantification of lignin, kappa and HexA were proposed presenting R-2 values of 0.99. Calibration models were used to predict pulp titers of 20 external samples in a validation set. The lignin concentration and kappa number in the range of 1.4-18% and 8-62, respectively, were predicted fairly accurately (standard error of prediction, SEP 1.1% for lignin and 2.9 for kappa). The HexA concentration (range of 5-71 mmol kg(-1) pulp) was more difficult to predict and the SEP was 7.0 mmol kg(-1) pulp in a model of HexA quantified by an ultraviolet (UV) technique and 6.1 mmol kg(-1) pulp in a model of HexA quantified by anion-exchange chromatography (AEC). Even in wet chemical procedures used for HexA determination, there is no good agreement between methods as demonstrated by the UV and AEC methods described in the present work. NIR spectroscopy did provide a rapid estimate of HexA content in kraft pulps prepared in routine cooking experiments.

Biomimetic oxidative treatment of spruce wood studied by pyrolysis-molecular beam mass spectrometry coupled with multivariate analysis and (13)C-labeled tetramethylammonium hydroxide thermochemolysis: implications for fungal degradation of wood

In this work, pyrolysis-molecular beam mass spectrometry analysis coupled with principal components analysis and (13)C-labeled tetramethylammonium hydroxide thermochemolysis were used to study lignin oxidation, depolymerization, and demethylation of spruce wood treated by biomimetic oxidative systems. Neat Fenton and chelator-mediated Fenton reaction (CMFR) systems as well as cellulosic enzyme treatments were used to mimic the nonenzymatic process involved in wood brown-rot biodegradation. The results suggest that compared with enzymatic processes, Fenton-based treatment more readily opens the structure of the lignocellulosic matrix, freeing cellulose fibrils from the matrix. The results demonstrate that, under the current treatment conditions, Fenton and CMFR treatment cause limited demethoxylation of lignin in the insoluble wood residue. However, analysis of a water-extractable fraction revealed considerable soluble lignin residue structures that had undergone side chain oxidation as well as demethoxylation upon CMFR treatment. This research has implications for our understanding of nonenzymatic degradation of wood and the diffusion of CMFR agents in the wood cell wall during fungal degradation processes.

Multivariate analysis of sensory characteristics of coffee grains (Coffea arabica L.) in the region of upper Paranaiba

This study aimed to examine the sensory characteristics of the grains of 21 cultivars of Coffea arabica L. and Coffea canephora Pierre from the essays of genetic improvement of EPAMIG, located in Patrocinio Municipality, Minas Gerais State, where they were collected through cloths stripping method and washed. Subsequently to dry (11 to 12% moisture b.u.), we obtained the coffee designated as natural. The evaluated varieties were: Acaia Cerrado MG 1474; Bourbon Vermelho DATERRA; Catigua MG 1; Catigua MG 2; Catual Amarelo IAC 62; Catuai Vermelho IAC 15; H 419-3-1-4-2; H 419-6-2 -5-2; H 419-6-2-5-3; H 419-6-2-7-3 Vermelho; H 493-1-2-10; H 514-7-10-1 Vermelho; H 514-7-10-6; H 515-4-2-2; H 518-3-6-1; Icatu Amarelo IAC 3282; Mundo Novo 379-19; Mundo Novo TAO 376-4; Rubi MG 1192; Sacramento MG 1 and Topazio MG 1190, from 2005/2006 and 2006/2007 seasons. The cultivars according to the first principal component with notes above 80 points, regarded as superior drink according to attributes with the highest scores (flavor, sweetness, balance, acidity, clean drink, and aspect) were: Catigua MG2, Rubi MG 1192, 514-7-10-6 H, H 419-3-1-4-2, H 419-6-2-5-2, 493-1-2-10 H, H 514-7-10-1 Vermelho, Catigua MG1, Sacramento MG1, 419-6-2-5-3 H, H 515-9-2-2 and Catuai Amarelo IAC 62.

A multivariate analysis of socio-demographic factors, water contact patterns and Schistosoma mansoni infection in an endemic area in Brazil

Associations between socio-demographic factors, water contact patterns and Schistosoma mansoni infection were investigated in 506 individuals (87% of inhabitants over 1 year of age) in an endemic area in Brazil (Divino), aiming at determining priorities for public health measures to prevent the infection. Those who eliminated S. mansoni eggs (n = 198) were compared to those without eggs in the stools (n = 308). The following explanatory variables were considered: age, sex, color, previous treatment with schistosomicide, place of birth, quality of the houses, water supply for the household, distance from houses to stream, and frequency and reasons for water contact. Factors found to be independently associated with the infection were age (10-19 and > 20 yrs old), and water contact for agricultural activities, fishing, and swimming or bathing (Adjusted relative odds = 5.0, 2.4, 3.2, 2.1 and 2.0, respectively). This suggests the need for public health measures to prevent the infection, emphasizing water contact for leisure and agricultural activities in this endemic area.

Optimization of River Water Quality Surveys by Multivariate Analysis of Physicochemical, Bacteriological and Ecotoxicological Data

This study aims to optimize the water quality monitoring of a polluted watercourse (Leça River, Portugal) through the principal component analysis (PCA) and cluster analysis (CA). These statistical methodologies were applied to physicochemical, bacteriological and ecotoxicological data (with the marine bacterium Vibrio fischeri and the green alga Chlorella vulgaris) obtained with the analysis of water samples monthly collected at seven monitoring sites and during five campaigns (February, May, June, August, and September 2006). The results of some variables were assigned to water quality classes according to national guidelines. Chemical and bacteriological quality data led to classify Leça River water quality as “bad” or “very bad”. PCA and CA identified monitoring sites with similar pollution pattern, giving to site 1 (located in the upstream stretch of the river) a distinct feature from all other sampling sites downstream. Ecotoxicity results corroborated this classification thus revealing differences in space and time. The present study includes not only physical, chemical and bacteriological but also ecotoxicological parameters, which broadens new perspectives in river water characterization. Moreover, the application of PCA and CA is very useful to optimize water quality monitoring networks, defining the minimum number of sites and their location. Thus, these tools can support appropriate management decisions.

A multivariate analysis of the relationship between work ability and S. japonicum infection in Dongting Lake Region, in China

A cross-sectional case-control study on the association between the reduced work ability and S. japonicum infection was carried out in a moderate endemic area for schistosomiasis japonica in the southern part of Dongting lake in China. A total of 120 cases with reduced work ability and 240 controls paired to the case by age, sex, occupation and without reduced work ability, participated in the study. The mean age for individuals was 37.6 years old (21-60), the ratio of male: female was 60:40, the prevalence of S. japonicum in the individuals was 28.3%. The results obtained in this study showed that the infection of S. japonicum in case and control groups was 49.2% (59/120) and 17.9% (43/240), respectively. Odds ratio for reduced work ability among those who had schistosomiasis was 4.34 (95%), confidence interval was 2.58-7.34, and among those who had S. japonicum infection (egg per gram > 100) was up to 12.67 (95%), confidence interval was 3.64-46.39. After odds ratio was adjusted by multiple logistic regression, it was confirmed that heavier intensity of S. japonicum infection and splenomegaly due to S. japonicum infection were the main risk factors for reduced work ability in the population studied.

Multivariate analysis applied to clinical analysis data

Dissertação para obtenção do Grau de Mestre em Engenharia e Gestão Industrial

Seismic vulnerability of existing masonry buildings: Nonlinear parametric analysis

Existing masonry structures are usually associated to a high seismic vulnerability, mainly due to the properties of the materials, weak connections between floors and load-bearing walls, high mass of the masonry walls and flexibility of the floors. For these reasons, the seismic performance of existing masonry structures has received much attention in the last decades. This study presents the parametric analysis taking into account the deviations on features of the gaioleiro buildings - Portuguese building typology. The main objective of the parametric analysis is to compare the seismic performance of the structure as a function of the variations of its properties with respect to the response of a reference model. The parametric analysis was carried out for two types of structural analysis, namely for the non-linear dynamic analysis with time integration and for the pushover analysis with distribution of forces proportional to the inertial forces of the structure. The Young's modulus of the masonry walls, Young's modulus of the timber floors, the compressive and tensile non-linear properties (strength and fracture energy) were the properties considered in both type of analysis. Additionally, in the dynamic analysis, the influences of the vis-cous damping and of the vertical component of the earthquake were evaluated. A pushover analysis proportional to the modal displacement of the first mode in each direction was also carried out. The results shows that the Young's modulus of the masonry walls, the Young's modulus of the timber floors and the compressive non-linear properties are the pa-rameters that most influence the seismic performance of this type of tall and weak existing masonry structures. Furthermore, it is concluded that that the stiffness of the floors influences significantly the strength capacity and the collapse mecha-nism of the numerical model. Thus, a study on the strengthening of the floors was also carried out. The increase of the thickness of the timber floors was the strengthening technique that presented the best seismic performance, in which the reduction of the out-of-plane displacements of the masonry walls is highlighted.

Evaluation of seismic vulnerability assessment parameters for portuguese vernacular constructions with nonlinear numerical analysis

Considering that vernacular architecture may bear important lessons on hazard mitigation and that well-constructed examples showing traditional seismic resistant features can present far less vulnerability than expected, this study aims at understanding the resisting mechanisms and seismic behavior of vernacular buildings through detailed finite element modeling and nonlinear static (pushover) analysis. This paper focuses specifically on a type of vernacular rammed earth constructions found in the Portuguese region of Alentejo. Several rammed earth constructions found in the region were selected and studied in terms of dimensions, architectural layout, structural solutions, construction materials and detailing and, as a result, a reference model was built, which intends to be a simplified representative example of these constructions, gathering the most common characteristics. Different parameters that may affect the seismic response of this type of vernacular constructions have been identified and a numerical parametric study was defined aiming at evaluating and quantifying their influence in the seismic behavior of this type of vernacular buildings. This paper is part of an ongoing research which includes the development of a simplified methodology for assessing the seismic vulnerability of vernacular buildings, based on vulnerability index evaluation methods.

Multivariate Analysis for Animal Selection in Experimental Research

Background: Several researchers seek methods for the selection of homogeneous groups of animals in experimental studies, a fact justified because homogeneity is an indispensable prerequisite for casualization of treatments. The lack of robust methods that comply with statistical and biological principles is the reason why researchers use empirical or subjective methods, influencing their results. Objective: To develop a multivariate statistical model for the selection of a homogeneous group of animals for experimental research and to elaborate a computational package to use it. Methods: The set of echocardiographic data of 115 male Wistar rats with supravalvular aortic stenosis (AoS) was used as an example of model development. Initially, the data were standardized, and became dimensionless. Then, the variance matrix of the set was submitted to principal components analysis (PCA), aiming at reducing the parametric space and at retaining the relevant variability. That technique established a new Cartesian system into which the animals were allocated, and finally the confidence region (ellipsoid) was built for the profile of the animals’ homogeneous responses. The animals located inside the ellipsoid were considered as belonging to the homogeneous batch; those outside the ellipsoid were considered spurious. Results: The PCA established eight descriptive axes that represented the accumulated variance of the data set in 88.71%. The allocation of the animals in the new system and the construction of the confidence region revealed six spurious animals as compared to the homogeneous batch of 109 animals. Conclusion: The biometric criterion presented proved to be effective, because it considers the animal as a whole, analyzing jointly all parameters measured, in addition to having a small discard rate.

Die Säuglingssterblichkeit in der Schweiz: multivariate Betrachtung. [Perinatal mortality in Switzerland: a multivariate analysis]

A regression analysis using a linked file of all Swiss births und perinatal deaths 1979-1981 showed a significant relation between birthweight and canton. Sex of infant and multiplicity of birth were significant, too. For live births, marital and socio-economic status of mother and father relate to birthweight. Logistic regressions brought out relationships between the risk of stillbirth and occupation of father, nationality and marital status of mother, apart from birthweight. For live births, only sex and (weakly) marital status and rank of the child were influencial after correction for birthweight.