Towards input/output-free modelling of linear infinite-dimensional systems in continuous time

This dissertation describes a networking approach to infinite-dimensional systems theory, where there is a minimal distinction between inputs and outputs. We introduce and study two closely related classes of systems, namely the state/signal systems and the port-Hamiltonian systems, and describe how they relate to each other. Some basic theory for these two classes of systems and the interconnections of such systems is provided. The main emphasis lies on passive and conservative systems, and the theoretical concepts are illustrated using the example of a lossless transfer line. Much remains to be done in this field and we point to some directions for future studies as well.

Draft prediction models for soil engaging tines in two soils of Rio Grande do Sul, Brazil

The draft forces of soil engaging tines and theoretical analysis compared to existing mathematical models, have yet not been studied in Rio Grande do Sul soils. From the existing models, those which can get the closest fitting draft forces to real measure on field have been established for two of Rio Grande do Sul soils. An Albaqualf and a Paleudult were evaluated. From the studied models, those suggested by Reece, so called "Universal Earthmoving Equation", Hettiaratchi and Reece, and Godwin and Spoor were the best fitting ones, comparing the calculated results with those measured "in situ". Allowing for the less complexity of Reece's model, it is suggested that this model should be used for modeling draft forces prediction for narrow tines in Albaqualf and Paleudut.

Magnetic susceptibility in the prediction of soil attributes in two sugarcane harvesting management systems

This study aimed to investigate the potential use of magnetic susceptibility (MS) as pedotransfer function to predict soil attributes under two sugarcane harvesting management systems. For each area of 1 ha (one with green sugarcane mechanized harvesting and other one with burnt sugarcane manual harvesting), 126 soil samples were collected and subjected to laboratory analysis to determine soil physical, chemical and mineralogical attributes and for measuring of MS. Data were submitted to descriptive statistics by calculating the mean and coefficient of variation. In order to compare the means in the different harvesting management systems it was carried out the Tukey test at a significance level of 5%. In order to investigate the correlation of the MS with other soil properties it was made the correlation test and aiming to assess how the MS contributes to the prediction of soil complex attributes it was made the multiple linear regressions. The results demonstrate that MS showed, in both sugarcane harvesting management systems, statistical correlation with chemical, physical and mineralogical soil attributes and it also showed potential to be used as pedotransfer function to predict attributes of the studied oxisol.

Using the best linear predictor (BLP) in the selection between and among half-sib progenies of the CMS-39 maize population

Data of corn ear production (kg/ha) of 196 half-sib progenies (HSP) of the maize population CMS-39 obtained from experiments carried out in four environments were used to adapt and assess the BLP method (best linear predictor) in comparison with to the selection among and within half-sib progenies (SAWHSP). The 196 HSP of the CMS-39 population developed by the National Center for Maize and Sorghum Research (CNPMS-EMBRAPA) were related through their pedigree with the recombined progenies of the previous selection cycle. The two methodologies used for the selection of the twenty best half-sib progenies, BLP and SAWHSP, led to similar expected genetic gains. There was a tendency in the BLP methodology to select a greater number of related progenies because of the previous generation (pedigree) than the other method. This implies that greater care with the effective size of the population must be taken with this method. The SAWHSP methodology was efficient in isolating the additive genetic variance component from the phenotypic component. The pedigree system, although unnecessary for the routine use of the SAWHSP methodology, allowed the prediction of an increase in the inbreeding of the population in the long term SAWHSP selection when recombination is simultaneous to creation of new progenies.

Prediction of exposed domains of envelope glycoprotein in Indian HIV-1 isolates and experimental confirmation of their immunogenicity in humans

We describe the impact of subtype differences on the seroreactivity of linear antigenic epitopes in envelope glycoprotein of HIV-1 isolates from different geographical locations. By computer analysis, we predicted potential antigenic sites of envelope glycoprotein (gp120 and gp4l) of this virus. For this purpose, after fetching sequences of proteins of interest from data banks, values of hydrophilicity, flexibility, accessibility, inverted hydrophobicity, and secondary structure were considered. We identified several potential antigenic epitopes in a B subtype strain of envelope glycoprotein of HIV-1 (IIIB). Solid- phase peptide synthesis methods of Merrifield and Fmoc chemistry were used for synthesizing peptides. These synthetic peptides corresponded mainly to the C2, V3 and CD4 binding sites of gp120 and some parts of the ectodomain of gp41. The reactivity of these peptides was tested by ELISA against different HIV-1-positive sera from different locations in India. For two of these predicted epitopes, the corresponding Indian consensus sequences (LAIERYLKQQLLGWG and DIIGDIRQAHCNISEDKWNET) (subtype C) were also synthesized and their reactivity was tested by ELISA. These peptides also distinguished HIV-1-positive sera of Indians with C subtype infections from sera from HIV-negative subjects.

Abnormalities of hippocampal signal intensity in patients with familial mesial temporal lobe epilepsy

Mesial temporal lobe epilepsy (MTLE) is associated with hippocampal atrophy and hippocampal signal abnormalities. In our series of familial MTLE (FMTLE), we found a high proportion of hippocampal abnormalities. To quantify signal abnormalities in patients with FMTLE we studied 152 individuals (46 of them asymptomatic) with FMTLE. We used NIH-Image® for volumetry and signal quantification in coronal T1 inversion recovery and T2 for all cross-sections of the hippocampus. Values diverging by 2 or more SD from the control mean were considered abnormal. T2 hippocampal signal abnormalities were found in 52% of all individuals: 54% of affected subjects and 48% of asymptomatic subjects. T1 hippocampal signal changes were found in 34% of all individuals: 42.5% of affected subjects and 15% of asymptomatic subjects. Analysis of the hippocampal head (first three slices) revealed T2 abnormalities in 73% of all individuals (74% of affected subjects and 72% of asymptomatic subjects) and T1 abnormalities in 59% (67% of affected subjects and 41% of asymptomatic subjects). Affected individuals had smaller volumes than controls (P < 0.0001). There was no difference in hippocampal volumes between asymptomatic subjects and controls, although 39% of asymptomatic patients had hippocampal atrophy. Patients with an abnormal hippocampal signal (133 individuals) had smaller ipsilateral volume, but no linear correlation could be determined. Hippocampal signal abnormalities in FMTLE were more frequently found in the hippocampal head in both affected and asymptomatic family members, including those with normal volumes. These results indicate that subtle abnormalities leading to an abnormal hippocampal signal in FMTLE are not necessarily related to seizures and may be determined by genetic factors.

The effect of an aerobic training program on the electrical remodeling of the heart: high-frequency components of the signal-averaged electrocardiogram are predictors of the maximal aerobic power

Increased heart rate variability (HRV) and high-frequency content of the terminal region of the ventricular activation of signal-averaged ECG (SAECG) have been reported in athletes. The present study investigates HRV and SAECG parameters as predictors of maximal aerobic power (VO2max) in athletes. HRV, SAECG and VO2max were determined in 18 high-performance long-distance (25 ± 6 years; 17 males) runners 24 h after a training session. Clinical visits, ECG and VO2max determination were scheduled for all athletes during thew training period. A group of 18 untrained healthy volunteers matched for age, gender, and body surface area was included as controls. SAECG was acquired in the resting supine position for 15 min and processed to extract average RR interval (Mean-RR) and root mean squared standard deviation (RMSSD) of the difference of two consecutive normal RR intervals. SAECG variables analyzed in the vector magnitude with 40-250 Hz band-pass bi-directional filtering were: total and 40-µV terminal (LAS40) duration of ventricular activation, RMS voltage of total (RMST) and of the 40-ms terminal region of ventricular activation. Linear and multivariate stepwise logistic regressions oriented by inter-group comparisons were adjusted in significant variables in order to predict VO2max, with a P < 0.05 considered to be significant. VO2max correlated significantly (P < 0.05) with RMST (r = 0.77), Mean-RR (r = 0.62), RMSSD (r = 0.47), and LAS40 (r = -0.39). RMST was the independent predictor of VO2max. In athletes, HRV and high-frequency components of the SAECG correlate with VO2max and the high-frequency content of SAECG is an independent predictor of VO2max.

Linear and nonlinear analysis of heart rate variability in healthy subjects and after acute myocardial infarction in patients

The objectives of this study were to evaluate and compare the use of linear and nonlinear methods for analysis of heart rate variability (HRV) in healthy subjects and in patients after acute myocardial infarction (AMI). Heart rate (HR) was recorded for 15 min in the supine position in 10 patients with AMI taking β-blockers (aged 57 ± 9 years) and in 11 healthy subjects (aged 53 ± 4 years). HRV was analyzed in the time domain (RMSSD and RMSM), the frequency domain using low- and high-frequency bands in normalized units (nu; LFnu and HFnu) and the LF/HF ratio and approximate entropy (ApEn) were determined. There was a correlation (P < 0.05) of RMSSD, RMSM, LFnu, HFnu, and the LF/HF ratio index with the ApEn of the AMI group on the 2nd (r = 0.87, 0.65, 0.72, 0.72, and 0.64) and 7th day (r = 0.88, 0.70, 0.69, 0.69, and 0.87) and of the healthy group (r = 0.63, 0.71, 0.63, 0.63, and 0.74), respectively. The median HRV indexes of the AMI group on the 2nd and 7th day differed from the healthy group (P < 0.05): RMSSD = 10.37, 19.95, 24.81; RMSM = 23.47, 31.96, 43.79; LFnu = 0.79, 0.79, 0.62; HFnu = 0.20, 0.20, 0.37; LF/HF ratio = 3.87, 3.94, 1.65; ApEn = 1.01, 1.24, 1.31, respectively. There was agreement between the methods, suggesting that these have the same power to evaluate autonomic modulation of HR in both AMI patients and healthy subjects. AMI contributed to a reduction in cardiac signal irregularity, higher sympathetic modulation and lower vagal modulation.

Utility of a novel risk score for prediction of ventricular tachycardia and cardiac death in chronic Chagas disease - the SEARCH-RIO study

The SEARCH-RIO study prospectively investigated electrocardiogram (ECG)-derived variables in chronic Chagas disease (CCD) as predictors of cardiac death and new onset ventricular tachycardia (VT). Cardiac arrhythmia is a major cause of death in CCD, and electrical markers may play a significant role in risk stratification. One hundred clinically stable outpatients with CCD were enrolled in this study. They initially underwent a 12-lead resting ECG, signal-averaged ECG, and 24-h ambulatory ECG. Abnormal Q-waves, filtered QRS duration, intraventricular electrical transients (IVET), 24-h standard deviation of normal RR intervals (SDNN), and VT were assessed. Echocardiograms assessed left ventricular ejection fraction. Predictors of cardiac death and new onset VT were identified in a Cox proportional hazard model. During a mean follow-up of 95.3 months, 36 patients had adverse events: 22 new onset VT (mean±SD, 18.4±4‰/year) and 20 deaths (26.4±1.8‰/year). In multivariate analysis, only Q-wave (hazard ratio, HR=6.7; P<0.001), VT (HR=5.3; P<0.001), SDNN<100 ms (HR=4.0; P=0.006), and IVET+ (HR=3.0; P=0.04) were independent predictors of the composite endpoint of cardiac death and new onset VT. A prognostic score was developed by weighting points proportional to beta coefficients and summing-up: Q-wave=2; VT=2; SDNN<100 ms=1; IVET+=1. Receiver operating characteristic curve analysis optimized the cutoff value at >1. In 10,000 bootstraps, the C-statistic of this novel score was non-inferior to a previously validated (Rassi) score (0.89±0.03 and 0.80±0.05, respectively; test for non-inferiority: P<0.001). In CCD, surface ECG-derived variables are predictors of cardiac death and new onset VT.

Autonomic prediction of error-related ERP components in perceptual and conceptual tasks in older and younger adults

In studies of cognitive processing, the allocation of attention has been consistently linked to subtle, phasic adjustments in autonomic control. Both autonomic control of heart rate and control of the allocation of attention are known to decline with age. It is not known, however, whether characteristic individual differences in autonomic control and the ability to control attention are closely linked. To test this, a measure of parasympathetic function, vagal tone (VT) was computed from cardiac recordings from older and younger adults taken before and during performance of two attentiondemanding tasks - the Eriksen visual flanker task and the source memory task. Both tasks elicited event-related potentials (ERPs) that accompany errors, i.e., error-related negativities (ERNs) and error positivities (Pe's). The ERN is a negative deflection in the ERP signal, time-locked to responses made on incorrect trials, likely generated in the anterior cingulate. It is followed immediately by the Pe, a broad, positive deflection which may reflect conscious awareness of having committed an error. Age-attenuation ofERN amplitude has previously been found in paradigms with simple stimulus-response mappings, such as the flanker task, but has rarely been examined in more complex, conceptual tasks. Until now, there have been no reports of its being investigated in a source monitoring task. Age-attenuation of the ERN component was observed in both tasks. Results also indicated that the ERNs generated in these two tasks were generally comparable for young adults. For older adults, however, the ERN from the source monitoring task was not only shallower, but incorporated more frontal processing, apparently reflecting task demands. The error positivities elicited by 3 the two tasks were not comparable, however, and age-attenuation of the Pe was seen only in the more perceptual flanker task. For younger adults, it was Pe scalp topography that seemed to reflect task demands, being maximal over central parietal areas in the flanker task, but over very frontal areas in the source monitoring task. With respect to vagal tone, in the flanker task, neither the number of errors nor ERP amplitudes were predicted by baseline or on-task vagal tone measures. However, in the more difficult source memory task, lower VT was marginally associated with greater numbers of source memory errors in the older group. Thus, for older adults, relatively low levels of parasympathetic control over cardiac response coincided with poorer source memory discrimination. In both groups, lower levels of baseline VT were associated with larger amplitude ERNs, and smaller amplitude Pe's. Thus, low VT was associated in a conceptual task with a greater "emergency response" to errors, and at the same time, reduced awareness of having made them. The efficiency of an individual's complex cognitive processing was therefore associated with the flexibility of parasympathetic control of heart rate, in response to a cognitively challenging task.

Pigment orientation changes detected by low temperature linear dichroism spectroscopy: cold-hardening transition in phycobilisome-containing organisms

Low temperature (77K) linear dichroism spectroscopy was used to characterize pigment orientation changes accompanying the light state transition in the cyanobacterium, Synechococcus sp. pee 6301, and cold-hardening in winter rye (Secale cereale L. cv. Puma). Samples were oriented for spectroscopy using the gel squeezing method (Abdourakhmanov et aI., 1979) and brought to 77K in liquid nitrogen. The linear dichroism (LD) spectra of Synechococcus 6301 phycobilisome/thylakoid membrane fragments cross-linked in light state 1 and light state 2 with glutaraldehyde showed differences in both chlorophyll a and phycobilin orientation. A decrease in the relative amplitude of the 681nm chlorophyll a positive LD peak was observed in membrane fragments in state 2. Reorientation of the phycobilisome (PBS) during the transition to state 2 resulted in an increase in core allophycocyanin absorption parallel to the membrane, and a decrease in rod phycocyanin parallel absorption. This result supports the "spillover" and "PBS detachment" models of the light state transition in PBS-containing organisms, but not the "mobile PBS" model. A model was proposed for PBS reorientation upon transition to state 2, consisting of a tilt in the antenna complex with respect to the membrane plane. Linear dichroism spectra of PBS/thylakoid fragments from the red alga, Porphyridium cruentum, grown in green light (containing relatively more PSI) and red light (containing relatively more PSll) were compared to identify chlorophyll a absorption bands associated with each photosystem. Spectra from red light - grown samples had a larger positive LD signal on the short wavelength side of the 686nm chlorophyll a peak than those from green light - grown fragments. These results support the identification of the difference in linear dichroism seen at 681nm in Synechococcus spectra as a reorientation of PSll chromophores. Linear dichroism spectra were taken of thylakoid membranes isolated from winter rye grown at 20°C (non-hardened) and 5°C (cold-hardened). Differences were seen in the orientation of chlorophyll b relative to chlorophyll a. An increase in parallel absorption was identified at the long-wavelength chlorophyll a absorption peak, along with a decrease in parallel absorption from chlorophyll b chromophores. The same changes in relative pigment orientation were seen in the LD of isolated hardened and non-hardened light-harvesting antenna complexes (LHCII). It was concluded that orientational differences in LHCII pigments were responsible for thylakoid LD differences. Changes in pigment orientation, along with differences observed in long-wavelength absorption and in the overall magnitude of LD in hardened and non-hardened complexes, could be explained by the higher LHCII monomer:oligomer ratio in hardened rye (Huner et ai., 1987) if differences in this ratio affect differential light scattering properties, or fluctuation of chromophore orientation in the isolated LHCII sample.

Improving sampling, optimization and feature extraction in Boltzmann machines

L’apprentissage supervisé de réseaux hiérarchiques à grande échelle connaît présentement un succès fulgurant. Malgré cette effervescence, l’apprentissage non-supervisé représente toujours, selon plusieurs chercheurs, un élément clé de l’Intelligence Artificielle, où les agents doivent apprendre à partir d’un nombre potentiellement limité de données. Cette thèse s’inscrit dans cette pensée et aborde divers sujets de recherche liés au problème d’estimation de densité par l’entremise des machines de Boltzmann (BM), modèles graphiques probabilistes au coeur de l’apprentissage profond. Nos contributions touchent les domaines de l’échantillonnage, l’estimation de fonctions de partition, l’optimisation ainsi que l’apprentissage de représentations invariantes. Cette thèse débute par l’exposition d’un nouvel algorithme d'échantillonnage adaptatif, qui ajuste (de fa ̧con automatique) la température des chaînes de Markov sous simulation, afin de maintenir une vitesse de convergence élevée tout au long de l’apprentissage. Lorsqu’utilisé dans le contexte de l’apprentissage par maximum de vraisemblance stochastique (SML), notre algorithme engendre une robustesse accrue face à la sélection du taux d’apprentissage, ainsi qu’une meilleure vitesse de convergence. Nos résultats sont présent ́es dans le domaine des BMs, mais la méthode est générale et applicable à l’apprentissage de tout modèle probabiliste exploitant l’échantillonnage par chaînes de Markov. Tandis que le gradient du maximum de vraisemblance peut-être approximé par échantillonnage, l’évaluation de la log-vraisemblance nécessite un estimé de la fonction de partition. Contrairement aux approches traditionnelles qui considèrent un modèle donné comme une boîte noire, nous proposons plutôt d’exploiter la dynamique de l’apprentissage en estimant les changements successifs de log-partition encourus à chaque mise à jour des paramètres. Le problème d’estimation est reformulé comme un problème d’inférence similaire au filtre de Kalman, mais sur un graphe bi-dimensionnel, où les dimensions correspondent aux axes du temps et au paramètre de température. Sur le thème de l’optimisation, nous présentons également un algorithme permettant d’appliquer, de manière efficace, le gradient naturel à des machines de Boltzmann comportant des milliers d’unités. Jusqu’à présent, son adoption était limitée par son haut coût computationel ainsi que sa demande en mémoire. Notre algorithme, Metric-Free Natural Gradient (MFNG), permet d’éviter le calcul explicite de la matrice d’information de Fisher (et son inverse) en exploitant un solveur linéaire combiné à un produit matrice-vecteur efficace. L’algorithme est prometteur: en terme du nombre d’évaluations de fonctions, MFNG converge plus rapidement que SML. Son implémentation demeure malheureusement inefficace en temps de calcul. Ces travaux explorent également les mécanismes sous-jacents à l’apprentissage de représentations invariantes. À cette fin, nous utilisons la famille de machines de Boltzmann restreintes “spike & slab” (ssRBM), que nous modifions afin de pouvoir modéliser des distributions binaires et parcimonieuses. Les variables latentes binaires de la ssRBM peuvent être rendues invariantes à un sous-espace vectoriel, en associant à chacune d’elles, un vecteur de variables latentes continues (dénommées “slabs”). Ceci se traduit par une invariance accrue au niveau de la représentation et un meilleur taux de classification lorsque peu de données étiquetées sont disponibles. Nous terminons cette thèse sur un sujet ambitieux: l’apprentissage de représentations pouvant séparer les facteurs de variations présents dans le signal d’entrée. Nous proposons une solution à base de ssRBM bilinéaire (avec deux groupes de facteurs latents) et formulons le problème comme l’un de “pooling” dans des sous-espaces vectoriels complémentaires.

PSWT Based Linear Predictive Coding and Development of a Parallel Multiple Subsequence Structure for DWT Computation

During 1990's the Wavelet Transform emerged as an important signal processing tool with potential applications in time-frequency analysis and non-stationary signal processing.Wavelets have gained popularity in broad range of disciplines like signal/image compression, medical diagnostics, boundary value problems, geophysical signal processing, statistical signal processing,pattern recognition,underwater acoustics etc.In 1993, G. Evangelista introduced the Pitch- synchronous Wavelet Transform, which is particularly suited for pseudo-periodic signal processing.The work presented in this thesis mainly concentrates on two interrelated topics in signal processing,viz. the Wavelet Transform based signal compression and the computation of Discrete Wavelet Transform. A new compression scheme is described in which the Pitch-Synchronous Wavelet Transform technique is combined with the popular linear Predictive Coding method for pseudo-periodic signal processing. Subsequently,A novel Parallel Multiple Subsequence structure is presented for the efficient computation of Wavelet Transform. Case studies also presented to highlight the potential applications.

Modeling and Analysis of Some Heavy Tailed Time Series

The thesis has covered various aspects of modeling and analysis of finite mean time series with symmetric stable distributed innovations. Time series analysis based on Box and Jenkins methods are the most popular approaches where the models are linear and errors are Gaussian. We highlighted the limitations of classical time series analysis tools and explored some generalized tools and organized the approach parallel to the classical set up. In the present thesis we mainly studied the estimation and prediction of signal plus noise model. Here we assumed the signal and noise follow some models with symmetric stable innovations.We start the thesis with some motivating examples and application areas of alpha stable time series models. Classical time series analysis and corresponding theories based on finite variance models are extensively discussed in second chapter. We also surveyed the existing theories and methods correspond to infinite variance models in the same chapter. We present a linear filtering method for computing the filter weights assigned to the observation for estimating unobserved signal under general noisy environment in third chapter. Here we consider both the signal and the noise as stationary processes with infinite variance innovations. We derived semi infinite, double infinite and asymmetric signal extraction filters based on minimum dispersion criteria. Finite length filters based on Kalman-Levy filters are developed and identified the pattern of the filter weights. Simulation studies show that the proposed methods are competent enough in signal extraction for processes with infinite variance.Parameter estimation of autoregressive signals observed in a symmetric stable noise environment is discussed in fourth chapter. Here we used higher order Yule-Walker type estimation using auto-covariation function and exemplify the methods by simulation and application to Sea surface temperature data. We increased the number of Yule-Walker equations and proposed a ordinary least square estimate to the autoregressive parameters. Singularity problem of the auto-covariation matrix is addressed and derived a modified version of the Generalized Yule-Walker method using singular value decomposition.In fifth chapter of the thesis we introduced partial covariation function as a tool for stable time series analysis where covariance or partial covariance is ill defined. Asymptotic results of the partial auto-covariation is studied and its application in model identification of stable auto-regressive models are discussed. We generalize the Durbin-Levinson algorithm to include infinite variance models in terms of partial auto-covariation function and introduce a new information criteria for consistent order estimation of stable autoregressive model.In chapter six we explore the application of the techniques discussed in the previous chapter in signal processing. Frequency estimation of sinusoidal signal observed in symmetric stable noisy environment is discussed in this context. Here we introduced a parametric spectrum analysis and frequency estimate using power transfer function. Estimate of the power transfer function is obtained using the modified generalized Yule-Walker approach. Another important problem in statistical signal processing is to identify the number of sinusoidal components in an observed signal. We used a modified version of the proposed information criteria for this purpose.

Statistical signal extraction using stable processes

The standard models for statistical signal extraction assume that the signal and noise are generated by linear Gaussian processes. The optimum filter weights for those models are derived using the method of minimum mean square error. In the present work we study the properties of signal extraction models under the assumption that signal/noise are generated by symmetric stable processes. The optimum filter is obtained by the method of minimum dispersion. The performance of the new filter is compared with their Gaussian counterparts by simulation.