Data based constructive identification - overcoming the curse of dimensionality

The modelling of a nonlinear stochastic dynamical processes from data involves solving the problems of data gathering, preprocessing, model architecture selection, learning or adaptation, parametric evaluation and model validation. For a given model architecture such as associative memory networks, a common problem in non-linear modelling is the problem of "the curse of dimensionality". A series of complementary data based constructive identification schemes, mainly based on but not limited to an operating point dependent fuzzy models, are introduced in this paper with the aim to overcome the curse of dimensionality. These include (i) a mixture of experts algorithm based on a forward constrained regression algorithm; (ii) an inherent parsimonious delaunay input space partition based piecewise local lineal modelling concept; (iii) a neurofuzzy model constructive approach based on forward orthogonal least squares and optimal experimental design and finally (iv) the neurofuzzy model construction algorithm based on basis functions that are Bézier Bernstein polynomial functions and the additive decomposition. Illustrative examples demonstrate their applicability, showing that the final major hurdle in data based modelling has almost been removed.

Impacts of pollution and climate change on ombrotrophic Sphagnum species in the UK: analysis of uncertainties in two empirical niche models

A significant challenge in the prediction of climate change impacts on ecosystems and biodiversity is quantifying the sources of uncertainty that emerge within and between different models. Statistical species niche models have grown in popularity, yet no single best technique has been identified reflecting differing performance in different situations. Our aim was to quantify uncertainties associated with the application of 2 complimentary modelling techniques. Generalised linear mixed models (GLMM) and generalised additive mixed models (GAMM) were used to model the realised niche of ombrotrophic Sphagnum species in British peatlands. These models were then used to predict changes in Sphagnum cover between 2020 and 2050 based on projections of climate change and atmospheric deposition of nitrogen and sulphur. Over 90% of the variation in the GLMM predictions was due to niche model parameter uncertainty, dropping to 14% for the GAMM. After having covaried out other factors, average variation in predicted values of Sphagnum cover across UK peatlands was the next largest source of variation (8% for the GLMM and 86% for the GAMM). The better performance of the GAMM needs to be weighed against its tendency to overfit the training data. While our niche models are only a first approximation, we used them to undertake a preliminary evaluation of the relative importance of climate change and nitrogen and sulphur deposition and the geographic locations of the largest expected changes in Sphagnum cover. Predicted changes in cover were all small (generally <1% in an average 4 m2 unit area) but also highly uncertain. Peatlands expected to be most affected by climate change in combination with atmospheric pollution were Dartmoor, Brecon Beacons and the western Lake District.

Optimal control of nonlinear differential algebraic equation systems

A novel iterative procedure is described for solving nonlinear optimal control problems subject to differential algebraic equations. The procedure iterates on an integrated modified linear quadratic model based problem with parameter updating in such a manner that the correct solution of the original non-linear problem is achieved. The resulting algorithm has a particular advantage in that the solution is achieved without the need to solve the differential algebraic equations . Convergence aspects are discussed and a simulation example is described which illustrates the performance of the technique. 1. Introduction When modelling industrial processes often the resulting equations consist of coupled differential and algebraic equations (DAEs). In many situations these equations are nonlinear and cannot readily be directly reduced to ordinary differential equations.

Predictive computed-torque control of a PUMA 560 manipulator robot

This paper describes the integration of constrained predictive control and computed-torque control, and its application on a six degree-of-freedom PUMA 560 manipulator arm. The real-time implementation was based on SIMULINK, with the predictive controller and the computed-torque control law implemented in the C programming language. The constrained predictive controller solved a quadratic programming problem at every sampling interval, which was as short as 10 ms, using a prediction horizon of 150 steps and an 18th order state space model.

The socioeconomics of food crop production and climate change vulnerability: a global scale quantitative analysis of how grain crops are sensitive to drought

Many studies warn that climate change may undermine global food security. Much work on this topic focuses on modelling crop-weather interactions but these models do not generally account for the ways in which socio-economic factors influence how harvests are affected by weather. To address this gap, this paper uses a quantitative harvest vulnerability index based on annual soil moisture and grain production data as the dependent variables in a Linear Mixed Effects model with national scale socio-economic data as independent variables for the period 1990-2005. Results show that rice, wheat and maize production in middle income countries were especially vulnerable to droughts. By contrast, harvests in countries with higher investments in agriculture (e.g higher amounts of fertilizer use) were less vulnerable to drought. In terms of differences between the world's major grain crops, factors that made rice and wheat crops vulnerable to drought were quite consistent, whilst those of maize crops varied considerably depending on the type of region. This is likely due to the fact that maize is produced under very different conditions worldwide. One recommendation for reducing drought vulnerability risks is coordinated development and adaptation policies, including institutional support that enables farmers to take proactive action.

When do export subsidies have a redistributional role?

If an export subsidy is efficient, that is, has a surplus-transfer role, then there exists an implicit function relating the optimal level of the subsidy to the income target in the agricultural sector. If an export subsidy is inefficient no such function exists. We show that dependence exists in large-export equilibrium, not in small-export equilibrium and show that these results remain robust to concerns about domestic tax distortions. The failure of previous work to produce this result stems from its neglect of the income constraint on producer surplus in the programming problem transferring surplusfrom consumersand taxpayers to farmers.

Non-replication of the association between 5HTTLPR and response to psychological therapy for child anxiety disorders

Background We previously reported an association between 5HTTLPR genotype and outcome following cognitive–behavioural therapy (CBT) in child anxiety (Cohort 1). Children homozygous for the low-expression short-allele showed more positive outcomes. Other similar studies have produced mixed results, with most reporting no association between genotype and CBT outcome. Aims To replicate the association between 5HTTLPR and CBT outcome in child anxiety from the Genes for Treatment study (GxT Cohort 2, n = 829). Method Logistic and linear mixed effects models were used to examine the relationship between 5HTTLPR and CBT outcomes. Mega-analyses using both cohorts were performed. Results There was no significant effect of 5HTTLPR on CBT outcomes in Cohort 2. Mega-analyses identified a significant association between 5HTTLPR and remission from all anxiety disorders at follow-up (odds ratio 0.45, P = 0.014), but not primary anxiety disorder outcomes. Conclusions The association between 5HTTLPR genotype and CBT outcome did not replicate. Short-allele homozygotes showed more positive treatment outcomes, but with small, non-significant effects. Future studies would benefit from utilising whole genome approaches and large, homogenous samples.

HPA axis related genes and response to psychological therapies: genetics and epigenetics

Background Hypothalamic–pituitary–adrenal (HPA) axis functioning has been implicated in the development of stress-related psychiatric diagnoses and response to adverse life experiences. This study aimed to investigate the association between genetic and epigenetics in HPA axis and response to cognitive behavior therapy (CBT). Methods Children with anxiety disorders were recruited into the Genes for Treatment project (GxT, N = 1,152). Polymorphisms of FKBP5 and GR were analyzed for association with response to CBT. Percentage DNA methylation at the FKBP5 and GR promoter regions was measured before and after CBT in a subset (n = 98). Linear mixed effect models were used to investigate the relationship between genotype, DNA methylation, and change in primary anxiety disorder severity (treatment response). Results Treatment response was not associated with FKBP5 and GR polymorphisms, or pretreatment percentage DNA methylation. However, change in FKBP5 DNA methylation was nominally significantly associated with treatment response. Participants who demonstrated the greatest reduction in severity decreased in percentage DNA methylation during treatment, whereas those with little/no reduction in severity increased in percentage DNA methylation. This effect was driven by those with one or more FKBP5 risk alleles, with no association seen in those with no FKBP5 risk alleles. No significant association was found between GR methylation and response. Conclusions Allele-specific change in FKBP5 methylation was associated with treatment response. This is the largest study to date investigating the role of HPA axis related genes in response to a psychological therapy. Furthermore, this is the first study to demonstrate that DNA methylation changes may be associated with response to psychological therapies in a genotype-dependent manner.

Genome-wide association study of response to cognitive behavioural therapy in children with anxiety disorders

Background Anxiety disorders are common, and cognitive–behavioural therapy (CBT) is a first-line treatment. Candidate gene studies have suggested a genetic basis to treatment response, but findings have been inconsistent. Aims To perform the first genome-wide association study (GWAS) of psychological treatment response in children with anxiety disorders (n = 980). Method Presence and severity of anxiety was assessed using semi-structured interview at baseline, on completion of treatment (post-treatment), and 3 to 12 months after treatment completion (follow-up). DNA was genotyped using the Illumina Human Core Exome-12v1.0 array. Linear mixed models were used to test associations between genetic variants and response (change in symptom severity) immediately post-treatment and at 6-month follow-up. Results No variants passed a genome-wide significance threshold (P = 5×10−8) in either analysis. Four variants met criteria for suggestive significance (P<5×10−6) in association with response post-treatment, and three variants in the 6-month follow-up analysis. Conclusions This is the first genome-wide therapygenetic study. It suggests no common variants of very high effect underlie response to CBT. Future investigations should maximise power to detect single-variant and polygenic effects by using larger, more homogeneous cohorts.

Assessing species’ habitat associations from occurrence records, standardised monitoring data and expert opinion: a test with British butterflies

Accurate knowledge of species’ habitat associations is important for conservation planning and policy. Assessing habitat associations is a vital precursor to selecting appropriate indicator species for prioritising sites for conservation or assessing trends in habitat quality. However, much existing knowledge is based on qualitative expert opinion or local scale studies, and may not remain accurate across different spatial scales or geographic locations. Data from biological recording schemes have the potential to provide objective measures of habitat association, with the ability to account for spatial variation. We used data on 50 British butterfly species as a test case to investigate the correspondence of data-derived measures of habitat association with expert opinion, from two different butterfly recording schemes. One scheme collected large quantities of occurrence data (c. 3 million records) and the other, lower quantities of standardised monitoring data (c. 1400 sites). We used general linear mixed effects models to derive scores of association with broad-leaf woodland for both datasets and compared them with scores canvassed from experts. Scores derived from occurrence and abundance data both showed strongly positive correlations with expert opinion. However, only for occurrence data did these fell within the range of correlations between experts. Data-derived scores showed regional spatial variation in the strength of butterfly associations with broad-leaf woodland, with a significant latitudinal trend in 26% of species. Sub-sampling of the data suggested a mean sample size of 5000 occurrence records per species to gain an accurate estimation of habitat association, although habitat specialists are likely to be readily detected using several hundred records. Occurrence data from recording schemes can thus provide easily obtained, objective, quantitative measures of habitat association.

Bayesian nonlinear regression models with scale mixtures of skew-normal distributions: Estimation and case influence diagnostics

The purpose of this paper is to develop a Bayesian analysis for nonlinear regression models under scale mixtures of skew-normal distributions. This novel class of models provides a useful generalization of the symmetrical nonlinear regression models since the error distributions cover both skewness and heavy-tailed distributions such as the skew-t, skew-slash and the skew-contaminated normal distributions. The main advantage of these class of distributions is that they have a nice hierarchical representation that allows the implementation of Markov chain Monte Carlo (MCMC) methods to simulate samples from the joint posterior distribution. In order to examine the robust aspects of this flexible class, against outlying and influential observations, we present a Bayesian case deletion influence diagnostics based on the Kullback-Leibler divergence. Further, some discussions on the model selection criteria are given. The newly developed procedures are illustrated considering two simulations study, and a real data previously analyzed under normal and skew-normal nonlinear regression models. (C) 2010 Elsevier B.V. All rights reserved.

Prediction in Multilevel Logistic Regression

The purpose of this article is to present a new method to predict the response variable of an observation in a new cluster for a multilevel logistic regression. The central idea is based on the empirical best estimator for the random effect. Two estimation methods for multilevel model are compared: penalized quasi-likelihood and Gauss-Hermite quadrature. The performance measures for the prediction of the probability for a new cluster observation of the multilevel logistic model in comparison with the usual logistic model are examined through simulations and an application.

Self-reported symptoms and motor tests via telemetry in a 36-month levodopa-carbidopa intestinal gel infusion trial

Objective To investigate if a home environment test battery can be used to measure effects of Parkinson’s disease (PD) treatment intervention and disease progression. Background Seventy-seven patients diagnosed with advanced PD were recruited in an open longitudinal 36-month study at 10 clinics in Sweden and Norway; 40 of them were treated with levodopa-carbidopa intestinal gel (LCIG) and 37 patients were candidates for switching from oral PD treatment to LCIG. They utilized a mobile device test battery, consisting of self-assessments of symptoms and objective measures of motor function through a set of fine motor tests (tapping and spiral drawings), in their homes. Both the LCIG-naïve and LCIG-non-naïve patients used the test battery four times per day during week-long test periods. Methods Assessments The LCIG-naïve patients used the test battery at baseline (before LCIG), month 0 (first visit; at least 3 months after intraduodenal LCIG), and thereafter quarterly for the first year and biannually for the second and third years. The LCIG-non-naïve patients used the test battery from the first visit, i.e. month 0. Out of the 77 patients, only 65 utilized the test battery; 35 were LCIG-non-naïve and 30 LCIG-naïve. In 20 of the LCIG-naïve patients, assessments with the test battery were available during oral treatment and at least one test period after having started infusion treatment. Three LCIG-naïve patients did not use the test battery at baseline but had at least one test period of assessments thereafter. Hence, n=23 in the LCIG-naïve group. In total, symptom assessments in the full sample (including both patient groups) were collected during 379 test periods and 10079 test occasions. For 369 of these test periods, clinical assessments including UPDRS and PDQ-39 were performed in afternoons at the start of the test periods. The repeated measurements of the test battery were processed and summarized into scores representing patients’ symptom severities over a test period, using statistical methods. Six conceptual dimensions were defined; four subjectively-reported: ‘walking’, ‘satisfied’, ‘dyskinesia’, and ‘off’ and two objectively-measured: ‘tapping’ and ‘spiral’. In addition, an ‘overall test score’ (OTS) was defined to represent the global health condition of the patient during a test period. Statistical methods Change in the test battery scores over time, that is at baseline and follow-up test periods, was assessed with linear mixed-effects models with patient ID as a random effect and test period as a fixed effect of interest. The within-patient variability of OTS was assessed using intra-class correlation coefficient (ICC), for the two patient groups. Correlations between clinical rating scores and test battery scores were assessed using Spearman’s rank correlations (rho). Results In LCIG-naïve patients, mean OTS compared to baseline was significantly improved from the first test period on LCIG treatment until month 24. However, there were no significant changes in mean OTS scores of LCIG-non-naïve patients, except for worse mean OTS at month 36 (p<0.01, n=16). The mean scores of all subjectively-reported dimensions improved significantly throughout the course of the study, except ‘walking’ at month 36 (p=0.41, n=4). However, there were no significant differences in mean scores of objectively-measured dimensions between baseline and other test periods, except improved ‘tapping’ at month 6 and month 36, and ‘spiral’ at month 3 (p<0.05). The LCIG-naïve patients had a higher within-subject variability in their OTS scores (ICC=0.67) compared to LCIG-non-naïve patients (ICC=0.71). The OTS correlated adequately with total UPDRS (rho=0.59) and total PDQ-39 (rho=0.59). Conclusions In this 3-year follow-up study of advanced PD patients treated with LCIG we found that it is possible to monitor PD progression over time using a home environment test battery. The significant improvements in the mean OTS scores indicate that the test battery is able to measure functional improvement with LCIG sustained over at least 24 months.

Novel Statistical Methods in Quantitative Genetics : Modeling Genetic Variance for Quantitative Trait Loci Mapping and Genomic Evaluation

This thesis develops and evaluates statistical methods for different types of genetic analyses, including quantitative trait loci (QTL) analysis, genome-wide association study (GWAS), and genomic evaluation. The main contribution of the thesis is to provide novel insights in modeling genetic variance, especially via random effects models. In variance component QTL analysis, a full likelihood model accounting for uncertainty in the identity-by-descent (IBD) matrix was developed. It was found to be able to correctly adjust the bias in genetic variance component estimation and gain power in QTL mapping in terms of precision.  Double hierarchical generalized linear models, and a non-iterative simplified version, were implemented and applied to fit data of an entire genome. These whole genome models were shown to have good performance in both QTL mapping and genomic prediction. A re-analysis of a publicly available GWAS data set identified significant loci in Arabidopsis that control phenotypic variance instead of mean, which validated the idea of variance-controlling genes.  The works in the thesis are accompanied by R packages available online, including a general statistical tool for fitting random effects models (hglm), an efficient generalized ridge regression for high-dimensional data (bigRR), a double-layer mixed model for genomic data analysis (iQTL), a stochastic IBD matrix calculator (MCIBD), a computational interface for QTL mapping (qtl.outbred), and a GWAS analysis tool for mapping variance-controlling loci (vGWAS).

Digital spiral analysis for objective assessment of fine motor timing variability in Parkinson's disease

OBJECTIVES: To develop a method for objective assessment of fine motor timing variability in Parkinson’s disease (PD) patients, using digital spiral data gathered by a touch screen device. BACKGROUND: A retrospective analysis was conducted on data from 105 subjects including65 patients with advanced PD (group A), 15 intermediate patients experiencing motor fluctuations (group I), 15 early stage patients (group S), and 10 healthy elderly subjects (HE) were examined. The subjects were asked to perform repeated upper limb motor tasks by tracing a pre-drawn Archimedes spiral as shown on the screen of the device. The spiral tracing test was performed using an ergonomic pen stylus, using dominant hand. The test was repeated three times per test occasion and the subjects were instructed to complete it within 10 seconds. Digital spiral data including stylus position (x-ycoordinates) and timestamps (milliseconds) were collected and used in subsequent analysis. The total number of observations with the test battery were as follows: Swedish group (n=10079), Italian I group (n=822), Italian S group (n = 811), and HE (n=299). METHODS: The raw spiral data were processed with three data processing methods. To quantify motor timing variability during spiral drawing tasks Approximate Entropy (APEN) method was applied on digitized spiral data. APEN is designed to capture the amount of irregularity or complexity in time series. APEN requires determination of two parameters, namely, the window size and similarity measure. In our work and after experimentation, window size was set to 4 and similarity measure to 0.2 (20% of the standard deviation of the time series). The final score obtained by APEN was normalized by total drawing completion time and used in subsequent analysis. The score generated by this method is hence on denoted APEN. In addition, two more methods were applied on digital spiral data and their scores were used in subsequent analysis. The first method was based on Digital Wavelet Transform and Principal Component Analysis and generated a score representing spiral drawing impairment. The score generated by this method is hence on denoted WAV. The second method was based on standard deviation of frequency filtered drawing velocity. The score generated by this method is hence on denoted SDDV. Linear mixed-effects (LME) models were used to evaluate mean differences of the spiral scores of the three methods across the four subject groups. Test-retest reliability of the three scores was assessed after taking mean of the three possible correlations (Spearman’s rank coefficients) between the three test trials. Internal consistency of the methods was assessed by calculating correlations between their scores. RESULTS: When comparing mean spiral scores between the four subject groups, the APEN scores were different between HE subjects and three patient groups (P=0.626 for S group with 9.9% mean value difference, P=0.089 for I group with 30.2%, and P=0.0019 for A group with 44.1%). However, there were no significant differences in mean scores of the other two methods, except for the WAV between the HE and A groups (P<0.001). WAV and SDDV were highly and significantly correlated to each other with a coefficient of 0.69. However, APEN was not correlated to neither WAV nor SDDV with coefficients of 0.11 and 0.12, respectively. Test-retest reliability coefficients of the three scores were as follows: APEN (0.9), WAV(0.83) and SD-DV (0.55). CONCLUSIONS: The results show that the digital spiral analysis-based objective APEN measure is able to significantly differentiate the healthy subjects from patients at advanced level. In contrast to the other two methods (WAV and SDDV) that are designed to quantify dyskinesias (over-medications), this method can be useful for characterizing Off symptoms in PD. The APEN was not correlated to none of the other two methods indicating that it measures a different construct of upper limb motor function in PD patients than WAV and SDDV. The APEN also had a better test-retest reliability indicating that it is more stable and consistent over time than WAV and SDDV.