Model selection approaches for non-linear system identification: a review

The identification of non-linear systems using only observed finite datasets has become a mature research area over the last two decades. A class of linear-in-the-parameter models with universal approximation capabilities have been intensively studied and widely used due to the availability of many linear-learning algorithms and their inherent convergence conditions. This article presents a systematic overview of basic research on model selection approaches for linear-in-the-parameter models. One of the fundamental problems in non-linear system identification is to find the minimal model with the best model generalisation performance from observational data only. The important concepts in achieving good model generalisation used in various non-linear system-identification algorithms are first reviewed, including Bayesian parameter regularisation and models selective criteria based on the cross validation and experimental design. A significant advance in machine learning has been the development of the support vector machine as a means for identifying kernel models based on the structural risk minimisation principle. The developments on the convex optimisation-based model construction algorithms including the support vector regression algorithms are outlined. Input selection algorithms and on-line system identification algorithms are also included in this review. Finally, some industrial applications of non-linear models are discussed.

A study of factors contributing to late submission of course work

This case study uses log-linear modelling to investigate the interrelationships between factors that may contribute to the late submission of coursework by undergraduate students. A class of 86 computing students are considered. These students were exposed to traditional teaching methods supported by e-learning via a Managed Learning Environment (MLE). The MLE warehouses detailed data about student usage of the various areas of the environment, which can be used to interpret the approach taken to learning. The study investigates the interrelationship between these factors with the information as to whether the student handed in their course work on time or whether they were late. The results from the log-linear modelling technique show that there is an interaction between participating in Discussions within the MLE and the timely submission of course work, indicating that participants are more likely to hand in on time, than those students who do not participate.

e-learning services provision and management

With the rapid development of information technology, learners demand effective personalised learning support, which imposes a new learning paradigm in learning content management. Standards as well as best practice in industry and research community have taken place to address the paradigm shift. With respect to this trend, it is recognised that finding learning content which meet personal learning requirements remains challenging. This paper describes a model of e-learning services provision which integrates the best practice in e-learning and Web services technology so that learning content management is capable of supporting applications of learning services.

Nonlinear model structure design and construction using orthogonal least squares and D-optimality design

A very efficient learning algorithm for model subset selection is introduced based on a new composite cost function that simultaneously optimizes the model approximation ability and model robustness and adequacy. The derived model parameters are estimated via forward orthogonal least squares, but the model subset selection cost function includes a D-optimality design criterion that maximizes the determinant of the design matrix of the subset to ensure the model robustness, adequacy, and parsimony of the final model. The proposed approach is based on the forward orthogonal least square (OLS) algorithm, such that new D-optimality-based cost function is constructed based on the orthogonalization process to gain computational advantages and hence to maintain the inherent advantage of computational efficiency associated with the conventional forward OLS approach. Illustrative examples are included to demonstrate the effectiveness of the new approach.

Nonlinear model structure detection using optimum experimental design and orthogonal least squares

A very efficient learning algorithm for model subset selection is introduced based on a new composite cost function that simultaneously optimizes the model approximation ability and model adequacy. The derived model parameters are estimated via forward orthogonal least squares, but the subset selection cost function includes an A-optimality design criterion to minimize the variance of the parameter estimates that ensures the adequacy and parsimony of the final model. An illustrative example is included to demonstrate the effectiveness of the new approach.

Learning enhanced 3D models for vehicle tracking

This paper presents an enhanced hypothesis verification strategy for 3D object recognition. A new learning methodology is presented which integrates the traditional dichotomic object-centred and appearance-based representations in computer vision giving improved hypothesis verification under iconic matching. The "appearance" of a 3D object is learnt using an eigenspace representation obtained as it is tracked through a scene. The feature representation implicitly models the background and the objects observed enabling the segmentation of the objects from the background. The method is shown to enhance model-based tracking, particularly in the presence of clutter and occlusion, and to provide a basis for identification. The unified approach is discussed in the context of the traffic surveillance domain. The approach is demonstrated on real-world image sequences and compared to previous (edge-based) iconic evaluation techniques.

Multiscale evolving complex network model of functional connectivity in neuronal cultures

Cultures of cortical neurons grown on multielectrode arrays exhibit spontaneous, robust and recurrent patterns of highly synchronous activity called bursts. These bursts play a crucial role in the development and topological selforganization of neuronal networks. Thus, understanding the evolution of synchrony within these bursts could give insight into network growth and the functional processes involved in learning and memory. Functional connectivity networks can be constructed by observing patterns of synchrony that evolve during bursts. To capture this evolution, a modelling approach is adopted using a framework of emergent evolving complex networks and, through taking advantage of the multiple time scales of the system, aims to show the importance of sequential and ordered synchronization in network function.

Designing persuasive third party applications for social networking services based on the 3D-RAB model

The use of social networks services for promoting business, teaching, learning, persuasion and spread of information continues to attract attention as most social networking services (SNSs) now allow third party applications to operate on their sites. In the field of persuasive technology, the ability of SNSs to build relationships among their users and create momentum and enthusiasm through rapid cycles also give it a greater advantage over other persuasive technology approaches. In this paper we discuss the 3-dimensional relationship between attitude and behavior (3D-RAB) model, and demonstrate how it can be used in designing third-party persuasive applications in SNSs by considering external factors which affects persuasive strategies.

Functional model for catecholase-like activity: A mechanistic approach with manganese(III) complexes of salen type Schiff base ligands

Three new Mn(III) complexes [MnL1(OOCH)(OH2)] (1), [MnL2(OH2)(2)][Mn2L22(NO2)(3)] (2) and [Mn2L21(NO2)(2)] (3) (where H2L1 = H(2)Me(2)Salen = 2,7-bis(2-hydroxyphenyl)-2,6-diazaocta-2,6-diene and H2L2 = H(2)Salpn = 1,7-bis(2-hydroxyphenyl)-2,6-diazahepta-1,6-diene) have been synthesized. X-ray crystal structure analysis reveals that 1 is a mononuclear species whereas 2 contains a mononuclear cationic and a dinuclear nitrite bridged (mu-1 kappa O:2 kappa O') anionic unit. Complex 3 is a phenoxido bridged dimer containing terminally coordinated nitrite. Complexes 1-3 show excellent catecholase-like activity with 3,5-di-tert-butylcatechol (3,5-DTBC) as the substrate. Kinetic measurements suggest that the rate of catechol oxidation follows saturation kinetics with respect to the substrate and first order kinetics with respect to the catalyst. Formation of bis(mu-oxo)dimanganese(III,III) as an intermediate during the course of reaction is identified from ESI-MS spectra. The characteristic six line EPR spectra of complex 2 in the presence of 3,5-DTBC supports the formation of manganese(II)-semiquinonate as an intermediate species during the catalytic oxidation of 3,5-DTBC.

Associating spontaneous with evoked activity in a neural mass model of cat visual cortex

Spontaneous activity of the brain at rest frequently has been considered a mere backdrop to the salient activity evoked by external stimuli or tasks. However, the resting state of the brain consumes most of its energy budget, which suggests a far more important role. An intriguing hint comes from experimental observations of spontaneous activity patterns, which closely resemble those evoked by visual stimulation with oriented gratings, except that cortex appeared to cycle between different orientation maps. Moreover, patterns similar to those evoked by the behaviorally most relevant horizontal and vertical orientations occurred more often than those corresponding to oblique angles. We hypothesize that this kind of spontaneous activity develops at least to some degree autonomously, providing a dynamical reservoir of cortical states, which are then associated with visual stimuli through learning. To test this hypothesis, we use a biologically inspired neural mass model to simulate a patch of cat visual cortex. Spontaneous transitions between orientation states were induced by modest modifications of the neural connectivity, establishing a stable heteroclinic channel. Significantly, the experimentally observed greater frequency of states representing the behaviorally important horizontal and vertical orientations emerged spontaneously from these simulations. We then applied bar-shaped inputs to the model cortex and used Hebbian learning rules to modify the corresponding synaptic strengths. After unsupervised learning, different bar inputs reliably and exclusively evoked their associated orientation state; whereas in the absence of input, the model cortex resumed its spontaneous cycling. We conclude that the experimentally observed similarities between spontaneous and evoked activity in visual cortex can be explained as the outcome of a learning process that associates external stimuli with a preexisting reservoir of autonomous neural activity states. Our findings hence demonstrate how cortical connectivity can link the maintenance of spontaneous activity in the brain mechanistically to its core cognitive functions.

A unified neurofuzzy model for classification

This work proposes a unified neurofuzzy modelling scheme. To begin with, the initial fuzzy base construction method is based on fuzzy clustering utilising a Gaussian mixture model (GMM) combined with the analysis of covariance (ANOVA) decomposition in order to obtain more compact univariate and bivariate membership functions over the subspaces of the input features. The mean and covariance of the Gaussian membership functions are found by the expectation maximisation (EM) algorithm with the merit of revealing the underlying density distribution of system inputs. The resultant set of membership functions forms the basis of the generalised fuzzy model (GFM) inference engine. The model structure and parameters of this neurofuzzy model are identified via the supervised subspace orthogonal least square (OLS) learning. Finally, instead of providing deterministic class label as model output by convention, a logistic regression model is applied to present the classifier’s output, in which the sigmoid type of logistic transfer function scales the outputs of the neurofuzzy model to the class probability. Experimental validation results are presented to demonstrate the effectiveness of the proposed neurofuzzy modelling scheme.

Measuring student perception and actual usage of online learning management system

Online learning management systems are in use to facilitate the face to face learning process in many universities. There are many variables that shape and influence a student’s perception of an online learning management system. This study investigates whether there is a relationship between the perception of a student regarding the learning management system and their actual usage of such system. It is believed to help better understand the student usage of online learning management system. An online questionnaire was published on a course management system for a selected subject and the student participation was voluntary. Results indicate that no significant relationship between the perception students had about the learning management system and the actual use of the system. Interestingly, a significant relationship was found between having internet access away from university and the student perception about the system. Students who had internet access away from university had better perception about the learning management system even though there was no significant difference in the level of online learning management system usage between the groups.

The simulation of the opposing fluxes of latent heat and CO2 over various land-use types: coupling a gas exchange model to a mesoscale atmospheric model

A mesoscale meteorological model (FOOT3DK) is coupled with a gas exchange model to simulate surface fluxes of CO2 and H2O under field conditions. The gas exchange model consists of a C3 single leaf photosynthesis sub-model and an extended big leaf (sun/shade) sub-model that divides the canopy into sunlit and shaded fractions. Simulated CO2 fluxes of the stand-alone version of the gas exchange model correspond well to eddy-covariance measurements at a test site in a rural area in the west of Germany. The coupled FOOT3DK/gas exchange model is validated for the diurnal cycle at singular grid points, and delivers realistic fluxes with respect to their order of magnitude and to the general daily course. Compared to the Jarvis-based big leaf scheme, simulations of latent heat fluxes with a photosynthesis-based scheme for stomatal conductance are more realistic. As expected, flux averages are strongly influenced by the underlying land cover. While the simulated net ecosystem exchange is highly correlated with leaf area index, this correlation is much weaker for the latent heat flux. Photosynthetic CO2 uptake is associated with transpirational water loss via the stomata, and the resulting opposing surface fluxes of CO2 and H2O are reproduced with the model approach. Over vegetated surfaces it is shown that the coupling of a photosynthesis-based gas exchange model with the land-surface scheme of a mesoscale model results in more realistic simulated latent heat fluxes.

Still feeling it: the time course of emotional recovery from an attentional perspective

Emotional reactivity and the time taken to recover, particularly from negative, stressful, events, are inextricably linked, and both are crucial for maintaining well-being. It is unclear, however, to what extent emotional reactivity during stimulus onset predicts the time course of recovery after stimulus offset. To address this question, 25 participants viewed arousing (negative and positive) and neutral pictures from the International Affective Picture System (IAPS) followed by task-relevant face targets, which were to be gender categorized. Faces were presented early (400–1500 ms) or late (2400–3500 ms) after picture offset to capture the time course of recovery from emotional stimuli. Measures of reaction time (RT), as well as face-locked N170 and P3 components were taken as indicators of the impact of lingering emotion on attentional facilitation or interference. Electrophysiological effects revealed negative and positive images to facilitate face-target processing on the P3 component, regardless of temporal interval. At the individual level, increased reactivity to: (1) negative pictures, quantified as the IAPS picture-locked Late Positive Potential (LPP), predicted larger attentional interference on the face-locked P3 component to faces presented in the late time window after picture offset. (2) Positive pictures, denoted by the LPP, predicted larger facilitation on the face-locked P3 component to faces presented in the earlier time window after picture offset. These results suggest that subsequent processing is still impacted up to 3500 ms after the offset of negative pictures and 1500 ms after the offset of positive pictures for individuals reacting more strongly to these pictures, respectively. Such findings emphasize the importance of individual differences in reactivity when predicting the temporality of emotional recovery. The current experimental model provides a novel basis for future research aiming to identify profiles of adaptive and maladaptive recovery.

The future of bioscience fieldwork in UK higher education

Fieldwork is an important and often enjoyable part of learning in Bioscience degree courses, however it is unclear how the recent reforms to Higher Education (HE) may impact the future funding of outdoor learning. This paper reports on the findings from a recent survey of 30 HE Bioscience practitioners from across the UK. Their current level of fieldwork provision and factors affecting this provision in the future were explored. The data showed that the level of fieldwork had remained similar over the past five years and this was set to remain so over the next academic year and also into the next five years (when it may even increase). Funding of fieldwork was under review in most institutions due to the increase in student tuition fees and it was found that in some cases the cost of compulsory fieldwork will be subsumed within the overall course fee. Many influencing factors were discussed, but the most frequently raised topics were that of the development of employability skills during fieldwork and its importance in attracting and retaining students. Both topics are high on the agenda of HE institutions going forward into the new funding model, suggesting that fieldwork will remain a central part of the Bioscience curriculum.