A gray-box neural network-based model identification and fault estimation scheme for nonlinear dynamic systems

A novel gray-box neural network model (GBNNM), including multi-layer perception (MLP) neural network (NN) and integrators, is proposed for a model identification and fault estimation (MIFE) scheme. With the GBNNM, both the nonlinearity and dynamics of a class of nonlinear dynamic systems can be approximated. Unlike previous NN-based model identification methods, the GBNNM directly inherits system dynamics and separately models system nonlinearities. This model corresponds well with the object system and is easy to build. The GBNNM is embedded online as a normal model reference to obtain the quantitative residual between the object system output and the GBNNM output. This residual can accurately indicate the fault offset value, so it is suitable for differing fault severities. To further estimate the fault parameters (FPs), an improved extended state observer (ESO) using the same NNs (IESONN) from the GBNNM is proposed to avoid requiring the knowledge of ESO nonlinearity. Then, the proposed MIFE scheme is applied for reaction wheels (RW) in a satellite attitude control system (SACS). The scheme using the GBNNM is compared with other NNs in the same fault scenario, and several partial loss of effect (LOE) faults with different severities are considered to validate the effectiveness of the FP estimation and its superiority.

Prediction of thermal expansion properties of carbon nanotubes using molecular dynamics simulations

The axial coefficients of thermal expansion (CTE) of various carbon nanotubes (CNTs), i.e., single-wall carbon nanotubes (SWCNTs), and some multi-wall carbon nanotubes (MWCNTs), were predicted using molecular dynamics (MDs) simulations. The effects of two parameters, i.e., temperature and the CNT diameter, on CTE were investigated extensively. For all SWCNTs and MWCNTs, the obtained results clearly revealed that within a wide low temperature range, their axial CTEs are negative. As the diameter of CNTs decreases, this temperature range for negative axial CTEs becomes narrow, and positive axial CTEs appear in high temperature range. It was found that the axial CTEs vary nonlinearly with the temperature, however, they decrease linearly as the CNT diameter increases. Moreover, within a wide temperature range, a set of empirical formulations was proposed for evaluating the axial CTEs of armchair and zigzag SWCNTs using the above two parameters. Finally, it was found that the absolute value of the negative axial CTE of any MWCNT is much smaller than those of its constituent SWCNTs, and the average value of the CTEs of its constituent SWCNTs. The present fundamental study is very important for understanding the thermal behaviors of CNTs in such as nanocomposite temperature sensors, or nanoelectronics devices using CNTs.

Building macroscale models from microscale probabilistic models : a general probabilistic approach for nonlinear diffusion and multispecies phenomena

A discrete agent-based model on a periodic lattice of arbitrary dimension is considered. Agents move to nearest-neighbor sites by a motility mechanism accounting for general interactions, which may include volume exclusion. The partial differential equation describing the average occupancy of the agent population is derived systematically. A diffusion equation arises for all types of interactions and is nonlinear except for the simplest interactions. In addition, multiple species of interacting subpopulations give rise to an advection-diffusion equation for each subpopulation. This work extends and generalizes previous specific results, providing a construction method for determining the transport coefficients in terms of a single conditional transition probability, which depends on the occupancy of sites in an influence region. These coefficients characterize the diffusion of agents in a crowded environment in biological and physical processes.

Learned stochastic mobility prediction for planning with control uncertainty on unstructured terrain

Motion planning for planetary rovers must consider control uncertainty in order to maintain the safety of the platform during navigation. Modelling such control uncertainty is difficult due to the complex interaction between the platform and its environment. In this paper, we propose a motion planning approach whereby the outcome of control actions is learned from experience and represented statistically using a Gaussian process regression model. This mobility prediction model is trained using sample executions of motion primitives on representative terrain, and predicts the future outcome of control actions on similar terrain. Using Gaussian process regression allows us to exploit its inherent measure of prediction uncertainty in planning. We integrate mobility prediction into a Markov decision process framework and use dynamic programming to construct a control policy for navigation to a goal region in a terrain map built using an on-board depth sensor. We consider both rigid terrain, consisting of uneven ground, small rocks, and non-traversable rocks, and also deformable terrain. We introduce two methods for training the mobility prediction model from either proprioceptive or exteroceptive observations, and report results from nearly 300 experimental trials using a planetary rover platform in a Mars-analogue environment. Our results validate the approach and demonstrate the value of planning under uncertainty for safe and reliable navigation.

A non-linear interface element model for thin layer high adhesive mortared masonry

A nonlinear interface element modelling method is formulated for the prediction of deformation and failure of high adhesive thin layer polymer mortared masonry exhibiting failure of units and mortar. Plastic flow vectors are explicitly integrated within the implicit finite element framework instead of relying on predictor–corrector like approaches. The method is calibrated using experimental data from uniaxial compression, shear triplet and flexural beam tests. The model is validated using a thin layer mortared masonry shear wall, whose experimental datasets are reported in the literature and is used to examine the behaviour of thin layer mortared masonry under biaxial loading.

Corporate credit risk prediction under stochastic volatility and jumps

This paper examines the impact of allowing for stochastic volatility and jumps (SVJ) in a structural model on corporate credit risk prediction. The results from a simulation study verify the better performance of the SVJ model compared with the commonly used Merton model, and three sources are provided to explain the superiority. The empirical analysis on two real samples further ascertains the importance of recognizing the stochastic volatility and jumps by showing that the SVJ model decreases bias in spread prediction from the Merton model, and better explains the time variation in actual CDS spreads. The improvements are found particularly apparent in small firms or when the market is turbulent such as the recent financial crisis.

Frequency-motivated observer design for the prediction of parametric roll resonance control applications in marine systems

This work deals with estimators for predicting when parametric roll resonance is going to occur in surface vessels. The roll angle of the vessel is modeled as a second-order linear oscillatory system with unknown parameters. Several algorithms are used to estimate the parameters and eigenvalues of the system based on data gathered experimentally on a 1:45 scale model of a tanker. Based on the estimated eigenvalues, the system predicts whether or not parametric roll occurred. A prediction accuracy of 100% is achieved for regular waves, and up to 87.5% for irregular waves.

Design of a nonlinear excitation controller using inverse filtering for transient stability enhancement

This paper proposes a nonlinear excitation controller to improve transient stability, oscillation damping and voltage regulation of the power system. The energy function of the predicted system states is used to obtain the desired flux for the next time step, which in turn is used to obtain a supplementary control input using an inverse filtering method. The inverse filtering technique enables the system to provide an additional input for the excitation system, which forces the system to track the desired flux. Synchronous generator flux saturation model is used in this paper. A single machine infinite bus (SMIB) test system is used to demonstrate the efficacy of the proposed control method using time-domain simulations. The robustness of the controller is assessed under different operating conditions.

Natural ventilation heuristics in high-rise residential buildings : evaluation and prediction

Complex behaviour of air flow in the buildings makes it difficult to predict. Consequently, architects use common strategies for designing buildings with adequate natural ventilation. However, each climate needs specific strategies and there are not many heuristics for subtropical climate in literature. Furthermore, most of these common strategies are based on low-rise buildings and their performance for high-rise buildings might be different due to the increase of the wind speed with increase in the height. This study uses Computational Fluid Dynamics (CFD) to evaluate these rules of thumb for natural ventilation for multi-residential buildings in subtropical climate. Four design proposals for multi-residential towers with natural ventilation which were produced in intensive two days charrette were evaluated using CFD. The results show that all the buildings reach acceptable level of wind speed in living areas and poor amount of air flow in sleeping areas.

Prediction of activity type in preschool children using machine learning techniques

Objectives Recent research has shown that machine learning techniques can accurately predict activity classes from accelerometer data in adolescents and adults. The purpose of this study is to develop and test machine learning models for predicting activity type in preschool-aged children. Design Participants completed 12 standardised activity trials (TV, reading, tablet game, quiet play, art, treasure hunt, cleaning up, active game, obstacle course, bicycle riding) over two laboratory visits. Methods Eleven children aged 3–6 years (mean age = 4.8 ± 0.87; 55% girls) completed the activity trials while wearing an ActiGraph GT3X+ accelerometer on the right hip. Activities were categorised into five activity classes: sedentary activities, light activities, moderate to vigorous activities, walking, and running. A standard feed-forward Artificial Neural Network and a Deep Learning Ensemble Network were trained on features in the accelerometer data used in previous investigations (10th, 25th, 50th, 75th and 90th percentiles and the lag-one autocorrelation). Results Overall recognition accuracy for the standard feed forward Artificial Neural Network was 69.7%. Recognition accuracy for sedentary activities, light activities and games, moderate-to-vigorous activities, walking, and running was 82%, 79%, 64%, 36% and 46%, respectively. In comparison, overall recognition accuracy for the Deep Learning Ensemble Network was 82.6%. For sedentary activities, light activities and games, moderate-to-vigorous activities, walking, and running recognition accuracy was 84%, 91%, 79%, 73% and 73%, respectively. Conclusions Ensemble machine learning approaches such as Deep Learning Ensemble Network can accurately predict activity type from accelerometer data in preschool children.

The BAD project: data mining, database and prediction of protein adsorption on surfaces

Protein adsorption at solid-liquid interfaces is critical to many applications, including biomaterials, protein microarrays and lab-on-a-chip devices. Despite this general interest, and a large amount of research in the last half a century, protein adsorption cannot be predicted with an engineering level, design-orientated accuracy. Here we describe a Biomolecular Adsorption Database (BAD), freely available online, which archives the published protein adsorption data. Piecewise linear regression with breakpoint applied to the data in the BAD suggests that the input variables to protein adsorption, i.e., protein concentration in solution; protein descriptors derived from primary structure (number of residues, global protein hydrophobicity and range of amino acid hydrophobicity, isoelectric point); surface descriptors (contact angle); and fluid environment descriptors (pH, ionic strength), correlate well with the output variable-the protein concentration on the surface. Furthermore, neural network analysis revealed that the size of the BAD makes it sufficiently representative, with a neural network-based predictive error of 5% or less. Interestingly, a consistently better fit is obtained if the BAD is divided in two separate sub-sets representing protein adsorption on hydrophilic and hydrophobic surfaces, respectively. Based on these findings, selected entries from the BAD have been used to construct neural network-based estimation routines, which predict the amount of adsorbed protein, the thickness of the adsorbed layer and the surface tension of the protein-covered surface. While the BAD is of general interest, the prediction of the thickness and the surface tension of the protein-covered layers are of particular relevance to the design of microfluidics devices.