Dynamic learning with the EM algorithm for neural networks

In this paper, we derive an EM algorithm for nonlinear state space models. We use it to estimate jointly the neural network weights, the model uncertainty and the noise in the data. In the E-step we apply a forwardbackward Rauch-Tung-Striebel smoother to compute the network weights. For the M-step, we derive expressions to compute the model uncertainty and the measurement noise. We find that the method is intrinsically very powerful, simple and stable.

Numerical simulation of the growth of ZnO nanostructures in a tube furnace by physical vapour deposition

Zinc oxide is a versatile II-VI naturally n-type semiconductor that exhibits piezoelectric properties. By controlling the growth kinetics during a simple carbothermal reduction process a wide range of 1D nanostructures such as nanowires, nanobelts, and nanotetrapods have been synthesized. The driving force: for the nanostructure growth is the Zn vapour supersaturation and supply rate which, if known, can be used to predict and explain the type of crystal structure that results. A model which attempts to determine the Zn vapour concentration as a function of position in the growth furnace is described. A numerical simulation package, COMSOL, was used to simultaneously model the effects of fluid flow, diffusion and heat transfer in a tube furnace made specifically for ZnO nanostructure growth. Parameters such as the temperature, pressure, and flow rate are used as inputs to the model to show the effect that each one has on the Zn concentration profile. An experimental parametric study of ZnO nanostructure growth was also conducted and compared to the model predictions for the Zn concentration in the tube. © 2008 Materials Research Society.

Bypass transition to sustained thermoacoustic oscillations in a linearly stable rijke tube

In this paper we examine triggering in a simple linearly-stable thermoacoustic system using techniques from flow instability and optimal control. Firstly, for a noiseless system, we find the initial states that have highest energy growth over given times and from given energies. Secondly, by varying the initial energy, we find the lowest energy that just triggers to a stable periodic solution. We show that the corresponding initial state grows first towards an unstable periodic solution and, from there, to the stable periodic solution. This exploits linear transient growth, which arises due to nonnormality in the governing equations and is directly analogous to bypass transition to turbulence. Thirdly, we introduce noise that has similar spectral characteristics to this initial state. We show that, when triggering from low noise levels, the system grows to high amplitude self-sustained oscillations by first growing towards the unstable periodic solution of the noiseless system. This helps to explain the experimental observation that linearly-stable systems can trigger to self-sustained oscillations even with low background noise. © 2010 by University of Cambridge. Published by the American Institute of Aeronautics and Astronautics, Inc.

Introduction to the development of an information management system for soil mix technology using artificial neural networks

This paper introduces current work in collating data from different projects using soil mix technology and establishing trends using artificial neural networks (ANNs). Variation in unconfined compressive strength as a function of selected soil mix variables (e.g., initial soil water content and binder dosage) is observed through the data compiled from completed and on-going soil mixing projects around the world. The potential and feasibility of ANNs in developing predictive models, which take into account a large number of variables, is discussed. The main objective of the work is the management and effective utilization of salient variables and the development of predictive models useful for soil mix technology design. Based on the observed success in the predictions made, this paper suggests that neural network analysis for the prediction of properties of soil mix systems is feasible. © ASCE 2011.

Transient growth and triggering in the horizontal Rijke tube Matthew

This theoretical paper examines a non-normal and non-linear model of a horizontal Rijke tube. Linear and non-linear optimal initial states, which maximize acoustic energy growth over a given time from a given energy, are calculated. It is found that non-linearity and non-normality both contribute to transient growth and that, for this model, linear optimal states are only a good predictor of non-linear optimal states for low initial energies. Two types of non-linear optimal initial state are found. The first has strong energy growth during the first period of the fundamental mode but loses energy thereafter. The second has weaker energy growth during the first period but retains high energy for longer. The second type causes triggering to self-sustained oscillations from lower energy than the first and has higher energy in the fundamental mode. This suggests, for instance, that low frequency noise will be more effective at causing triggering than high frequency noise.

TRANSIENT SCANNING ELECTRON BEAM ANNEALING METHODS USED TO STUDY DIFFUSION AND DEFECTS IN IMPLANTED SILICON.

Rapid thermal annealing of arsenic and boron difluoride implants, such as those used for source/drain regions in CMOS, has been carried out using a scanning electron beam annealer, as part of a study of transient diffusion effects. Three types of e-beam anneal have been performed, with peak temperatures in the range 900 -1200 degree C; the normal isothermal e-beam anneals, together with sub-second fast anneals and 'dual-pulse' anneals, in which the sample undergoes an isothermal pre-anneal followed by rapid heating to the required anneal temperature is less than 0. 5s. The diffusion occuring during these anneal cycles has been modelled using SPS-1D, an implant and diffusion modelling program developed by one of the authors. This has been modified to incorporate simulated temperature vs. time cycles for the anneals. Results are presented applying the usual equilibrium clustering model, a transient point-defect enhancement to the diffusivity proposed recently by Fair and a new dynamic clustering model for arsenic. Good agreement with SIMS measurements is obtained using the dynamic clustering model, without recourse to a transient defect model.

Ultra-structural defects cause low bone matrix stiffness despite high mineralization in osteogenesis imperfecta mice.

Bone is a complex material with a hierarchical multi-scale organization from the molecule to the organ scale. The genetic bone disease, osteogenesis imperfecta, is primarily caused by mutations in the collagen type I genes, resulting in bone fragility. Because the basis of the disease is molecular with ramifications at the whole bone level, it provides a platform for investigating the relationship between structure, composition, and mechanics throughout the hierarchy. Prior studies have individually shown that OI leads to: 1. increased bone mineralization, 2. decreased elastic modulus, and 3. smaller apatite crystal size. However, these have not been studied together and the mechanism for how mineral structure influences tissue mechanics has not been identified. This lack of understanding inhibits the development of more accurate models and therapies. To address this research gap, we used a mouse model of the disease (oim) to measure these outcomes together in order to propose an underlying mechanism for the changes in properties. Our main finding was that despite increased mineralization, oim bones have lower stiffness that may result from the poorly organized mineral matrix with significantly smaller, highly packed and disoriented apatite crystals. Using a composite framework, we interpret the lower oim bone matrix elasticity observed as the result of a change in the aspect ratio of apatite crystals and a disruption of the crystal connectivity.