The modified Kanerva model for automatic speech recognition

A parallel processing network derived from Kanerva's associative memory theory Kanerva 1984 is shown to be able to train rapidly on connected speech data and recognize further speech data with a label error rate of 0·68%. This modified Kanerva model can be trained substantially faster than other networks with comparable pattern discrimination properties. Kanerva presented his theory of a self-propagating search in 1984, and showed theoretically that large-scale versions of his model would have powerful pattern matching properties. This paper describes how the design for the modified Kanerva model is derived from Kanerva's original theory. Several designs are tested to discover which form may be implemented fastest while still maintaining versatile recognition performance. A method is developed to deal with the time varying nature of the speech signal by recognizing static patterns together with a fixed quantity of contextual information. In order to recognize speech features in different contexts it is necessary for a network to be able to model disjoint pattern classes. This type of modelling cannot be performed by a single layer of links. Network research was once held back by the inability of single-layer networks to solve this sort of problem, and the lack of a training algorithm for multi-layer networks. Rumelhart, Hinton & Williams 1985 provided one solution by demonstrating the "back propagation" training algorithm for multi-layer networks. A second alternative is used in the modified Kanerva model. A non-linear fixed transformation maps the pattern space into a space of higher dimensionality in which the speech features are linearly separable. A single-layer network may then be used to perform the recognition. The advantage of this solution over the other using multi-layer networks lies in the greater power and speed of the single-layer network training algorithm. © 1989.

Numerical simulations of unsteady wet steam flows with non-equilibrium condensation in the nozzle and the steam turbine

Numerical techniques for non-equilibrium condensing flows are presented. Conservation equations for homogeneous gas-liquid two-phase compressible flows are solved by using a finite volume method based on an approximate Riemann solver. The phase change consists of the homogeneous nucleation and growth of existing droplets. Nucleation is computed with the classical Volmer-Frenkel model, corrected for the influence of the droplet temperature being higher than the steam temperature due to latent heat release. For droplet growth, two types of heat transfer model between droplets and the surrounding steam are used: a free molecular flow model and a semi-empirical two-layer model which is deemed to be valid over a wide range of Knudsen number. The computed pressure distribution and Sauter mean droplet diameters in a convergent-divergent (Laval) nozzle are compared with experimental data. Both droplet growth models capture qualitatively the pressure increases due to sudden heat release by the non-equilibrium condensation. However the agreement between computed and experimental pressure distributions is better for the two-layer model. The droplet diameter calculated by this model also agrees well with the experimental value, whereas that predicted by the free molecular model is too small. Condensing flows in a steam turbine cascade are calculated at different Mach numbers and inlet superheat conditions and are compared with experiments. Static pressure traverses downstream from the blade and pressure distributions on the blade surface agree well with experimental results in all cases. Once again, droplet diameters computed with the two-layer model give best agreement with the experiments. Droplet sizes are found to vary across the blade pitch due to the significant variation in expansion rate. Flow patterns including oblique shock waves and condensation-induced pressure increases are also presented and are similar to those shown in the experimental Schlieren photographs. Finally, calculations are presented for periodically unsteady condensing flows in a low expansion rate, convergent-divergent (Laval) nozzle. Depending on the inlet stagnation subcooling, two types of self-excited oscillations appear: a symmetric mode at lower inlet subcooling and an asymmetric mode at higher subcooling. Plots of oscillation frequency versus inlet sub-cooling exhibit a hysteresis loop, in accord with observations made by other researchers for moist air flow. Copyright © 2006 by ASME.

Comparison of stabilised/solidified mixes of model drill cuttings based on the North Sea and Red Sea Areas

Following the global stringent legislations regulating the wastes generated from the drilling process of oil exploration and production activities, the management of hazardous drill cuttings has become one of the pressing needs confronting the petroleum industry. Most of the prevalent treatment techniques adopted by oil companies are extremely expensive and/or the treated product has to be landfilled without any potential end-use; thereby rendering these solutions unsustainable. The technique of stabilisation/solidification is being investigated in this research to treat drill cuttings prior to landfilling or for potential re-use in construction products. Two case studies were explored namely North Sea and Red Sea. Given the known difficulties with stabilising/solidifying oils and chlorides, this research made use of model drill cutting mixes based on typical drill cutting from the two case studies, which contained 4.2% and 10.95% average concentrations of hydrocarbons; and 2.03% and 2.13% of chlorides, by weight respectively. A number of different binders, including a range of conventional viz. Portland cement (PC) as well as less-conventional viz. zeolite, or waste binders viz. cement kiln dust (CKD), fly ash and compost were tested to assess their ability to treat the North Sea and Red Sea model drill cuttings. The dry binder content by weight was 10%, 20% and 30%. In addition, raw drill cuttings from one of the North Sea offshore rigs were stabilised/solidified using 30% PC. The characteristics of the final stabilised/solidified product were finally compared to those of thermally treated cuttings. The effectiveness of the treatment using the different binder systems was compared in the light of the aforementioned two contaminants only. A set of physical tests (unconfined compressive strength (UCS)), chemical tests (NRA leachability) and micro-structural examinations (using scanning electron microscopy (SEM), and X-ray diffraction (XRD)) were used to evaluate the relative performance of the different binder mixes in treating the drill cuttings. The results showed that the observed UCS covered a wide range of values indicating various feasible end-use scenarios for the treated cuttings within the construction industry. The teachability results showed the reduction of the model drill cuttings to a stable non-reactive hazardous waste, compliant with the UK acceptance criteria for non-hazardous landfills: (a) by most of the 30% and 20% binders for chloride concentrations, and (b) by the 20% and 30% of compost-PC and CKD-PC binders for the Red Sea cuttings. The 20% and 30% compost-PC and CKD-PC binders successfully reduced the leached oil concentration of the North Sea cuttings to inert levels. Copyright 2007, Society of Petroleum Engineers.

Hafnia nanoparticles - a model system for graphene growth on a dielectric

We study graphene growth on hafnia (HfO2) nanoparticles by chemical vapour deposition using optical microscopy, high resolution transmission electron microscopy and Raman spectroscopy. We find that monoclinic HfO2 nanoparticles neither reduce to a metal nor form a carbide while nucleating nanometer domain-sized few layer graphene. Hence we regard this as an interesting non-metallic catalyst model system with the potential to explore graphene growth directly on a (high-k) dielectric. HfO2 nanoparticles coated with few layer graphene by atmospheric pressure CVD with methane and hydrogen at 950 °C. (© 2011 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim) Graphene growth on hafnia (HfO2) nanoparticles by chemical vapour deposition (CVD) is studied. It is found that monoclinic HfO2 nanoparticles neither reduce to a metal nor form a carbide while nucleating nanometer domain-sized few layer graphene. Hence the authors of this Letter regard this as an interesting non-metallic catalyst model system with the potential to explore graphene growth directly on a (high-k) dielectric. © 2011 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Multiple pitch estimation using non-homogeneous poisson processes

Novel statistical models are proposed and developed in this paper for automated multiple-pitch estimation problems. Point estimates of the parameters of partial frequencies of a musical note are modeled as realizations from a non-homogeneous Poisson process defined on the frequency axis. When several notes are combined, the processes for the individual notes combine to give a new Poisson process whose likelihood is easy to compute. This model avoids the data-association step of linking the harmonics of each note with the corresponding partials and is ideal for efficient Bayesian inference of unknown multiple fundamental frequencies in a signal. © 2011 IEEE.

Energy scattering in weakly non-linear systems.

The Chinese Tam-Tam exhibits non-linear behavior in its vibro-acoustic response. The frequency content of the response during free, unforced vibration smoothly changes, with energy being progressively smeared out over a greater bandwidth with time. This is used as a motivating case for the general study of the phenomenon of energy cascading through weak nonlinearity. Numerical models based upon the Fermi-Pasta-Ulam system of non-linearly coupled oscillators, modified with the addition of damping, have been developed. These were used to study the response of ensembles of systems with randomized natural frequencies. Results from simulations will be presented here. For un-damped systems, individual ensemble members exhibit cyclical energy exchange between linear modes, but the ensemble average displays a steady state. For the ensemble response of damped systems, lightly damped modes can exhibit an effective damping which is higher than predicated by linear theory. The presence of a non-linearity provides a path for energy flow to other modes, increasing the apparent damping spectrum at some frequencies and reducing it at others. The target of this work is a model revealing the governing parameters of a generic system of this type and leading to predictions of the ensemble response.

Application of the fixed point method for solution in time stepping finite element analysis using the inverse vector Jiles-Atherton model

An implementation of the inverse vector Jiles-Atherton model for the solution of non-linear hysteretic finite element problems is presented. The implementation applies the fixed point method with differential reluctivity values obtained from the Jiles-Atherton model. Differential reluctivities are usually computed using numerical differentiation, which is ill-posed and amplifies small perturbations causing large sudden increases or decreases of differential reluctivity values, which may cause numerical problems. A rule based algorithm for conditioning differential reluctivity values is presented. Unwanted perturbations on the computed differential reluctivity values are eliminated or reduced with the aim to guarantee convergence. Details of the algorithm are presented together with an evaluation of the algorithm by a numerical example. The algorithm is shown to guarantee convergence, although the rate of convergence depends on the choice of algorithm parameters. © 2011 IEEE.

Maze model to study spatial learning and memory in freely moving monkeys

Many types of mazes have been used in cognitive brain research and data obtained from those experiments, especially those from rodents' studies, support the idea that the hippocampus is related to spatial learning and memory. But the results from non-huma

Convex approaches to model wavelet sparsity patterns

Statistical dependencies among wavelet coefficients are commonly represented by graphical models such as hidden Markov trees (HMTs). However, in linear inverse problems such as deconvolution, tomography, and compressed sensing, the presence of a sensing or observation matrix produces a linear mixing of the simple Markovian dependency structure. This leads to reconstruction problems that are non-convex optimizations. Past work has dealt with this issue by resorting to greedy or suboptimal iterative reconstruction methods. In this paper, we propose new modeling approaches based on group-sparsity penalties that leads to convex optimizations that can be solved exactly and efficiently. We show that the methods we develop perform significantly better in de-convolution and compressed sensing applications, while being as computationally efficient as standard coefficient-wise approaches such as lasso. © 2011 IEEE.

Screening of healthcare workers for tuberculosis: development and validation of a new health economic model to inform practice

Methods for determining cost-effectiveness of different treatments are well established, unlike appraisal of non-drug interventions, including novel diagnostics and biomarkers.

Content Based Integration of Construction Site Images in AEC/FM Model Based Systems

The Architecture, Engineering, Construction and Facilities Management (AEC/FM) industry is rapidly becoming a multidisciplinary, multinational and multi-billion dollar economy, involving large numbers of actors working concurrently at different locations and using heterogeneous software and hardware technologies. Since the beginning of the last decade, a great deal of effort has been spent within the field of construction IT in order to integrate data and information from most computer tools used to carry out engineering projects. For this purpose, a number of integration models have been developed, like web-centric systems and construction project modeling, a useful approach in representing construction projects and integrating data from various civil engineering applications. In the modern, distributed and dynamic construction environment it is important to retrieve and exchange information from different sources and in different data formats in order to improve the processes supported by these systems. Previous research demonstrated that a major hurdle in AEC/FM data integration in such systems is caused by its variety of data types and that a significant part of the data is stored in semi-structured or unstructured formats. Therefore, new integrative approaches are needed to handle non-structured data types like images and text files. This research is focused on the integration of construction site images. These images are a significant part of the construction documentation with thousands stored in site photographs logs of large scale projects. However, locating and identifying such data needed for the important decision making processes is a very hard and time-consuming task, while so far, there are no automated methods for associating them with other related objects. Therefore, automated methods for the integration of construction images are important for construction information management. During this research, processes for retrieval, classification, and integration of construction images in AEC/FM model based systems have been explored. Specifically, a combination of techniques from the areas of image and video processing, computer vision, information retrieval, statistics and content-based image and video retrieval have been deployed in order to develop a methodology for the retrieval of related construction site image data from components of a project model. This method has been tested on available construction site images from a variety of sources like past and current building construction and transportation projects and is able to automatically classify, store, integrate and retrieve image data files in inter-organizational systems so as to allow their usage in project management related tasks.

Modelling non-linearities in a MEMS square wave oscillator

The modelling of the non-linear behaviour of MEMS oscillators is of interest to understand the effects of non-linearities on start-up, limit cycle behaviour and performance metrics such as output frequency and phase noise. This paper proposes an approach to integrate the non-linear modelling of the resonator, transducer and sustaining amplifier in a single numerical modelling environment so that their combined effects may be investigated simultaneously. The paper validates the proposed electrical model of the resonator through open-loop frequency response measurements on an electrically addressed flexural silicon MEMS resonator driven to large motional amplitudes. A square wave oscillator is constructed by embedding the same resonator as the primary frequency determining element. Measurements of output power and output frequency of the square wave oscillator as a function of resonator bias and driving voltage are consistent with model predictions ensuring that the model captures the essential non-linear behaviour of the resonator and the sustaining amplifier in a single mathematical equation. © 2012 IEEE.

Bayesian non-parametrics and the probabilistic approach to modelling.

Modelling is fundamental to many fields of science and engineering. A model can be thought of as a representation of possible data one could predict from a system. The probabilistic approach to modelling uses probability theory to express all aspects of uncertainty in the model. The probabilistic approach is synonymous with Bayesian modelling, which simply uses the rules of probability theory in order to make predictions, compare alternative models, and learn model parameters and structure from data. This simple and elegant framework is most powerful when coupled with flexible probabilistic models. Flexibility is achieved through the use of Bayesian non-parametrics. This article provides an overview of probabilistic modelling and an accessible survey of some of the main tools in Bayesian non-parametrics. The survey covers the use of Bayesian non-parametrics for modelling unknown functions, density estimation, clustering, time-series modelling, and representing sparsity, hierarchies, and covariance structure. More specifically, it gives brief non-technical overviews of Gaussian processes, Dirichlet processes, infinite hidden Markov models, Indian buffet processes, Kingman's coalescent, Dirichlet diffusion trees and Wishart processes.

Modelling and Fragility Analysis of Non-Ductile Reinforced Concrete Buildings in Low-to-Moderate Seismic Zones

Reinforced concrete buildings in low-to-moderate seismic zones are often designed only for gravity loads in accordance with the non-seismic detailing provisions. Deficient detailing of columns and beam-column joints can lead to unpredictable brittle failures even under moderate earthquakes. Therefore, a reliable estimate of structural response is required for the seismic evaluation of these structures. For this purpose, analytical models for both interior and exterior slab-beam-column subassemblages and for a 1/3 scale model frame were implemented into the nonlinear finite element platform OpenSees. Comparison between the analytical results and experimental data available in the literature is carried out using nonlinear pushover analyses and nonlinear time history analysis for the subassemblages and the model frame, respectively. Furthermore, the seismic fragility assessment of reinforced concrete buildings is performed on a set of non-ductile frames using nonlinear time history analyses. The fragility curves, which are developed for various damage states for the maximum interstory drift ratio are characterized in terms of peak ground acceleration and spectral acceleration using a suite of ground motions representative of the seismic hazard in the region.

Linear quadratic game and non-cooperative predictive methods for potential application to modelling driver-AFS interactive steering control

This paper is concerned with the modelling of strategic interactions between the human driver and the vehicle active front steering (AFS) controller in a path-following task where the two controllers hold different target paths. The work is aimed at extending the use of mathematical models in representing driver steering behaviour in complicated driving situations. Two game theoretic approaches, namely linear quadratic game and non-cooperative model predictive control (non-cooperative MPC), are used for developing the driver-AFS interactive steering control model. For each approach, the open-loop Nash steering control solution is derived; the influences of the path-following weights, preview and control horizons, driver time delay and arm neuromuscular system (NMS) dynamics are investigated, and the CPU time consumed is recorded. It is found that the two approaches give identical time histories as well as control gains, while the non-cooperative MPC method uses much less CPU time. Specifically, it is observed that the introduction of weight on the integral of vehicle lateral displacement error helps to eliminate the steady-state path-following error; the increase in preview horizon and NMS natural frequency and the decline in time delay and NMS damping ratio improve the path-following accuracy. © 2013 Copyright Taylor and Francis Group, LLC.