Predicting amount of saleable products using neural network metamodels of casthouses

This study aims at developing abstract metamodels for approximating highly nonlinear relationships within a metal casting plant. Metal casting product quality nonlinearly depends on many controllable and uncontrollable factors. For improving the productivity of the system, it is vital for operation planners to predict in advance the amount of high quality products. Neural networks metamodels are developed and applied in this study for predicting the amount of saleable products. Training of metamodels is done using the Levenberg-Marquardt and Bayesian learning methods. Statistical measures are calculated for the developed metamodels over a grid of neural network structures. Demonstrated results indicate that Bayesian-based neural network metamodels outperform the Levenberg-Marquardt-based metamodels in terms of both prediction accuracy and robustness to the metamodel complexity. In contrast, the latter metamodels are computationally less expensive and generate the results more quickly.

A comparative study of supervised learning techniques for data-driven haptic simulation

This paper focuses on the choice of a supervised learning algorithm and possible data preprocessing in the domain of data-driven haptic simulation. This is done through a comparison of the performance of different supervised learning techniques with and without data preprocessing. The simulation of haptic interactions with deformable objects using data-driven methods has emerged as an alternative to parametric methods. The accuracy of the simulation depends on the empirical data and the learning method. Several methods were suggested in the literature and here we provide a comparison between their performance and applicability to this domain. We selected four examples to be compared: singular learning mechanism which is artificial neural networks (ANN), attribute selection followed by ANN learning process, ensemble of multiple learning techniques, and attribute selection followed by the learning ensemble. These methods performance was compared in the domain of simulating multiple interactions with a deformable object with nonlinear material behavior.

Zero-day malware detection based on supervised learning algorithms of API call signatures

Zero-day or unknown malware are created using code obfuscation techniques that can modify the parent code to produce offspring copies which have the same functionality but with different signatures. Current techniques reported in literature lack the capability of detecting zero-day malware with the required accuracy and efficiency. In this paper, we have proposed and evaluated a novel method of employing several data mining techniques to detect and classify zero-day malware with high levels of accuracy and efficiency based on the frequency of Windows API calls. This paper describes the methodology employed for the collection of large data sets to train the classifiers, and analyses the performance results of the various data mining algorithms adopted for the study using a fully automated tool developed in this research to conduct the various experimental investigations and evaluation. Through the performance results of these algorithms from our experimental analysis, we are able to evaluate and discuss the advantages of one data mining algorithm over the other for accurately detecting zero-day malware successfully. The data mining framework employed in this research learns through analysing the behavior of existing malicious and benign codes in large datasets. We have employed robust classifiers, namely Naïve Bayes (NB) Algorithm, k−Nearest Neighbor (kNN) Algorithm, Sequential Minimal Optimization (SMO) Algorithm with 4 differents kernels (SMO - Normalized PolyKernel, SMO – PolyKernel, SMO – Puk, and SMO- Radial Basis Function (RBF)), Backpropagation Neural Networks Algorithm, and J48 decision tree and have evaluated their performance. Overall, the automated data mining system implemented for this study has achieved high true positive (TP) rate of more than 98.5%, and low false positive (FP) rate of less than 0.025, which has not been achieved in literature so far. This is much higher than the required commercial acceptance level indicating that our novel technique is a major leap forward in detecting zero-day malware. This paper also offers future directions for researchers in exploring different aspects of obfuscations that are affecting the IT world today.

The social network virtual design studio : integrated design learning using blended learning environments

Online communications, multimedia, mobile computing and face-to-face learning create blended learning environments to which some Virtual Design Studios (VDS) have reacted to. Social Networks (SN), as instruments for communication, have provided a potentially fruitful operative base for VDS. These technologies transfer communication, leadership, democratic interaction, teamwork, social engagement and responsibility away from the design tutors to the participants. The implementation of Social Network VDS (SNVDS) moved the VDS beyond its conventional realm and enabled students to develop architectural design that is embedded into a community of learners and expertise both online and offline. Problem-based learning (PBL) becomes an iterative and reflexive process facilitating deep learning. The paper discusses details of the SNVDS, its pedagogical implications to PBL, and presents how the SNVDS is successful in enabling architectural students to collaborate and communicate design proposals that integrate a variety of skills, deep learning, knowledge and construction with a rich learning experience.

A globally convergent MC algorithm with an adaptive learning rate

This brief deals with the problem of minor component analysis (MCA). Artificial neural networks can be exploited to achieve the task of MCA. Recent research works show that convergence of neural networks based MCA algorithms can be guaranteed if the learning rates are less than certain thresholds. However, the computation of these thresholds needs information about the eigenvalues of the autocorrelation matrix of data set, which is unavailable in online extraction of minor component from input data stream. In this correspondence, we introduce an adaptive learning rate into the OJAn MCA algorithm, such that its convergence condition does not depend on any unobtainable information, and can be easily satisfied in practical applications.

A neural network-based multi-agent classifier system with a Bayesian formalism for trust measurement

In this paper, a neural network (NN)-based multi-agent classifier system (MACS) utilising the trust-negotiation-communication (TNC) reasoning model is proposed. A novel trust measurement method, based on the combination of Bayesian belief functions, is incorporated into the TNC model. The Fuzzy Min-Max (FMM) NN is used as learning agents in the MACS, and useful modifications of FMM are proposed so that it can be adopted for trust measurement. Besides, an auctioning procedure, based on the sealed bid method, is applied for the negotiation phase of the TNC model. Two benchmark data sets are used to evaluate the effectiveness of the proposed MACS. The results obtained compare favourably with those from a number of machine learning methods. The applicability of the proposed MACS to two industrial sensor data fusion and classification tasks is also demonstrated, with the implications analysed and discussed.

Short term load forecasting using a hybrid neural network

Short Term Load Forecasting (STLF) is very important from the power systems grid operation point of view. STLF involves forecasting load demand in a short term time frame. The short term time frame may consist of half hourly prediction up to weekly prediction. Accurate forecasting would benefit the utility in terms of reliability and stability of the grid ensuring adequate supply is present to meet with the load demand. Apart from that it would also affect the financial performance of the utility company. An accurate forecast would result in better savings while maintaining the security of the grid. This paper outlines the STLF using a novel hybrid online learning neural network, known as the Gaussian Regression (GR). This new hybrid neural network is a combination of two existing online learning neural networks which are the Gaussian Adaptive Resonance Theory (GA) and the Generalized Regression Neural Network (GRNN). Both GA and GRNN implemented online learning, but each of them suffers from limitation. Originally GA is used for unsupervised clustering by compressing the training samples into several categories. A supervised version of GA is available, namely Gaussian ARTMAP (GAM). However, the GAM is still not capable on solving regression problem. On the other hand, GRNN is designed for solving real value estimation (regression) problem, but the learning process would involve of memorizing all training samples, hence high computational cost. The hybrid GR is considered an enhanced version of GRNN with compression ability while still maintains online learning properties. Simulation results show that GR has comparable prediction accuracy and has less prototype as compared to the original GRNN as well as the Support Vector Regression.

Text-dependent speaker recognition using the Fuzzy ARTMAP neural network

Speaker recognition is the process of automatically recognizing the speaker by analyzing individual information contained in the speech waves. In this paper, we discuss the development of an intelligent system for text-dependent speaker recognition. The system comprises two main modules, a wavelet-based signal-processing module for feature extraction of speech waves, and an artificial-neural-network-based classifier module to identify and categorize the speakers. Wavelet is used in de-noising and in compressing the speech signals. The wavelet family that we used is the Daubechies Wavelets. After extracting the necessary features from the speech waves, the features were then fed to a neural-network-based classifier to identify the speakers. We have implemented the Fuzzy ARTMAP (FAM) network in the classifier module to categorize the de-noised and compressed signals. The proposed intelligent learning system has been applied to a case study of text-dependent speaker recognition problem.

Application of an adaptive neural network with symbolic rule extraction to fault detection and diagnosis in a power generation plant

Artificial neural networks have a good potential to be employed for fault diagnosis and condition monitoring problems in complex processes. In this paper, the applicability of the fuzzy ARTMAP (FAM) neural network as an intelligent learning system for fault detection and diagnosis in a power generation plant is described. The process under scrutiny is the circulating water (CW) system, with specific attention to the conditions of heat transfer and tube blockage in the CW system. A series of experiments has been conducted systematically to investigate the effectiveness of FAM in fault detection and diagnosis tasks. In addition, a set of domain rules has been extracted from the trained FAM network so that its predictions can be explained and justified. The outcomes demonstrate the benefits of employing FAM as an intelligent fault detection and diagnosis tool with an explanatory capability for monitoring and diagnosing complex processes in power generation plants.

Managing manufacturing technology investments: An intelligent learning system approach

This paper proposes an intelligent decision-support system for managing manufacturing technology investments. The intelligent system is a hybrid integration of two information processing modules: case-based reasoning and fuzzy ARTMAP – a supervised adaptive resonance theory (ART) neural network with a multi-dimensional map. The developed system captures a company's strategic information, provides facilities to quantify qualitative attributes and analyses them alongside the quantitative attributes in an evaluation framework. Through the system, similar cases can be retrieved to enable managers to make effective use of their knowledge and experience of previously delivered technologies and projects as an input to the prioritization of future projects. Other salient features of the system include its ability to adapt and absorb new knowledge and responses pertaining to significant events in the business environment, as well as to extract and elucidate information from the knowledge database for explaining and justifying its analysis. The applicability of the developed system is evaluated using a real case study in collaboration with a pharmaceutical manufacturing firm.

Online pattern classification with multiple neural network systems: an experimental study

In this paper, an empirical study of the development and application of a committee of neural networks on online pattern classification tasks is presented. A multiple classifier framework is designed by adopting an Adaptive Resonance Theory-based (ART) autonomously learning neural network as the building block. A number of algorithms for combining outputs from multiple neural classifiers are considered, and two benchmark data sets have been used to evaluate the applicability of the proposed system. Different learning strategies coupling offline and online learning approaches, as well as different input pattern representation schemes, including the "ensemble" and "modular" methods, have been examined experimentally. Benefits and shortcomings of each approach are systematically analyzed and discussed. The results are comparable, and in some cases superior, with those from other classification algorithms. The experiments demonstrate the potentials of the proposed multiple neural network systems in offering an alternative to handle online pattern classification tasks in possibly nonstationary environments.

The application of an ensemble of boosted elman networks to time series prediction : a benchmark study

In this paper, the application of multiple Elman neural networks to time series data regression problems is studied. An ensemble of Elman networks is formed by boosting to enhance the performance of the individual networks. A modified version of the AdaBoost algorithm is employed to integrate the predictions from multiple networks. Two benchmark time series data sets, i.e., the Sunspot and Box-Jenkins gas furnace problems, are used to assess the effectiveness of the proposed system. The simulation results reveal that an ensemble of boosted Elman networks can achieve a higher degree of generalization as well as performance than that of the individual networks. The results are compared with those from other learning systems, and implications of the performance are discussed.

Virtual design studio via social networks

With the advent of social networks, it became apparent that the social aspect of designing and learning plays a crucial role in students’ education. The ease of communication, leadership opportunity, democratic interaction, teamwork, and the sense of community are some of the aspects that are now in the centre of design interaction. Online interactions, multimedia, mobile computing and face-to-face learning create blended learning environments to which some Virtual Design Studios (VDS) have reacted. On the sample of a design studio at Deakin University the paper discusses details of the Social Network VDS, its pedagogical implications to PBL, and presents how it is successful in empowering architectural students to collaborate and communicate design proposals that integrate a variety of skills, deep learning, and construction of knowledge. It studies the effectiveness of the generated social intelligence and explores the facilitation of students’ self-directed learning. Hereby the paper studies the construction of knowledge via social interaction and how blended learning environments foster motivation and information exchange.

Bayesian model averaging of load demand forecasts from neural network models

Creating a set of a number of neural network (NN) models in an ensemble and accumulating them can achieve better overview capability as compared to single neural network. Neural network ensembles are designed to provide solutions to particular problems. Many researchers and academicians have adopted this NN ensemble technique, especially in machine learning, and has been applied in various fields of engineering, medicine and information technology. This paper present a robust aggregation methodology for load demand forecasting based on Bayesian Model Averaging of a set of neural network models in an ensemble. This paper estimate a vector of coefficient for individual NN models' forecasts using validation data-set. These coefficients, also known as weights, are equal to posterior probabilities of the models generating the forecasts. These BMA weights are then used in combining forecasts generated from NN models with test data-set. By comparing the Bayesian results with the Simple Averaging method, it was observed that benefits are obtained by utilizing an advanced method like BMA for forecast combinations.

Intelligent traffic light control of isolated intersections using machine learning methods

Traffic congestion is one of the major problems in modern cities. This study applies machine learning methods to determine green times in order to minimize in an isolated intersection. Q-learning and neural networks are applied here to set signal light times and minimize total delays. It is assumed that an intersection behaves in a similar fashion to an intelligent agent learning how to set green times in each cycle based on traffic information. Here, a comparison between Q-learning and neural network is presented. In Q-learning, considering continuous green time requires a large state space, making the learning process practically impossible. In contrast to Q-learning methods, the neural network model can easily set the appropriate green time to fit the traffic demand. The performance of the proposed neural network is compared with two traditional alternatives for controlling traffic lights. Simulation results indicate that the application of the proposed method greatly reduces the total delay in the network compared to the alternative methods.