On-line learning in multilayer neural networks

We present an analytic solution to the problem of on-line gradient-descent learning for two-layer neural networks with an arbitrary number of hidden units in both teacher and student networks. The technique, demonstrated here for the case of adaptive input-to-hidden weights, becomes exact as the dimensionality of the input space increases.

Using ancillary statistics in on-line learning algorithms

Neural networks are usually curved statistical models. They do not have finite dimensional sufficient statistics, so on-line learning on the model itself inevitably loses information. In this paper we propose a new scheme for training curved models, inspired by the ideas of ancillary statistics and adaptive critics. At each point estimate an auxiliary flat model (exponential family) is built to locally accommodate both the usual statistic (tangent to the model) and an ancillary statistic (normal to the model). The auxiliary model plays a role in determining credit assignment analogous to that played by an adaptive critic in solving temporal problems. The method is illustrated with the Cauchy model and the algorithm is proved to be asymptotically efficient.

The learning dynamics of a universal approximator

The learning properties of a universal approximator, a normalized committee machine with adjustable biases, are studied for on-line back-propagation learning. Within a statistical mechanics framework, numerical studies show that this model has features which do not exist in previously studied two-layer network models without adjustable biases, e.g., attractive suboptimal symmetric phases even for realizable cases and noiseless data.

Combining the wavelet transform and forecasting models to predict gas forward prices

This paper presents a forecasting technique for forward energy prices, one day ahead. This technique combines a wavelet transform and forecasting models such as multi- layer perceptron, linear regression or GARCH. These techniques are applied to real data from the UK gas markets to evaluate their performance. The results show that the forecasting accuracy is improved significantly by using the wavelet transform. The methodology can be also applied to forecasting market clearing prices and electricity/gas loads.

Organisational learning - a critical systems thinking discipline

Original Paper European Journal of Information Systems (2001) 10, 135–146; doi:10.1057/palgrave.ejis.3000394 Organisational learning—a critical systems thinking discipline P Panagiotidis1,3 and J S Edwards2,4 1Deloitte and Touche, Athens, Greece 2Aston Business School, Aston University, Aston Triangle, Birmingham, B4 7ET, UK Correspondence: Dr J S Edwards, Aston Business School, Aston University, Aston Triangle, Birmingham, B4 7ET, UK. E-mail: j.s.edwards@aston.ac.uk 3Petros Panagiotidis is Manager responsible for the Process and Systems Integrity Services of Deloitte and Touche in Athens, Greece. He has a BSc in Business Administration and an MSc in Management Information Systems from Western International University, Phoenix, Arizona, USA; an MSc in Business Systems Analysis and Design from City University, London, UK; and a PhD degree from Aston University, Birmingham, UK. His doctorate was in Business Systems Analysis and Design. His principal interests now are in the ERP/DSS field, where he serves as project leader and project risk managment leader in the implementation of SAP and JD Edwards/Cognos in various major clients in the telecommunications and manufacturing sectors. In addition, he is responsible for the development and application of knowledge management systems and activity-based costing systems. 4John S Edwards is Senior Lecturer in Operational Research and Systems at Aston Business School, Birmingham, UK. He holds MA and PhD degrees (in mathematics and operational research respectively) from Cambridge University. His principal research interests are in knowledge management and decision support, especially methods and processes for system development. He has written more than 30 research papers on these topics, and two books, Building Knowledge-based Systems and Decision Making with Computers, both published by Pitman. Current research work includes the effect of scale of operations on knowledge management, interfacing expert systems with simulation models, process modelling in law and legal services, and a study of the use of artifical intelligence techniques in management accounting. Top of pageAbstract This paper deals with the application of critical systems thinking in the domain of organisational learning and knowledge management. Its viewpoint is that deep organisational learning only takes place when the business systems' stakeholders reflect on their actions and thus inquire about their purpose(s) in relation to the business system and the other stakeholders they perceive to exist. This is done by reflecting both on the sources of motivation and/or deception that are contained in their purpose, and also on the sources of collective motivation and/or deception that are contained in the business system's purpose. The development of an organisational information system that captures, manages and institutionalises meaningful information—a knowledge management system—cannot be separated from organisational learning practices, since it should be the result of these very practices. Although Senge's five disciplines provide a useful starting-point in looking at organisational learning, we argue for a critical systems approach, instead of an uncritical Systems Dynamics one that concentrates only on the organisational learning practices. We proceed to outline a methodology called Business Systems Purpose Analysis (BSPA) that offers a participatory structure for team and organisational learning, upon which the stakeholders can take legitimate action that is based on the force of the better argument. In addition, the organisational learning process in BSPA leads to the development of an intrinsically motivated information organisational system that allows for the institutionalisation of the learning process itself in the form of an organisational knowledge management system. This could be a specific application, or something as wide-ranging as an Enterprise Resource Planning (ERP) implementation. Examples of the use of BSPA in two ERP implementations are presented.

Ethnic diversity as a multilevel construct:the combined effects of dissimilarity, group diversity, and societal status on learning performance in work groups

The authors present a model of the multilevel effects of diversity on individual learning performance in work groups. For ethnically diverse work groups, the model predicts that group diversity elicits either positive or negative effects on individual learning performance, depending on whether a focal individual’s ethnic dissimilarity from other group members is high or low. By further considering the societal status of an individual’s ethnic origin within society (Anglo versus non-Anglo for our U.K. context), the authors hypothesize that the model’s predictions hold more strongly for non-Anglo group members than for Anglo group members. We test this model with data from 412 individuals working on a 24-week business simulation in 87 four- to seven-person groups with varying degrees of ethnic diversity. Two of the three hypotheses derived from the model received full support and one hypothesis received partial support. Implications for theory development, methods, and practice in applied group diversity research are discussed.

Short-term electricity demand and gas price forecasts using wavelet transforms and adaptive models

This paper presents some forecasting techniques for energy demand and price prediction, one day ahead. These techniques combine wavelet transform (WT) with fixed and adaptive machine learning/time series models (multi-layer perceptron (MLP), radial basis functions, linear regression, or GARCH). To create an adaptive model, we use an extended Kalman filter or particle filter to update the parameters continuously on the test set. The adaptive GARCH model is a new contribution, broadening the applicability of GARCH methods. We empirically compared two approaches of combining the WT with prediction models: multicomponent forecasts and direct forecasts. These techniques are applied to large sets of real data (both stationary and non-stationary) from the UK energy markets, so as to provide comparative results that are statistically stronger than those previously reported. The results showed that the forecasting accuracy is significantly improved by using the WT and adaptive models. The best models on the electricity demand/gas price forecast are the adaptive MLP/GARCH with the multicomponent forecast; their MSEs are 0.02314 and 0.15384 respectively.

Consumer responses to really new products: examining the impacts of learning strategies and presentation formats on product comprehension and attitude formation

Mental simulations and analogies have been identified as powerful learning tools for RNPs. Furthermore, visuals in advertising have recently been conceptualized as meaningful sources of information as opposed to peripheral cues and thus may help consumers learn about RNPs. The study of visual attention may also contribute to understanding the links between conceptual and perceptual analyses when learning for a RNP. Two conceptual models are developed. the first model consists of causal relationships between the attributes of advertising stimuli for RNPs and consumer responses, as well as mediating influences. The second model focuses on the role of visual attention in product comprehension as a response to advertising stimuli. Two experiments are conducted: a Web-Experiment and an eye-tracking experiment. The first experiment (858 subjects) examines the effect of learning strategies (mental simulation vs. analogy vs. no analogy/no mental simulation) and presentation formats (words vs. pictures) on individual responses. The mediating role of emotions is assessed. The second experiment investigates the effect of learning strategies and presentation formats on product comprehension, along with the role of attention (17 subjects). The findings from experiment 1 indicate that learning strategies and presentation formats can either enhance or undermine the effect of advertising stimuli on individual responses. Moreover, the nature of the product (i.e. hedonic vs. utilitarian vs. hybrid) should be considered when designing communications for RNPs. The mediating role of emotions is verified. Experiment 2 suggests that an increase in attention to the message may either reflect enhanced comprehension or confusion.

Content-based VLE designs improve learning efficiency in constructivist statistics education

Background: We introduced a series of computer-supported workshops in our undergraduate statistics courses, in the hope that it would help students to gain a deeper understanding of statistical concepts. This raised questions about the appropriate design of the Virtual Learning Environment (VLE) in which such an approach had to be implemented. Therefore, we investigated two competing software design models for VLEs. In the first system, all learning features were a function of the classical VLE. The second system was designed from the perspective that learning features should be a function of the course's core content (statistical analyses), which required us to develop a specific-purpose Statistical Learning Environment (SLE) based on Reproducible Computing and newly developed Peer Review (PR) technology. Objectives: The main research question is whether the second VLE design improved learning efficiency as compared to the standard type of VLE design that is commonly used in education. As a secondary objective we provide empirical evidence about the usefulness of PR as a constructivist learning activity which supports non-rote learning. Finally, this paper illustrates that it is possible to introduce a constructivist learning approach in large student populations, based on adequately designed educational technology, without subsuming educational content to technological convenience. Methods: Both VLE systems were tested within a two-year quasi-experiment based on a Reliable Nonequivalent Group Design. This approach allowed us to draw valid conclusions about the treatment effect of the changed VLE design, even though the systems were implemented in successive years. The methodological aspects about the experiment's internal validity are explained extensively. Results: The effect of the design change is shown to have substantially increased the efficiency of constructivist, computer-assisted learning activities for all cohorts of the student population under investigation. The findings demonstrate that a content-based design outperforms the traditional VLE-based design. © 2011 Wessa et al.

A comparative study of bayesian models for unsupervised sentiment detection

This paper presents a comparative study of three closely related Bayesian models for unsupervised document level sentiment classification, namely, the latent sentiment model (LSM), the joint sentiment-topic (JST) model, and the Reverse-JST model. Extensive experiments have been conducted on two corpora, the movie review dataset and the multi-domain sentiment dataset. It has been found that while all the three models achieve either better or comparable performance on these two corpora when compared to the existing unsupervised sentiment classification approaches, both JST and Reverse-JST are able to extract sentiment-oriented topics. In addition, Reverse-JST always performs worse than JST suggesting that the JST model is more appropriate for joint sentiment topic detection.

New career models in UK professional service firms:from up-or-out to up-and-going-nowhere?

In this paper, we empirically examine how professional service firms are adapting their promotion and career models to new market and institutional pressures, without losing the benefits of the traditional up-or-out tournament. Based on an in-depth qualitative study of 10 large UK based law firms we find that most of these firms do not have a formal up-or-out policy but that the up-or-out rule operates in practice. We also find that most firms have introduced alternative roles and a novel career policy that offers a holistic learning and development deal to associates without any expectation that unsuccessful candidates for promotion to partner should quit the firm. While this policy and the new roles formally contradict the principle of up-or-out by creating permanent non-partner positions, in practice they coexist. We conclude that the motivational power of the up-or-out tournament remains intact, notwithstanding the changes to the internal labour market structure of these professional service firms.

Experiential learning:inspiring the business leaders of tomorrow

Purpose: The complex challenges of sustainable development and the need to embed these issues effectively into the education of future business leaders has never been more urgent. The purpose of this paper is to discuss different approaches taken by two UK signatories to the UN Principles for Responsible Management Education (PRME). Design/methodology/approach: The two approaches examined are: MSc Entrepreneurship students opting for placements with social enterprises; and MBA students undertaking workshops using "live" case studies. A content analysis of the experiences of students from their written reflective narratives is presented. This is supplemented by reflections of the facilitators and tutors. Findings: The analysis reveals that the opportunity to work with social entrepreneurs and/or "responsible" business professionals provides the business students with inspirational role models and positive social learning opportunities. Research limitations/implications: This paper suggests that experiential learning is an effective way of integrating ethics, responsibility and sustainability into the curriculum but the research draws on the experience of two schools. Further research is important to explore these findings in other contexts. Practical implications: The authors argue that direct exposure to a business culture (and/or behaviour) that is predicated upon ethical/social responsibility and sustainability is an effective means to embed these values in the curriculum. Originality/value: This paper contributes by drawing on social psychological research related to behaviour change to examine how experiential learning on traditional Business Masters programmes can provide students with the knowledge, motivation and skills to contribute positively to society, in a way that more traditional pedagogies cannot. © Emerald Group Publishing Limited.

Supply chain learning needs:towards a port community perspective

The traditional role of ports in the wider supply chain context is currently being subject to a process of radical review. In broad terms, the traditional model is being replaced by a model which focuses on higher value and more knowledge intensive activities. This trend requires a change in the way in which new knowledge and skills are developed by staff in companies of all kinds within port communities. Traditional models need to be re-evaluated to reflect the increasing importance of knowledge and skills acquisition, particularly in relation to the supply chain management (SCM) concept and the evolving role of information and communications technology (ICT) in improving supply chain capability. This paper describes the case of NITL’s Foundation Certificate Programme (FCP) learning programme with specific reference to its use in addressing some of current shortcomings related to supply chain knowledge and skills in port communities. The FCP rationale is based on the need to move from traditional approaches of supply chain organisation where the various links in the chain were measured and managed in isolation from each other and thus tended to operate at cross purposes, towards more cooperative and integrated approaches.

Evolution, recurrency and kernels in learning to model inflation

This paper provides the most fully comprehensive evidence to date on whether or not monetary aggregates are valuable for forecasting US inflation in the early to mid 2000s. We explore a wide range of different definitions of money, including different methods of aggregation and different collections of included monetary assets. We use non-linear, artificial intelligence techniques, namely, recurrent neural networks, evolution strategies and kernel methods in our forecasting experiment. In the experiment, these three methodologies compete to find the best fitting US inflation forecasting models and are then compared to forecasts from a naive random walk model. The best models were non-linear autoregressive models based on kernel methods. Our findings do not provide much support for the usefulness of monetary aggregates in forecasting inflation. There is evidence in the literature that evolutionary methods can be used to evolve kernels hence our future work should combine the evolutionary and kernel methods to get the benefits of both.

Complex Adaptive On-line Learning System “Theory of Automatic Control"

The controlled from distance teaching (DT) in the system of technical education has a row of features: complication of informative content, necessity of development of simulation models and trainers for conducting of practical and laboratory employments, conducting of knowledge diagnostics on the basis of mathematical-based algorithms, organization of execution collective projects of the applied setting. For development of the process of teaching bases of fundamental discipline control system Theory of automatic control (TAC) the combined approach of optimum combination of existent programmatic instruments of support was chosen DT and own developments. The system DT TAC included: controlled from distance course (DC) of TAC, site of virtual laboratory practical works in LAB.TAC and students knowledge remote diagnostic system d-tester.