Using the EM Algorithm to Train Neural Networks: Misconceptions and a New Algorithm for Multiclass Classification

The expectation-maximization (EM) algorithm has been of considerable interest in recent years as the basis for various algorithms in application areas of neural networks such as pattern recognition. However, there exists some misconceptions concerning its application to neural networks. In this paper, we clarify these misconceptions and consider how the EM algorithm can be adopted to train multilayer perceptron (MLP) and mixture of experts (ME) networks in applications to multiclass classification. We identify some situations where the application of the EM algorithm to train MLP networks may be of limited value and discuss some ways of handling the difficulties. For ME networks, it is reported in the literature that networks trained by the EM algorithm using iteratively reweighted least squares (IRLS) algorithm in the inner loop of the M-step, often performed poorly in multiclass classification. However, we found that the convergence of the IRLS algorithm is stable and that the log likelihood is monotonic increasing when a learning rate smaller than one is adopted. Also, we propose the use of an expectation-conditional maximization (ECM) algorithm to train ME networks. Its performance is demonstrated to be superior to the IRLS algorithm on some simulated and real data sets.

Risk technology in Australia: The role of the job seeker classification instrument in employment services

Promoted as the key policy response to unemployment, the Job Network constitutes an array of interlocking processes that position unemployed people as `problems' in need of remediation. Unemployment is presented as a primary risk threatening society, and unemployed people are presented as displaying various degrees of riskiness. The Job Seeker Classification Instrument (JSCI) is a `technology' employed by Centrelink to assess `risk' and to determine the type of interaction that unemployed people have with the job Network. In the first instance, we critically examine the development of the JSCI and expose issues that erode its credibility and legitimacy. Second, employing the analytical tools of discourse analysis, we show how the JSCI both assumes and imposes particular subject identities on unemployed people. The purpose of this latter analysis is to illustrate the consequences of the sorts of technologies and interventions used within the job Network.