Using the EM Algorithm to Train Neural Networks: Misconceptions and a New Algorithm for Multiclass Classification

The expectation-maximization (EM) algorithm has been of considerable interest in recent years as the basis for various algorithms in application areas of neural networks such as pattern recognition. However, there exists some misconceptions concerning its application to neural networks. In this paper, we clarify these misconceptions and consider how the EM algorithm can be adopted to train multilayer perceptron (MLP) and mixture of experts (ME) networks in applications to multiclass classification. We identify some situations where the application of the EM algorithm to train MLP networks may be of limited value and discuss some ways of handling the difficulties. For ME networks, it is reported in the literature that networks trained by the EM algorithm using iteratively reweighted least squares (IRLS) algorithm in the inner loop of the M-step, often performed poorly in multiclass classification. However, we found that the convergence of the IRLS algorithm is stable and that the log likelihood is monotonic increasing when a learning rate smaller than one is adopted. Also, we propose the use of an expectation-conditional maximization (ECM) algorithm to train ME networks. Its performance is demonstrated to be superior to the IRLS algorithm on some simulated and real data sets.

Effect of environment and genotype on bread-making quality of spring-sown spring wheat cultivars in China

Improvement of end-use quality in bread wheat depends on a thorough understanding of current wheat quality and the influences of genotype (G), environment (E), and genotype by environment interaction (G x E) on quality traits. Thirty-nine spring-sown spring wheat (SSSW) cultivars and advanced lines from China were grown in four agro-ecological zones comprising seven locations during the 1998 and 1999 cropping seasons. Data on 12 major bread-making quality traits were used to investigate the effect of G, E, and G x E on these traits. Wide range variability for protein quantity and quality, starch quality parameters and milling quality in Chinese SSSW was observed. Genotype and environment were found to significantly influence all quality parameters as major effects. Kernel hardness, flour yield, Zeleny sedimentation value and mixograph properties were mainly influenced by the genetic variance components, while thousand kernel weight, test weight, and falling number were mostly influenced by the environmental variance components. Genotype, environment, and their interaction had important effects on test weight, mixing development time and RVA parameters. Cultivars originating from Zone VI (northeast) generally expressed high kernel hardness, good starch quality, but poor milling and medium to weak mixograph performance; those from Zone VII (north) medium to good gluten and starch quality, but low milling quality; those from Zone VIII (central northwest) medium milling and starch quality, and medium to strong mixograph performance; those from Zone IX (western/southwestern Qinghai-Tibetan Plateau) medium milling quality, but poor gluten strength and starch parameters; and those from Zone X (northwest) high milling quality, strong mixograph properties, but low protein content. Samples from Harbin are characterized by good gluten and starch quality, but medium to poor milling quality; those from Hongxinglong by strong mixograph properties, medium to high milling quality, but medium to poor starch quality and medium to low protein content; those from Hohhot by good gluten but poor milling quality; those from Linhe by weak gluten quality, medium to poor milling quality; those from Lanzhou by poor bread-making and starch quality; those from Yongning by acceptable bread-making and starch quality and good milling quality; and those from Urumqi by good milling quality, medium gluten quality and good starch pasting parameters. Our findings suggest that Chinese SSSW quality could be greatly enhanced through genetic improvement for targeted well-characterized production environments.

Effects of phosphorus on the growth and nitrogen fixation rates of Lyngbya majuscula: implications for management in Moreton Bay, Queensland

Significant acetylene reduction and therefore N-2 fixation was observed for Lyngbya majuscula only during dark periods, which suggests that oxygenic photosynthesis and N-2 fixation are incompatible processes for this species. Results from a series of batch and continuous-flow-culture reactor studies showed that the specific growth rate and N-2 fixation rate of L, majuscula increased with phosphate (P-PO4) concentration up to a maximum value and thereafter remained constant. The P-PO4 concentrations corresponding to the maximum N-2 fixation and maximum growth rates were -0.27 and -0.18 muM respectively and these values are denoted as the saturation values for N-2 fixation and growth respectively. Regular monitoring studies in Moreton Bay, Queensland, show that concentrations Of P-PO4 generally exceed these saturation values over a large portion of the Bay and therefore, the growth of the bloom-forming L, majuscula is potentially maximised throughout much of the Bay by the elevated P-PO4 concentrations. Results from other studies suggest that the elevated P-PO4 concentrations in the Bay can be largely attributed to discharges from waste-water treatment plants (WWTPs), and thus it is proposed that the control of the growth of L. majuscula in Moreton Bay will require a significant reduction in the P load from the WWTP discharges. If the current strategy of N load reduction for these discharges is maintained in the absence of substantial P load reduction, it is hypothesised that the growth of L, majuscula and other diazotrophs in Moreton Bay will increase in the future.

Understanding service experience in non-profit performing arts: Implications for operations and service management

Recent research in the non-profit performing arts has shown that marketing efforts designed to increase revenue from ticket sales are not achieving the results required to sustain the performing arts. This paper applies operations management analytical techniques to the non-profit performing arts to increase understanding of operational issues and inform service management strategy. The paper takes a two-study idiographic approach. Implementing a modified version of service transaction analysis (STA), Study One describes a performing arts service from provider and customer perspectives, identifies service gaps and develops an elaborated service description incorporating both perspectives. In Study Two, building on the elaborated service description and extant research, in-depth interviews are conducted to gather thick descriptions of predictors of satisfaction, value and service quality as they relate to repurchase intention (RI). Technical, functional and critical factors required to improve organizational performance are identified. Implications for operational strategy, service design and service management theory for this context are discussed. (c) 2005 Published by Elsevier B.V.

Milling quality and protein properties of autumn-sown Chinese wheats evaluated through multi-location trials

Eight milling quality and protein properties of autumn-sown Chinese wheats were investigated using 59 cultivars and advanced lines grown in 14 locations in China from 1995 to 1998. Wide ranges of variability for all traits were observed across genotypes and locations. Genotype, location, year, and their interactions all significantly influenced most of the quality parameters. Kernel hardness, Zeleny sedimentation value, and mixograph development time were predominantly influenced by the effects of genotype. Genotype, location and genotype x location interaction were all important sources of variation for thousand kernel weight, test weight, protein content, and falling number, whereas genotype x location interaction had the largest effect on flour yield. Most of the genotypes were characterized by weak gluten strength with Zeleny sedimentation values less than 40 ml and mixograph development time shorter than 3 min. Eight groups of genotypes were recognized based on the average quality performance, grain hardness and gluten strength were the two parameters that determined the grouping, with contributions from protein content. Genotypes such as Zhongyou 16 and Annong 8903 displayed good milling quality, high grain hardness, protein content and strong gluten strength with high sedimentation value and long mixograph development time. Genotypes such as Lumai 15 and Yumai 18 were characterized by low grain hardness, protein content and weak gluten strength. Genotypes such as Yannong 15 and Chuanmai 24 were characterized by strong gluten strength with high sedimentation value and long mixograph development time, but low grain hardness and protein content lower than 12.3%. Genotypes such as Jingdong 6 and Xi'an 8 had weak gluten strength, but with high grain hardness and protein content higher than 12.2%. Five groups of locations were identified, and protein content and gluten strength were the two parameters that determined the grouping. Beijing, Shijiazhuang, Nanyang, Zhumadian and Nanjing produced wheats with medium to strong gluten strength and medium protein content, although there was still a large variation for most of the traits investigated between the locations. Wheat produced in Yantai was characterized by strong gluten strength, but with low protein content. Jinan, Anyang and Linfen locations produced wheats with medium to weak gluten strength and medium to high protein content. Wheats produced in Yangling, Zhenzhou, and Chengdu were characterized by weak gluten strength with medium to low protein content, whereas wheats produced in Xuzhou and Wuhan were characterized by weak gluten strength with low protein content. Industrial grain quality could be substantially improved through integrating knowledge of geographic genotype distribution with key location variables that affected end-use quality.

Output price subsidies in a stochastic world

This article studies the comparative statics of output subsidies for firms, with monotonic preferences over costs and returns, that face price and production uncertainty. The modeling of deficiency payments, support-price schemes, and stochastic supply shifts in a state-space framework is discussed. It is shown how these notions can be used, via a simple application of Shephard's lemma, to analyze input-demand shifts once comparative-static results for supply are available. A range of comparative-static results for supply are then developed and discussed.

Procedures and parameters in the real-time program refinement calculus

The real-time refinement calculus is a formal method for the systematic derivation of real-time programs from real-time specifications in a style similar to the non-real-time refinement calculi of Back and Morgan. In this paper we extend the real-time refinement calculus with procedures and provide refinement rules for refining real-time specifications to procedure calls. A real-time specification can include constraints on, not only what outputs are produced, but also when they are produced. The derived programs can also include time constraints oil when certain points in the program must be reached; these are expressed in the form of deadline commands. Such programs are machine independent. An important consequence of the approach taken is that, not only are the specifications machine independent, but the whole refinement process is machine independent. To implement the machine independent code on a target machine one has a separate task of showing that the compiled machine code will reach all its deadlines before they expire. For real-time programs, externally observable input and output variables are essential. These differ from local variables in that their values are observable over the duration of the execution of the program. Hence procedures require input and output parameter mechanisms that are references to the actual parameters so that changes to external inputs are observable within the procedure and changes to output parameters are externally observable. In addition, we allow value and result parameters. These may be auxiliary parameters, which are used for reasoning about the correctness of real-time programs as well as in the expression of timing deadlines, but do not lead to any code being generated for them by a compiler. (c) 2006 Elsevier B.V. All rights reserved.

Simulation of binary mixture adsorption of methane and CO2 at supercritical conditions in carbons

Knowledge of the adsorption behavior of coal-bed gases, mainly under supercritical high-pressure conditions, is important for optimum design of production processes to recover coal-bed methane and to sequester CO2 in coal-beds. Here, we compare the two most rigorous adsorption methods based on the statistical mechanics approach, which are Density Functional Theory (DFT) and Grand Canonical Monte Carlo (GCMC) simulation, for single and binary mixtures of methane and carbon dioxide in slit-shaped pores ranging from around 0.75 to 7.5 nm in width, for pressure up to 300 bar, and temperature range of 308-348 K, as a preliminary study for the CO2 sequestration problem. For single component adsorption, the isotherms generated by DFT, especially for CO2, do not match well with GCMC calculation, and simulation is subsequently pursued here to investigate the binary mixture adsorption. For binary adsorption, upon increase of pressure, the selectivity of carbon dioxide relative to methane in a binary mixture initially increases to a maximum value, and subsequently drops before attaining a constant value at pressures higher than 300 bar. While the selectivity increases with temperature in the initial pressure-sensitive region, the constant high-pressure value is also temperature independent. Optimum selectivity at any temperature is attained at a pressure of 90-100 bar at low bulk mole fraction of CO2, decreasing to approximately 35 bar at high bulk mole fractions. (c) 2005 American Institute of Chemical Engineers.

Inventory parameter management and focused continuous improvement for repetitive batch manufacturers

What this thesis proposes is a methodology to assist repetitive batch manufacturers in the adoption of certain aspects of the Lean Production principles. The methodology concentrates on the reduction of inventory through the setting of appropriate batch sizes, taking account of the effect of sequence dependent set-ups and the identification and elimination of bottlenecks. It uses a simple Pareto and modified EBQ based analysis technique to allocate items to period order day classes based on a combination of each item's annual usage value and set-up cost. The period order day classes the items are allocated to are determined by the constraints limits in the three measured dimensions, capacity, administration and finance. The methodology overcomes the limitations associated with MRP in the area of sequence dependent set-ups, and provides a simple way of setting planning parameters taking this effect into account by concentrating on the reduction of inventory through the systematic identification and elimination of bottlenecks through set-up reduction processes, so allowing batch sizes to reduce. It aims to help traditional repetitive batch manufacturers in a route to continual improvement by: Highlighting those areas where change would bring the greatest benefits. Modelling the effect of proposed changes. Quantifying the benefits that could be gained through implementing the proposed changes. Simplifying the effort required to perform the modelling process. It concentrates on increasing flexibility through managed inventory reduction through rationally decreasing batch sizes, taking account of sequence dependent set-ups and the identification and elimination of bottlenecks. This was achieved through the development of a software modelling tool, and validated through a case study approach.

Technology valuation within the context of transfer collaborations with Chinese machine tool companies

The point of departure for this study was a recognition of the differences in suppliers' and acquirers' judgements of the value of technology when transferred between the two, and the significant impacts of technology valuation on the establishment of technology partnerships and effectiveness of technology collaborations. The perceptions, transfer strategies and objectives, perceived benefits and assessed technology contributions as well as associated costs and risks of both suppliers and acquirers were seen to be the core to these differences. This study hypothesised that the capability embodied in technology to yield future returns makes technology valuation distinct from the process of valuing manufacturing products. The study hence has gone beyond the dimensions of cost calculation and price determination that have been discussed in the existing literature, by taking a broader view of how to achieve and share future added value from transferred technology. The core of technology valuation was argued as the evaluation of the 'quality' of the capability (technology) in generating future value and the effectiveness of the transfer arrangement for best use of such a capability. A dynamic approach comprising future value generation and realisation within the context of specific forms of collaboration was therefore adopted. The research investigations focused on the UK and China machine tool industries, where there are many technology transfer activities and the value issue has already been recognised in practice. Data were gathered from three groups: machine tool manufacturing technology suppliers in the UK and acquirers in China, and machine tool users in China. Data collecting methods included questionnaire surveys and case studies within all the three groups. The study has focused on identifying and examining the major factors affecting value as well as their interactive effects on technology valuation from both the supplier's and acquirer's point of view. The survey results showed the perceptions and the assessments of the owner's value and transfer value from the supplier's and acquirer's point of view respectively. Benefits, costs and risks related to the technology transfer were the major factors affecting the value of technology. The impacts of transfer payment on the value of technology by the sharing of financial benefits, costs and risks between partners were assessed. The close relationship between technology valuation and transfer arrangements was established by which technical requirements and strategic implications were considered. The case studies reflected the research propositions and revealed that benefits, costs and risks in the financial, technical and strategic dimensions interacted in the process of technology valuation within the context of technology collaboration. Further to the assessment of factors affecting value, a technology valuation framework was developed which suggests that technology attributes for the enhancement of contributory factors and their contributions to the realisation of transfer objectives need to be measured and compared with the associated costs and risks. The study concluded that technology valuation is a dynamic process including the generation and sharing of future value and the interactions between financial, technical and strategic achievements.

Brand equity and purchase intention in fashion industry:a cross-cultural study in Asia and Europe

This research is the leading brand for purchase of assets, and analyzing the factors based on brand asset components and the relationship between the brand and brand assets assets impact factors and purchase intent on uncovering the relationship between components and trademarks centered on South Korea and the United Kingdom, by comparing the asset management plan would generate. The study, information navigation product knowledge affects of constant (+), brand attitudes and knowledge of the brand loyalty and brand value to the constant trademark (+). Brand value and brand loyalty and purchase intent-(+) in the United Kingdom, on the other hand, of the impact that do not affect that.

The knowledge competitiveness of regional economies: conceptualisation and measurement

Whereas the competitive advantage of firms can arise from size and position within their industry as well as physical assets, the pattern of competition in advanced economies has increasingly come to favour those firms that can mobilise knowledge and technological skills to create novelty in their products. At the same time, regions are attracting growing attention as an economic unit of analysis, with firms increasingly locating their functions in select regions within the global space. This article introduces the concept of knowledge competitiveness, defined as an economy’s knowledge capacity, capability and sustainability, and the extent to which this knowledge is translated into economic value and transferred into the wealth of the citizens. The article discusses the way in which the knowledge competitiveness of regions is measured and further introduces the World Knowledge Competitiveness Index, which is the first composite and relative measure of the knowledge competitiveness of the globe’s best performing regions.

Professionals, discretion and public sector reform in the UK:re-visiting Lipsky

Purpose – Seeks to examine how far Michael Lipsky's theory of discretion as it relates to public sector professionals as “street-level bureaucrats” is still applicable in the light of public sector reform and in particular the introduction of increased managerial control over professionals. Design/methodology/approach – The main thesis in Lipsky's work, Street-Level Bureaucracy, that street-level bureaucrats devise their own rules and procedures to deal with the dilemmas of policy implementation is linked to public sector reform over the past 25 years or so. The article differentiates between three forms of discretion, rule, task and value and assesses the extent to which these different forms of discretion have been compromised by reform. Examples are drawn principally from the literature on school teachers and social workers Findings – The findings suggest that the rule-making (hence bureaucratic) capacity of professionals at street-level is much less influential than before although it is questionable whether or not the greater accountability of professionals to management and clarity of the targets and objectives of organisations delivering public policy has liberated them from the dilemmas of street-level bureaucracy. Research limitations/implications – The work has focussed on the UK and in particular on two professions. However, it may be applied to any country which has undergone public sector reform and in particular where “new public management” processes and procedures have been implemented. There is scope for in-depth studies of a range of occupations, professional and otherwise in the UK and elsewhere. Practical implications – Policy makers and managers should consider how far the positive aspects of facilitating discretion in the workplace by reducing the need for “rule-making” to cope with dilemmas have been outweighed by increased levels of bureaucracy and the “de-skilling” of professionals. Originality/value – Lipsky's much cited and influential work is evaluated in the light of public sector reform some 25 years since it was published. The three forms of discretion identified offer the scope for their systematic application to the workplace.

Antecedents and consequences of service quality in consumer evaluation of self-service internet technologies

Advances in technology coupled with increasing labour costs have caused service firms to explore self-service delivery options. Although some studies have focused on self-service and use of technology in service delivery, few have explored the role of service quality in consumer evaluation of technology-based self-service options. By integrating and extending the self-service quality framework the service evaluation model and the Technology Acceptance Model the authors address this emerging issue by empirically testing a comprehensive model that captures the antecedents and consequences of perceived service quality to predict continued customer interaction in the technology-based self-service context of Internet banking. Important service evaluation constructs like perceived risk, perceived value and perceived satisfaction are modelled in this framework. The results show that perceived control has the strongest influence on service quality evaluations. Perceived speed of delivery, reliability and enjoyment also have a significant impact on service quality perceptions. The study also found that even though perceived service quality, perceived risk and satisfaction are important predictors of continued interaction, perceived customer value plays a pivotal role in influencing continued interaction.

Modelling the innovation value chain

Innovation events – the introduction of new products or processes – represent the end of a process of knowledge sourcing and transformation. They also represent the beginning of a process of exploitation which may result in an improvement in the performance of the innovating business. This recursive process of knowledge sourcing, transformation and exploitation comprises the innovation value chain. Modelling the innovation value chain for a large group of manufacturing firms in Ireland and Northern Ireland highlights the drivers of innovation, productivity and firm growth. In terms of knowledge sourcing,we find strong complementarity between horizontal, forwards, backwards, public and internal knowledge sourcing activities. Each of these forms of knowledge sourcing also makes a positive contribution to innovation in both products and processes although public knowledge sources have only an indirect effect on innovation outputs. In the exploitation phase, innovation in both products and processes contribute positively tocompany growth, with product innovation having a short-term ‘disruption’ effect on labour productivity. Modelling the complete innovation value chain highlights the structure and complexity of the process of translating knowledge into business value and emphasises the role of skills, capital investment and firms’ other resources in the value creation process.