Comparative performance measurement in regulation: The case of English and Welsh sewerage services

This paper discusses the use of comparative performance measurement by means of Data Envelopment Analysis in the context of the regulation of English and Welsh water companies. Specifically, the use of Data Envelopment Analysis to estimate potential cost savings in sewerage is discussed as it fed into the price review of water companies carried out by the regulator of water companies in 1994. The application is used as a vehicle for highlighting generic issues in terms of assessing the impact of factors on the ranking of units on performance, the insights gained from using alternative methods to assess comparative performance, and the issue of assessing comparative performance when few in number but highly complex entities are involved. The paper should prove of interest to those interested in regulation and, more generally, in the use of methods of comparative performance measurement.

Assessing pupil and school performance by non-parametric and parametric techniques

This paper discusses the use of the non-parametric free disposal hull (FDH) and the parametric multi-level model (MLM) as alternative methods for measuring pupil and school attainment where hierarchical structured data are available. Using robust FDH estimates, we show how to decompose the overall inefficiency of a unit (a pupil) into a unit specific and a higher level (a school) component. By a sample of entry and exit attainments of 3017 girls in British ordinary single sex schools, we test the robustness of the non-parametric and parametric estimates. Finally, the paper uses the traditional MLM model in a best practice framework so that pupil and school efficiencies can be computed.

Supply chain performance measurement framework:case studies on the Thai manufacturers

One of the most significant paradigm shifts of modern business management is that individual businesses no longer compete as solely autonomous entities, but rather as supply chains. Firms worldwide have embraced the concept of supply chain management as important and sometimes critical to their business. The idea of a collaborative supply chain is to gain a competitive advantage by improving overall performance through measuring a holistic perspective of the supply chain. However, contemporary performance measurement theory is somewhat fragmented and fails to support this idea. Therefore, this research develops and applies an integrated supply chain performance measurement framework that provides a more holistic approach to the study of supply chain performance measurement by combining both supply chain macro processes and decision making levels. Therefore, the proposed framework can provide a balanced horizontal (cross-process) and vertical (hierarchical decision) view and measure the performance of the entire supply chain system. Firstly, literature on performance measurement frameworks and performance measurement factors of supply chain management will help to develop a conceptual framework. Next the proposed framework will be presented. The framework will be validated through in-depth interviews with three Thai manufacturing companies. The fieldwork combined varied sources in order to understand the views of manufacturers on supply chain performance in the three case study companies. The collected data were analyzed, interpreted, and reported using thematic analysis and analysis hierarchy process (AHP), which was influenced by the study’s conceptual framework. This research contributes a new theory of supply chain performance measurement and knowledge on supply chain characteristics of a developing country, Thailand. The research also affects organisations by preparing decision makers to make strategic, tactical and operational level decisions with respect to supply chain macro processes. The results from the case studies also indicate the similarities and differences in their supply chain performance. Furthermore, the implications of the study are offered for both academic and practical use.

New insights on measuring bank branches efficiency through DEA:transactional, operational, and profit assessments

This thesis presents a number of methodological developments that were raised by a real life application to measuring the efficiency of bank branches. The advent of internet banking and phone banking is changing the role of bank branches from a predominantly transaction-based one to a sales-oriented role. This fact requires the development of new forms of assessing and comparing branches of a bank. In addition, performance assessment models must also take into account the fact that bank branches are service and for-profit organisations to which providing adequate service quality as well as being profitable are crucial objectives. This study analyses bank branches performance in their new roles in three different areas: their effectiveness in fostering the use of new transaction channels such as the internet and the telephone (transactional efficiency); their effectiveness in increasing sales and their customer base (operational efficiency); and their effectiveness in generating profits without compromising the quality of service (profit efficiency). The chosen methodology for the overall analysis is Data Envelopment Analysis (DEA). The application attempted here required some adaptations to existing DEA models and indeed some new models so that some specialities of our data could be handled. These concern the development of models that can account for negative data, the development of models to measure profit efficiency, and the development of models that yield production units with targets that are nearer to their observed levels than targets yielded by traditional DEA models. The application of the developed models to a sample of Portuguese bank branches allowed their classification according to the three performance dimensions (transactional, operational and profit efficiency). It also provided useful insights to bank managers regarding how bank branches compare between themselves in terms of their performance, and how, in general, the three performance dimensions are connected between themselves.

Evaluating the impact of design decisions on the financial performance of manufacturing companies

Product design decisions can have a significant impact on the financial and operation performance of manufacturing companies. Therefore good analysis of the financial impact of design decisions is required if the profitability of the business is to be maximised. The product design process can be viewed as a chain of decisions which links decisions about the concept to decisions about the detail. The idea of decision chains can be extended to include the design and operation of the 'downstream' business processes which manufacture and support the product. These chains of decisions are not independent but are interrelated in a complex manner. To deal with the interdependencies requires a modelling approach which represents all the chains of decisions, to a level of detail not normally considered in the analysis of product design. The operational, control and financial elements of a manufacturing business constitute a dynamic system. These elements interact with each other and with external elements (i.e. customers and suppliers). Analysing the chain of decisions for such an environment requires the application of simulation techniques, not just to any one area of interest, but to the whole business i.e. an enterprise simulation. To investigate the capability and viability of enterprise simulation an experimental 'Whole Business Simulation' system has been developed. This system combines specialist simulation elements and standard operational applications software packages, to create a model that incorporates all the key elements of a manufacturing business, including its customers and suppliers. By means of a series of experiments, the performance of this system was compared with a range of existing analysis tools (i.e. DFX, capacity calculation, shop floor simulator, and business planner driven by a shop floor simulator).

Visual performance of the human eye with soft hydrophilic contact lenses

The recording of visual acuity using the Snellen letter chart is only a limited measure of the visual performance of an eye wearing a refractive aid. Qualitative in addition to quantitative information is required to establish such a parameter: spatial, temporal and photometric aspects must all be incorporated into the test procedure. The literature relating to the correction of ametropia by refractive aids was reviewed. Selected aspects of a comparison between the correction provided by spectacles and contact lenses were considered. Special attention was directed to soft hydrophilic contact lenses. Despite technological advances which have produced physiologically acceptable soft lenses, there still remain associated with this recent form of refractive aid unpredictable visual factors. Several techniques for vision assessment were described, and previous studies of visual performance were discussed. To facilitate the investigation of visual performance in a clinical environment, a new semi-automated system was described: this utilized the presentation of broken ring test stimuli on a television screen. The research project comprised two stages. Initial work was concerned with the validation of the television system, including the optimization of its several operational variables. The second phase involved the utilization of the system in an investigation of visual performance aspects of the first month of regular daily soft contact lens wear by experimentally-naive subjects. On the basis of the results of this work an ‘homoeostatic’ model has been proposed to represent the strategy which an observer adopts in order to optimize his visual performance with soft contact lenses.

Professionals' awareness of operational antibiotic prescribing controls in UK NHS hospitals

In recent years, there have been increasing recommendations for multidisciplinary collaboration between clinical pharmacists and medical microbiologists in an attempt to control the quality (and quantity) of antibiotic prescribing. A questionnaire addressing the utilization of antibiotic prescribing controls was sent to the chief pharmacist and medical microbiologist in UK NHS hospitals. Responses were received from both the chief pharmacist and the medical microbiologist employed in the same hospital from 83 hospitals (a 30% response rate from two independent studies). A high level of disagreement and poor awareness was identified between the interprofessional staff groups regarding the existence of antibiotic formulary (with disagreement between the two groups, or not known by one or both respondents, in 46% of the paired hospitals, N=38) and guideline documents (13%, N=11), performance of antibiotic prescribing audits (40%, N=33), and whether pharmacists (52%, N=43) and medical microbiologists (77%, N=64) monitored physician compliance with antibiotic prescribing control documents. This study has identified poor knowledge of the existence of basic antibiotic prescribing control mechanisms and the role of professional colleagues. It is suggested that there is some way to go before 'Agenda for Change' principles of flexible and collaborative roles are met. © 2004 The Hospital Infection Society. Published by Elsevier Ltd. All rights reserved.

Real options in management and organizational strategy:a review of decision-making and performance implications

This paper contributes to the debate on the role of real options theory in business strategy and organizational decision-making. It analyses and critiques the decision-making and performance implications of real options within the management theories of the (multinational) firm, reviews and categorizes the organizational, strategic and operational facets of real options management in large business settings. It also presents the views of scholars and practitioners regarding the incorporation and validity of real options in strategy, international management and business processes. The focus is particularly on the decision-making and performance attributes of the real options logic concerning strategic investments, governance modes and multinational operations management. These attributes are examined from both strategic and operating perspectives of decision-making in organizations, also with an overview of the empirical evidence on real options decision-making and performance.

Selection of simulation tools for improving supply chain performance

Simulation is an effective method for improving supply chain performance. However, there is limited advice available to assist practitioners in selecting the most appropriate method for a given problem. Much of the advice that does exist relies on custom and practice rather than a rigorous conceptual or empirical analysis. An analysis of the different modelling techniques applied in the supply chain domain was conducted, and the three main approaches to simulation used were identified; these are System Dynamics (SD), Discrete Event Simulation (DES) and Agent Based Modelling (ABM). This research has examined these approaches in two stages. Firstly, a first principles analysis was carried out in order to challenge the received wisdom about their strengths and weaknesses and a series of propositions were developed from this initial analysis. The second stage was to use the case study approach to test these propositions and to provide further empirical evidence to support their comparison. The contributions of this research are both in terms of knowledge and practice. In terms of knowledge, this research is the first holistic cross paradigm comparison of the three main approaches in the supply chain domain. Case studies have involved building ‘back to back’ models of the same supply chain problem using SD and a discrete approach (either DES or ABM). This has led to contributions concerning the limitations of applying SD to operational problem types. SD has also been found to have risks when applied to strategic and policy problems. Discrete methods have been found to have potential for exploring strategic problem types. It has been found that discrete simulation methods can model material and information feedback successfully. Further insights have been gained into the relationship between modelling purpose and modelling approach. In terms of practice, the findings have been summarised in the form of a framework linking modelling purpose, problem characteristics and simulation approach.

Uses of frontier efficiency methodologies and multi-criteria decision making for performance measurement in the energy sector

Guest editorial Ali Emrouznejad is a Senior Lecturer at the Aston Business School in Birmingham, UK. His areas of research interest include performance measurement and management, efficiency and productivity analysis as well as data mining. He has published widely in various international journals. He is an Associate Editor of IMA Journal of Management Mathematics and Guest Editor to several special issues of journals including Journal of Operational Research Society, Annals of Operations Research, Journal of Medical Systems, and International Journal of Energy Management Sector. He is in the editorial board of several international journals and co-founder of Performance Improvement Management Software. William Ho is a Senior Lecturer at the Aston University Business School. Before joining Aston in 2005, he had worked as a Research Associate in the Department of Industrial and Systems Engineering at the Hong Kong Polytechnic University. His research interests include supply chain management, production and operations management, and operations research. He has published extensively in various international journals like Computers & Operations Research, Engineering Applications of Artificial Intelligence, European Journal of Operational Research, Expert Systems with Applications, International Journal of Production Economics, International Journal of Production Research, Supply Chain Management: An International Journal, and so on. His first authored book was published in 2006. He is an Editorial Board member of the International Journal of Advanced Manufacturing Technology and an Associate Editor of the OR Insight Journal. Currently, he is a Scholar of the Advanced Institute of Management Research. Uses of frontier efficiency methodologies and multi-criteria decision making for performance measurement in the energy sector This special issue aims to focus on holistic, applied research on performance measurement in energy sector management and for publication of relevant applied research to bridge the gap between industry and academia. After a rigorous refereeing process, seven papers were included in this special issue. The volume opens with five data envelopment analysis (DEA)-based papers. Wu et al. apply the DEA-based Malmquist index to evaluate the changes in relative efficiency and the total factor productivity of coal-fired electricity generation of 30 Chinese administrative regions from 1999 to 2007. Factors considered in the model include fuel consumption, labor, capital, sulphur dioxide emissions, and electricity generated. The authors reveal that the east provinces were relatively and technically more efficient, whereas the west provinces had the highest growth rate in the period studied. Ioannis E. Tsolas applies the DEA approach to assess the performance of Greek fossil fuel-fired power stations taking undesirable outputs into consideration, such as carbon dioxide and sulphur dioxide emissions. In addition, the bootstrapping approach is deployed to address the uncertainty surrounding DEA point estimates, and provide bias-corrected estimations and confidence intervals for the point estimates. The author revealed from the sample that the non-lignite-fired stations are on an average more efficient than the lignite-fired stations. Maethee Mekaroonreung and Andrew L. Johnson compare the relative performance of three DEA-based measures, which estimate production frontiers and evaluate the relative efficiency of 113 US petroleum refineries while considering undesirable outputs. Three inputs (capital, energy consumption, and crude oil consumption), two desirable outputs (gasoline and distillate generation), and an undesirable output (toxic release) are considered in the DEA models. The authors discover that refineries in the Rocky Mountain region performed the best, and about 60 percent of oil refineries in the sample could improve their efficiencies further. H. Omrani, A. Azadeh, S. F. Ghaderi, and S. Abdollahzadeh presented an integrated approach, combining DEA, corrected ordinary least squares (COLS), and principal component analysis (PCA) methods, to calculate the relative efficiency scores of 26 Iranian electricity distribution units from 2003 to 2006. Specifically, both DEA and COLS are used to check three internal consistency conditions, whereas PCA is used to verify and validate the final ranking results of either DEA (consistency) or DEA-COLS (non-consistency). Three inputs (network length, transformer capacity, and number of employees) and two outputs (number of customers and total electricity sales) are considered in the model. Virendra Ajodhia applied three DEA-based models to evaluate the relative performance of 20 electricity distribution firms from the UK and the Netherlands. The first model is a traditional DEA model for analyzing cost-only efficiency. The second model includes (inverse) quality by modelling total customer minutes lost as an input data. The third model is based on the idea of using total social costs, including the firm’s private costs and the interruption costs incurred by consumers, as an input. Both energy-delivered and number of consumers are treated as the outputs in the models. After five DEA papers, Stelios Grafakos, Alexandros Flamos, Vlasis Oikonomou, and D. Zevgolis presented a multiple criteria analysis weighting approach to evaluate the energy and climate policy. The proposed approach is akin to the analytic hierarchy process, which consists of pairwise comparisons, consistency verification, and criteria prioritization. In the approach, stakeholders and experts in the energy policy field are incorporated in the evaluation process by providing an interactive mean with verbal, numerical, and visual representation of their preferences. A total of 14 evaluation criteria were considered and classified into four objectives, such as climate change mitigation, energy effectiveness, socioeconomic, and competitiveness and technology. Finally, Borge Hess applied the stochastic frontier analysis approach to analyze the impact of various business strategies, including acquisition, holding structures, and joint ventures, on a firm’s efficiency within a sample of 47 natural gas transmission pipelines in the USA from 1996 to 2005. The author finds that there were no significant changes in the firm’s efficiency by an acquisition, and there is a weak evidence for efficiency improvements caused by the new shareholder. Besides, the author discovers that parent companies appear not to influence a subsidiary’s efficiency positively. In addition, the analysis shows a negative impact of a joint venture on technical efficiency of the pipeline company. To conclude, we are grateful to all the authors for their contribution, and all the reviewers for their constructive comments, which made this special issue possible. We hope that this issue would contribute significantly to performance improvement of the energy sector.

Assessment of national health systems performance in the WHO African region

There is growing peer and donor pressure on African countries to utilize available resources more efficiently in a bid to support the ongoing efforts to expand coverage of health interventions with a view to achieving the health-related Millennium Development Goals. The purpose of this study was to estimate the technical and scale efficiency of national health systems in African continent. Methods The study applied the Data Envelopment Analysis approach to estimate the technical efficiency and scale efficiency among the 53 countries of the African Continent. Results Out of the 38 low-income African countries, 12 countries national health systems manifested a constant returns to scale technical efficiency (CRSTE) score of 100%; 15 countries had a VRSTE score of 100%; and 12 countries had a SE score of one. The average variable returns to scale technical efficiency (VRSTE) score was 95% and the mean scale efficiency (SE) score was 59%; meaning that while on average the degree of inefficiency was only 5%, the magnitude of scale inefficiency was 41%. Of the 15 middle-income countries, 5 countries, 9 countries and 5 countries had CRSTE, VRSTE and SE scores of 100%. Ten countries, six countries and 10 countries had CRSTE, VRSTE and SE scores of less than 100%; and thus, they were deemed inefficient. The average VRSTE (i.e. pure efficiency) score was 97.6%. The average SE score was 49.9%. Conclusion There are large unmet need for health and health-related services among countries of the African Continent. Thus, it would not be advisable for health policy-makers address NHS inefficiencies through reduction in excess human resources for health. Instead, it would be more prudent for them to leverage health promotion approaches and universal access prepaid (tax-based, insurance-based or mixtures) health financing systems to create demand for under utilised health services/interventions with a view to increasing ultimate health outputs to efficient target levels.