Methods and trends of performance benchmarking in UK utility regulation

Regulation is subject to information asymmetries that can lead to allocative and productive inefficiencies. One solution, suggested by Shleifer in 1985 and now adopted by many regulatory bodies round the world, is 'benchmarking', which is sometimes called 'yardstick competition'. In this paper we consider Shleifer's original approach to benchmarking and contrast this with the actual use of benchmarking by UK regulatory bodies in telecommunications, water and the energy sector since the privatizations of the 1980s and early 1990s. We find that benchmarking plays only one part and sometimes a small part in the setting of regulatory price caps in the UK. We also find that in practice benchmarking has been subject to a number of difficulties, which mean that it is never likely to be more than one tool in the regulator's armoury. The UK's experience provides lessons for regulation internationally. © 2006 Elsevier Ltd. All rights reserved.

The impact of performance measurement in strategic planning

Purpose – To investigate the impact of performance measurement in strategic planning process. Design/methodology/approach – A large scale survey was conducted online with Warwick Business School alumni. The questionnaire was based on the Strategic Development Process model by Dyson. The questionnaire was designed to map the current practice of strategic planning and to determine its most influential factors on the effectiveness of the process. All questions were close ended and a seven-point Likert scale used. The independent variables were grouped into four meaningful factors by factor analysis (Varimax, coefficient of rotation 0.4). The factors produced were used to build regression models (stepwise) for the five assessments of strategic planning process. Regression models were developed for the totality of the responses, comparing SMEs and large organizations and comparing organizations operating in slowly and rapidly changing environments. Findings – The results indicate that performance measurement stands as one of the four main factors characterising the current practice of strategic planning. This research has determined that complexity coming from organizational size and rate of change in the sector creates variation in the impact of performance measurement in strategic planning. Large organizations and organizations operating in rapidly changing environments make greater use of performance measurement. Research limitations/implications – This research is based on subjective data, therefore the conclusions do not concern the impact of strategic planning process' elements on the organizational performance achievements, but on the success/effectiveness of the strategic planning process itself. Practical implications – This research raises a series of questions about the use and potential impact of performance measurement, especially in the categories of organizations that are not significantly influenced by its utilisation. It contributes to the field of performance measurement impact. Originality/value – This research fills in the gap literature concerning the lack of large scale surveys on strategic development processes and performance measurement. It also contributes in the literature of this field by providing empirical evidences on the impact of performance measurement upon the strategic planning process.

Assessing pupil and school performance by non-parametric and parametric techniques

This paper discusses the use of the non-parametric free disposal hull (FDH) and the parametric multi-level model (MLM) as alternative methods for measuring pupil and school attainment where hierarchical structured data are available. Using robust FDH estimates, we show how to decompose the overall inefficiency of a unit (a pupil) into a unit specific and a higher level (a school) component. By a sample of entry and exit attainments of 3017 girls in British ordinary single sex schools, we test the robustness of the non-parametric and parametric estimates. Finally, the paper uses the traditional MLM model in a best practice framework so that pupil and school efficiencies can be computed.

Seeing light vs dark lines: psychophysical performance is based on separate channels, limited by noise and uncertainty

Visual detection performance (d') is usually an accelerating function of stimulus contrast, which could imply a smooth, threshold-like nonlinearity in the sensory response. Alternatively, Pelli (1985 Journal of the Optical Society of America A 2 1508 - 1532) developed the 'uncertainty model' in which responses were linear with contrast, but the observer was uncertain about which of many noisy channels contained the signal. Such internal uncertainty effectively adds noise to weak signals, and predicts the nonlinear psychometric function. We re-examined these ideas by plotting psychometric functions (as z-scores) for two observers (SAW, PRM) with high precision. The task was to detect a single, vertical, blurred line at the fixation point, or identify its polarity (light vs dark). Detection of a known polarity was nearly linear for SAW but very nonlinear for PRM. Randomly interleaving light and dark trials reduced performance and rendered it non-linear for SAW, but had little effect for PRM. This occurred for both single-interval and 2AFC procedures. The whole pattern of results was well predicted by our Monte Carlo simulation of Pelli's model, with only two free parameters. SAW (highly practised) had very low uncertainty. PRM (with little prior practice) had much greater uncertainty, resulting in lower contrast sensitivity, nonlinear performance, and no effect of external (polarity) uncertainty. For SAW, identification was about v2 better than detection, implying statistically independent channels for stimuli of opposite polarity, rather than an opponent (light - dark) channel. These findings strongly suggest that noise and uncertainty, rather than sensory nonlinearity, limit visual detection.

Ethnic diversity as a multilevel construct:the combined effects of dissimilarity, group diversity, and societal status on learning performance in work groups

The authors present a model of the multilevel effects of diversity on individual learning performance in work groups. For ethnically diverse work groups, the model predicts that group diversity elicits either positive or negative effects on individual learning performance, depending on whether a focal individual’s ethnic dissimilarity from other group members is high or low. By further considering the societal status of an individual’s ethnic origin within society (Anglo versus non-Anglo for our U.K. context), the authors hypothesize that the model’s predictions hold more strongly for non-Anglo group members than for Anglo group members. We test this model with data from 412 individuals working on a 24-week business simulation in 87 four- to seven-person groups with varying degrees of ethnic diversity. Two of the three hypotheses derived from the model received full support and one hypothesis received partial support. Implications for theory development, methods, and practice in applied group diversity research are discussed.

Shareholder or stakeholder management:strategies for performance optimisation

This paper is based upon the findings of a CIMA research project into the way which corporate performance is affected by the performance measurement system adopted. It compares and contrasts the techniques in use in a sample of large companies that use a variety of techniques. We have classified these techniques into 3 types: • Value based management techniques • Stakeholder management techniques • Traditional accounting techniques. The analysis traces the interactions between corporate objectives, decision making criteria, performance measurement systems, and executive incentive schemes in order to develop an understanding of the effects of such techniques upon corporate performance. This paper seeks to provide some answers to the following two questions: • What approach leads to superior performance for a firm? • What is different between these approaches when they are used in practice, as distinct from theory? In doing so we have drawn upon both contingency theory and sociobiology theory to develop a framework for understanding the relationship between the choke of performance measurement system and the resulting performance.

Measuring the operational performance of intensive care units using the analytic hierarchy process approach

Purpose - The purpose of this study is to develop a performance measurement model for service operations using the analytic hierarchy process approach. Design/methodology/approach - The study reviews current relevant literature on performance measurement and develops a model for performance measurement. The model is then applied to the intensive care units (ICUs) of three different hospitals in developing nations. Six focus group discussions were undertaken, involving experts from the specific area under investigation, in order to develop an understandable performance measurement model that was both quantitative and hierarchical. Findings - A combination of outcome, structure and process-based factors were used as a foundation for the model. The analyses of the links between them were used to reveal the relative importance of each and their associated sub factors. It was considered to be an effective quantitative tool by the stakeholders. Research limitations/implications - This research only applies the model to ICUs in healthcare services. Practical implications - Performance measurement is an important area within the operations management field. Although numerous models are routinely being deployed both in practice and research, there is always room for improvement. The present study proposes a hierarchical quantitative approach, which considers both subjective and objective performance criteria. Originality/value - This paper develops a hierarchical quantitative model for service performance measurement. It considers success factors with respect to outcomes, structure and processes with the involvement of the concerned stakeholders based upon the analytic hierarchy process approach. The unique model is applied to the ICUs of hospitals in order to demonstrate its effectiveness. The unique application provides a comparative international study of service performance measurement in ICUs of hospitals in three different countries. © Emerald Group Publishing Limited.

Whole life performance assessment: critical success factors

Whole life costing (WLC) has become the best practice in construction procurement and it is likely to be a major issue in predicting whole life costs of a construction project accurately. However, different expectations from different organizations throughout a project's life and the lack of data, monitoring targets, and long-term interest for many key players are obstacles to be overcome if WLC is to be implemented. A questionnaire survey was undertaken to investigate a set of ten common factors and 188 individual factors. These were grouped into eight critical categories (project scope, time, cost, quality, contract/administration, human resource, risk, and health and safety) by project phase, as perceived by the clients, contractors and subcontractors in order to identify critical success factors for whole life performance assessment (WLPA). Using a relative importance index, the top ten critical factors for each category, from the perspective of project participants, were analyzed and ranked. Their agreement on those categories and factors were analyzed using Spearman's rank correlation. All participants identify “Type of Project” as the most common critical factor in the eight categories for WLPA. Using the relative index ranking technique and weighted average methods, it was found that the most critical individual factors in each category were: “clarity of contract” (scope); “fixed construction period” (time); “precise project budget estimate” (cost); “material quality” (quality); “mutual/trusting relationships” (contract/administration); “leadership/team management” (human resource); and “management of work safety on site” (health and safety). There was relatively a high agreement on these categories among all participants. Obviously, with 80 critical factors of WLPA, there is a stronger positive relationship between client and contactor rather than contractor and subcontractor, client and subcontractor. Putting these critical factors into a criteria matrix can facilitate an initial framework of WLPA in order to aid decision making in the public sector in South Korea for evaluation/selection process of a construction project at the bid stage.

Characteristics of UK firms related to timing of adoption of Statement of Standard Accounting Practice No. 20

This study examines whether the timing of adoption of the UK Statement of Standard Accounting Practice No. 20 'Foreign Currency Translation' depended on firms' financial characteristics. Consistent with US studies, we find that early adopters tended to be larger firms, and that variables, such as growth options, profitability, leverage and management payout, have strong predictive power. In general, the decision to adopt the Statement of Standard Accounting Practice No. 20 did not appear to adversely affect the profitability measures or dividend payout. Firms tended to adopt when the adverse economic consequences of the adoption were likely to be minimal. They also appeared to defer the adoption of the standard to influence their financial performance and, hence, to achieve certain corporate financial objectives. © 2006 AFAANZ.

Studies of the shellside performance of shell-and-tube heat exchangers

Accurate prediction of shellside pressure drop in a baffled shell-and-tube heat exchanger is very difficult because of the complicated shellside geometry. Ideally, all the shellside fluid should be alternately deflected across the tube bundle as it traverses from inlet to outlet. In practice, up to 60% of the shellside fluid may bypass the tube bundle or leak through the baffles. This short-circuiting of the main flow reduces the efficiency of the exchanger. Of the various shellside methods, it is shown that only the multi-stream methods, which attempt to obtain the shellside flow distribution, predict the pressure drop with any degree of accuracy, the various predictions ranging from -30% to +70%, generally overpredicting. It is shown that the inaccuracies are mainly due to the manner in which baffle leakage is modelled. The present multi-stream methods do not allow for interactions of the various flowstreams, and yet it is shown that three main effects are identified, a) there is a strong interaction between the main cross flow and the baffle leakage streams, enhancing the crossflow pressure drop, b) there is a further short-circuit not considered previously i.e. leakage in the window, and c) the crossflow does not penetrate as far, on average, as previously supposed. Models are developed for each of these three effects, along with a new windowflow pressure drop model, and it is shown that the effect of baffle leakage in the window is the most significant. These models developed to allow for various interactions, lead to an improved multi-stream method, named the "STREAM-INTERACTION" method. The overall method is shown to be consistently more accurate than previous methods, with virtually all the available shellside data being predicted to within ±30% and over 60% being within ±20%. The method is, thus, strongly recommended for use as a design method.

Strategic orientations in practice:Exploring the strategic belief structures of line-managers embedded in practice

Recently researchers have started to investigate the cognitive strategic orientations of individual top managers and have pointed out these may be key in determining the direction and success of their organizations in terms of performance, but they have been unable to effectively operationalize this notion in empirical research and this is holding up knowledge development. To make a contribution that helps overcome this limitation a theoretical framework is developed which specifies the different possible cognitive strategic orientations of top managers as well as those of managers at lower organizational levels involved in the strategy process. This theoretical framework is investigated in the empirical phase of the study into strategic orientations in practice. Additional contributions to knowledge of strategic orientation are made in three main domains. Firstly, current knowledge of strategic orientation is largely limited to analysis at the level of the firm whereas there is a lack of understanding of any relationships with practice at lower organizational levels. The exploratory research undertaken for this thesis contributes to new knowledge of different rational, developmental and interactive strategic orientations of front-line managers and this contributes to a cognitive explanation for emergent strategy linked to strategy processes embedded in practice. In theorising the presence of different strategic orientations in practice the discussion highlights the importance of network and spatial embeddedness within enacted environments. Secondly, a contribution to further knowledge of the links between strategy processes and the content of strategies within a retail context is made. The research highlights different strategy processes used in practice by retail front-line managers in a branch network of stores and these are linked to consequences such as different objectives, performance expectations and the fulfilment of personal goals. Thirdly, a contribution to research methodology is made by addressing problems associated with the comparison of cognitive maps.

A comparative and longitudinal analysis of the evolving relationship between the environment and the strategy, structure and performance of selected organisations in the British carpet industry 1959-1986:a firms in sector perspective of organisational adaptation

Orthodox contingency theory links effective organisational performance to compatible relationships between the environment and organisation strategy and structure and assumes that organisations have the capacity to adapt as the environment changes. Recent contributions to the literature on organisation theory claim that the key to effective performance is effective adaptation which in turn requires the simultaneous reconciliation of efficiency and innovation which is afforded by an unique environment-organisation configuration. The literature on organisation theory recognises the continuing confusion caused by the fragmented and often conflicting results from cross-sectional studies. Although the case is made for longitudinal studies which comprehensively describe the evolving relationship between the environment and the organisation there is little to suggest how such studies should be executed in practice. Typically the choice is between the approaches of the historicised case study and statistical analysis of large populations which examine the relationship between environment and organisation strategy and/or structure and ignore the product-process relationship. This study combines the historicised case study and the multi-variable and ordinal scale approach of statistical analysis to construct an analytical framework which tracks and exposes the environment-organisation-performance relationship over time. The framework examines changes in the environment, strategy and structure and uniquely includes an assessment of the organisation's product-process relationship and its contribution to organisational efficiency and innovation. The analytical framework is applied to examine the evolving environment-organisation relationship of two organisations in the same industry over the same twenty-five year period to provide a sector perspective of organisational adaptation. The findings demonstrate the significance of the environment-organisation configuration to the scope and frequency of adaptation and suggest that the level of sector homogeneity may be linked to the level of product-process standardisation.

Work stressors, strains and hospital unit performance

Hospital employees who work in an environment with zero tolerance to error, face several stressors that may result in psychological, physiological, and behavioural strains, and subsequently, in suboptimal performance. This thesis includes two studies which investigate the stressor-to-strain-to-performance relationships in hospitals. The first study is a cross-sectional, multi-group investigation based on secondary data from 65,142 respondents in 172 acute/specialist UK NHS trusts. This model proposes that senior management leadership predicts social support and job design which, in turn, moderate stressors-to-strains across team structure. The results confirm the model's robustness. Regression analysis provides support for main effects and minimal support for moderation hypotheses. Therefore, based on its conclusions and inherent limitations, study one lays the framework for study two. The second study is a cross-sectional, multilevel investigation of the strain-reducing effects of social environment on externally-rated unit-level performance based on primary data from 1,137 employees in 136 units, in a hospital in Malta. The term "social environment" refers to the prediction of the moderator variables, which is to say, social support and decision latitude/control, by transformational leadership and team climate across hospital units. This study demonstrates that transformational leadership is positively associated with social support, whereas team climate is positively associated with both moderators. At the same time, it identifies a number of moderating effects which social support and decision latitude/control, both separately and together, had on specific stressor-to-strain relationships. The results show significant mediated stressor-to-strain-to-performance relationships. Furthermore, at the higher level, unit-level performance is positively associated with shared unit-level team climate and with unit-level vision, the latter being one of the five sub-dimension of transformational leadership. At the same time, performance is also positively related to both transformational leadership and team climate when the two constructs are tested together. Few studies have linked the buffering effects of the social environment in occupational stress with performance. Therefore, this research strives to make a significant contribution to the occupational stress and performance literature with a focus on hospital practice. Indeed, the study highlights the wide-ranging and far-reaching implications that these findings provide for theory, management, and practice.

Real options and multinational investments : an empirical study of risk, performance and organisational awareness

DUE TO COPYRIGHT RESTRICTIONS ONLY AVAILABLE FOR CONSULTATION AT ASTON UNIVERSITY LIBRARY AND INFORMATION SERVICES WITH PRIOR ARRANGEMENT This thesis is a cross-disciplinary study of the empirical impact of real options theory in the fields of decision sciences and performance management. Borrowing from the economics, strategy and operations research literature, the research examines the risk and performance implications of real options in firms’ strategic investments and multinational operations. An emphasis is placed on the flexibility potential and competitive advantage of multinational corporations to explore the extent to which real options analysis can be classified as best practice in management research. Using a combination of qualitative and quantitative techniques the evidence suggests that, if real options are explored and exploited appropriately, real options management can result in superior performance for multinational companies. The qualitative findings give an overview of the practical advantages and disadvantages of real options and the statistical results reveal that firms which have developed a high awareness of their real options are, as predicted by the theory, able to reduce their downside risk and increase profits through flexibility, organisational slack and multinationality. Although real options awareness does not systematically guarantee higher returns from operations, supplementary findings indicate that firms with evidence of significant investments in the acquisition of real options knowledge tend to outperform competitors which are unaware of their real options. There are three contributions of this research. First, it extends the real options and capacity planning literature to path-dependent contingent-claims analysis to underline the benefits of average type options in capacity allocation. Second, it is thought to be the first to explicitly examine the performance effects of real options on a sample of firms which have developed partial capabilities in real options analysis suggesting that real options diffusion can be key to value creation. Third, it builds a new decision-aiding framework to facilitate the use of real options in projects appraisal and strategic planning.

Differences between theoretical predictions and operational performance in a stock control application

Over the past decade, several experienced Operational Researchers have advanced the view that the theoretical aspects of model building have raced ahead of the ability of people to use them. Consequently, the impact of Operational Research on commercial organisations and the public sector is limited, and many systems fail to achieve their anticipated benefits in full. The primary objective of this study is to examine a complex interactive Stock Control system, and identify the reasons for the differences between the theoretical expectations and the operational performance. The methodology used is to hypothesise all the possible factors which could cause a divergence between theory and practice, and to evaluate numerically the effect each of these factors has on two main control indices - Service Level and Average Stock Value. Both analytical and empirical methods are used, and simulation is employed extensively. The factors are divided into two main categories for analysis - theoretical imperfections in the model, and the usage of the system by Buyers. No evidence could be found in the literature of any previous attempts to place the differences between theory and practice in a system in quantitative perspective nor, more specifically, to study the effects of Buyer/computer interaction in a Stock Control system. The study reveals that, in general, the human factors influencing performance are of a much higher order of magnitude than the theoretical factors, thus providing objective evidence to support the original premise. The most important finding is that, by judicious intervention into an automatic stock control algorithm, it is possible for Buyers to produce results which not only attain but surpass the algorithmic predictions. However, the complexity and behavioural recalcitrance of these systems are such that an innately numerate, enquiring type of Buyer needs to be inducted to realise the performance potential of the overall man/computer system.