Stakeholder performance measurement:general approaches and methods of economic evaluation

This paper begins by suggesting that when considering Corporate Social Responsibility (CSR), even CSR as justified in terms of the business case, stakeholders are of great importance to corporations. In the UK the Company Law Review (DTI, 2002) has suggested that it is appropriate for UK companies to be managed upon the basis of an enlightened shareholder approach. Within this approach the importance of stakeholders, other than shareholders, is recognised as being instrumental in succeeding in providing shareholder value. Given the importance of these other stakeholders it is then important that corporate management measure and manage stakeholder performance. In order to do this there are two general approaches that could be adopted and these are the use of monetary values to reflect stakeholder value or cost and non-monetary values. In order to consider these approaches further this paper considered the possible use of these approaches for two stakeholder groups: namely employees and the environment. It concludes that there are ethical and practical difficulties with calculating economic values for stakeholder resources and so prefers a multi-dimensional approach to stakeholder performance measurement that does not use economic valuation.

Computer automation of land evaluation procedures

This study was concerned with the computer automation of land evaluation. This is a broad subject with many issues to be resolved, so the study concentrated on three key problems: knowledge based programming; the integration of spatial information from remote sensing and other sources; and the inclusion of socio-economic information into the land evaluation analysis. Land evaluation and land use planning were considered in the context of overseas projects in the developing world. Knowledge based systems were found to provide significant advantages over conventional programming techniques for some aspects of the land evaluation process. Declarative languages, in particular Prolog, were ideally suited to integration of social information which changes with every situation. Rule-based expert system shells were also found to be suitable for this role, including knowledge acquisition at the interview stage. All the expert system shells examined suffered from very limited constraints to problem size, but new products now overcome this. Inductive expert system shells were useful as a guide to knowledge gaps and possible relationships, but the number of examples required was unrealistic for typical land use planning situations. The accuracy of classified satellite imagery was significantly enhanced by integrating spatial information on soil distribution for Thailand data. Estimates of the rice producing area were substantially improved (30% change in area) by the addition of soil information. Image processing work on Mozambique showed that satellite remote sensing was a useful tool in stratifying vegetation cover at provincial level to identify key development areas, but its full utility could not be realised on typical planning projects, without treatment as part of a complete spatial information system.

Crossover evaluation of silicone hydrogel daily disposable contact lenses

PURPOSE: To assess the surface tear breakup time and clinical performance of three daily disposable silicone hydrogel contact lenses over 16 hours of wear. METHODS: Thirty-nine patients (mean [±SD] age, 22.1 [±3.5] years) bilaterally wore (narafilcon A, filcon II-3, and delefilcon A) contact lenses in a prospective, randomized, masked, 1-week crossover clinical trial. Tear film was assessed by the tear meniscus height (TMH), ocular/contact lens surface temperature dynamics, and lens surface noninvasive breakup time at 8, 12, and 16 hours of wear. Clinical performance and ocular physiology were assessed by subjective questionnaire, by high-/low-contrast logMAR (logarithm of the minimum angle of resolution) acuity, and through bulbar and limbal hyperemia grading. Corneal and conjunctival staining were assessed after lens removal. RESULTS: Delefilcon A demonstrated a longer noninvasive breakup time (13.4 [±4.4] seconds) than filcon II-3 (11.6 [±3.7] seconds; p < 0.001) and narafilcon A (12.3 [±3.7] seconds; p < 0.001). A greater TMH (0.35 [±0.11] mm) was shown by delefilcon A than filcon II-3 (0.32 [±0.10] seconds; p = 0.016). Delefilcon A showed less corneal staining after 16 hours of lens wear (0.7 [±0.6] Efron grade) than filcon II-3 (1.1 [±0.7]; p < 0.001) and narafilcon A (0.9 [±0.7]; p = 0.031). Time was not a significant factor for prelens tear film stability (F = 0.594, p = 0.555) or TMH (F = 0.632, p = 0.534). Lens brand did not affect temperature (F = 1.220, p = 0.308), but it decreased toward the end of the day (F = 19.497, p < 0.001). Comfort, quality of vision, visual acuity and contrast acuity, and limbal grading were similar between the lens brands but decreased with time during the day (p < 0.05). CONCLUSIONS: The tear breakup time over the contact lens surface differed between lens types and may have a role in protecting the ocular surface.

The evaluation of information systems in the organisational context of the National Health Service. Available in 2 volumes.

This thesis describes a project which has investigated the evaluation of information systems. The work took place in, and is related to, a specific organisational context, that of the National Health Service (NHS). It aims to increase understanding of the evaluation which takes place in the service and the way in which this is affected by the NHS environment. It also investigates the issues which surround some important types of evaluation and their use in this context. The first stage of the project was a postal survey in which respondents were asked to describe the evaluation which took place in their authorities and to give their opinions about it. This was used to give an overview of the practice of IS evaluation in the NHS and to identify its uses and the problems experienced. Three important types of evaluation were then examined in more detail by means of action research studies. One of these dealt with the selection and purchase of a large hospital information system. The study took the form of an evaluation of the procurement process, and examined the methods used and the influence of organisational factors. The other studies are concerned with post-implementation evaluation, and examine the choice of an evaluation approach as well as its application. One was an evaluation of a community health system which had been operational for some time but was of doubtful value, and suffered from a number of problems. The situation was explored by means of a study of the costs and benefits of the system. The remaining study was the initial review of a system which was used in the administration of a Breast Screening Service. The service itself was also newly operational and the relationship between the service and the system was of interest.

The finance of biotechnology:investment in new biotechnology firms by British venture capitalists-attitudes to, and evaluation of, business proposals

A notable feature of the recent commercialisation of biotechnology has been the success of 200 or so new firms, established in America since 1976, in exploiting specialised market niches. A key factor in their formation has been the ready availability of venture capital funding. These firms have been instrumental in establishing America's lead in exploiting biotechnology. It is this example which Britain has attempted to emulate as part of its strategy for developing its own biotechnology capabilities. This thesis investigated some aspects of the relationship between biotechnology and venture capital, concentrating on the determinants of the venture capitalist's investment decision. Following an extensive literature survey, two hypothetical business proposals were used to find what venture capitalists themselves consider to be the key elements of this decision. It was found that venture capitalists invest in people, not products, and businesses, not industries. It was concluded that venture capital-backed small firms should, therefore, be seen as an adjunct to the development of biotechnology in Britain, rather than as a substitute for a co-ordinated, co-operative strategy involving Government, the financial institutions, industry and academia. This is chiefly because the small size of the UK's domestic market means that many potentially important innovations in biotechnology may continue to be lost, since the short term identification of market opportunities for biotechnology products will dictate that they are insupportable in Britain alone. In addition, the data analysis highlighted some interesting methodological issues concerning the investigation of investment decision making. These related especially to shortcomings in the use of scoresheets and questionnaires in research in this area. The conclusion here was that future research should concentrate on the reasons why an individual reaches an investment decision. It is argued that only in this way can the nature of the evaluation procedures employed by venture capitalists be properly understood.

The sustained delivery of antisense oligodeoxynucleotides using biodegradable polymer microspheres

Antisense technology is a novel drug discovery method, which provides an essential tool for directly using gene sequence information to rationally design specific inhibitions of mRNA, to treat a wide range of diseases. The efficacy of naked oligodeoxynucleotides (ODNs) is relatively short lived due to rapid degradation in vivo. The entrapment of ODNs within biodegradable sustained-release delivery systems may improve ODN stability and reduce dose required for efficacy. Biodegradable polymer microspheres were evaluated as delivery devices for ODNs and ribozymes. Poly(lactide-co-glycolide) polymers were used due to their biocompatibility and non toxic degradation products. Microspheres were prepared using a double emulsion-deposition method and the formulations characterised. In vitro release profiles were characterised by an initial burst effect during the first 48 hours of release followed by a more sustained release. The release profiles were influenced by microsphere size, copolymer molecular weight, copolymer ratio, ODN loading, ODN length, and ODN chemistry. The serum stability of ODNs was significantly improved when entrapped within polymer microspheres. The cellular association of ODNs entrapped within small spheres (1-2μm) was improved by approximately 20-fold in A431 carcinoma cells compared with free ODNs. Fluorescence microscopy studies showed a more diffuse subcellular distribution when delivered as a microsphere formulation compared with free ODNs, which exhibited the characteristic punctate periplasmic distribution. For in vivo evaluation, polymer microspheres containing fluorescently-labelled ODNs were stereo-taxically administered to the neostriatum of the rat brain. Free ODN resulted in a punctate cellular distribution after 24 hours. In comparison ODN delivered using polymer microspheres were intensely visible in cells 48 hours post administration, and fluorescence appeared to be diffuse covering both cytosolic and nuclear regions. Whole-body autoradiography was also used to evaluate the biodistribution of free tritium labelled ODN and ODN entrapped microspheres, following subcutaneous administration to Balb-C mice. Polymer entrapped ODN gave a similar biodistribution to free ODN. Free ODN was distributed within 24 hours, whereas polymer released ODN was observed still presented in organs and at the site of administration seven days post administration.

Evaluation of the quality and promotion of open learning materials

In the UK, Open Learning has been used in industrial training for at least the last decade. Trainers and Open Learning practitioners have been concerned about the quality of the products and services being delivered. The argument put forward in this thesis is that there is ambiguity amongst industrialists over the meanings of `Open Learning' and `Quality in Open Learning'. For clarity, a new definition of Open Learning is proposed which challenges the traditional learner-centred approach favoured by educationalists. It introduces the concept that there are benefits afforded to the trainer/employer/teacher as well as to the learner. This enables a focussed view of what quality in Open Learning really means. Having discussed these issues, a new quantitative method of evaluating Open Learning is proposed. This is based upon an assessment of the degree of compliance with which products meet Parts 1 & 2 of the Open Learning Code of Practice. The vehicle for these research studies has been a commercial contract commissioned by the Training Agency for the Engineering Industry Training Board (EITB) to examine the quality of Open Learning products supplied to the engineering industry. A major part of this research has been the application of the evaluation technique to a range of 67 Open Learning products (in eight subject areas). The findings were that good quality products can be found right across the price range - so can average and poor quality ones. The study also shows quite convincingly that there are good quality products to be found at less than 50. Finally the majority (24 out of 34) of the good quality products were text based.

The evaluation and development of the lead authority partnership scheme as a central intervention strategy for health and safety enforcement by local authorities

The research comprises a suite of studies that examines and develops the Lead Authority Partnership Scheme (LAPS) as a central intervention strategy for health and safety by local authority (LA) enforcers. Partnership working is a regulatory concept that in recent years has become more popular but there has been little research conducted to investigate, explore and evaluate its practical application. The study reviewed two contrasting approaches to partnership working between LAs and businesses, both of which were intended to secure improvements in the consistency of enforcement by the regulators and in the health and safety management systems of the participating businesses. The first was a well-established and highly prescriptive approach that required a substantial resource commitment on the part of the LA responsible for conducting a safety management review (SMR) of the business. As a result of his evaluation of the existing ‘full SMR’ scheme, the author developed a second, more flexible approach to partnership working. The research framework was based upon a primarily qualitative methodology intended to investigate and explore the impact of the new flexible arrangements for partnership working. The findings from this study of the flexible development of the scheme were compared and contrasted with those from studies of the established ‘full SMR’ scheme. A substantial degree of triangulation was applied in an attempt to strengthen validity and broaden applicability of the research findings. Key informant interviews, participant observation, document/archive reviews, questionnaires and surveys all their particular part to play in the overall study. The findings from this research revealed that LAPS failed to deliver consistency of LA enforcement across multiple-outlet businesses and the LA enforced business sectors. Improvement was however apparent in the safety management systems of the businesses participating in LAPS. Trust between LA inspector and safety professional was key to the success of the partnerships as was the commitment of these key individuals. Competition for precious LA resources, the priority afforded to food safety over health and safety, the perceived high resource demands of LAPS, and the structure and culture of LAs were identified as significant barriers to LA participation. Flexible approaches, whilst addressing the resource issues, introduced some fresh concerns relating to credibility and delivery. Over and above the stated aims of the scheme, LAs and businesses had their own reasons for participation, notably the personal development of individuals and kudos for the organisation. The research has explored the wider implications for partnership working with the overall conclusion it is most appropriately seen as a strategic level element within a broader structured intervention strategy.

Uses of frontier efficiency methodologies and multi-criteria decision making for performance measurement in the energy sector

Guest editorial Ali Emrouznejad is a Senior Lecturer at the Aston Business School in Birmingham, UK. His areas of research interest include performance measurement and management, efficiency and productivity analysis as well as data mining. He has published widely in various international journals. He is an Associate Editor of IMA Journal of Management Mathematics and Guest Editor to several special issues of journals including Journal of Operational Research Society, Annals of Operations Research, Journal of Medical Systems, and International Journal of Energy Management Sector. He is in the editorial board of several international journals and co-founder of Performance Improvement Management Software. William Ho is a Senior Lecturer at the Aston University Business School. Before joining Aston in 2005, he had worked as a Research Associate in the Department of Industrial and Systems Engineering at the Hong Kong Polytechnic University. His research interests include supply chain management, production and operations management, and operations research. He has published extensively in various international journals like Computers & Operations Research, Engineering Applications of Artificial Intelligence, European Journal of Operational Research, Expert Systems with Applications, International Journal of Production Economics, International Journal of Production Research, Supply Chain Management: An International Journal, and so on. His first authored book was published in 2006. He is an Editorial Board member of the International Journal of Advanced Manufacturing Technology and an Associate Editor of the OR Insight Journal. Currently, he is a Scholar of the Advanced Institute of Management Research. Uses of frontier efficiency methodologies and multi-criteria decision making for performance measurement in the energy sector This special issue aims to focus on holistic, applied research on performance measurement in energy sector management and for publication of relevant applied research to bridge the gap between industry and academia. After a rigorous refereeing process, seven papers were included in this special issue. The volume opens with five data envelopment analysis (DEA)-based papers. Wu et al. apply the DEA-based Malmquist index to evaluate the changes in relative efficiency and the total factor productivity of coal-fired electricity generation of 30 Chinese administrative regions from 1999 to 2007. Factors considered in the model include fuel consumption, labor, capital, sulphur dioxide emissions, and electricity generated. The authors reveal that the east provinces were relatively and technically more efficient, whereas the west provinces had the highest growth rate in the period studied. Ioannis E. Tsolas applies the DEA approach to assess the performance of Greek fossil fuel-fired power stations taking undesirable outputs into consideration, such as carbon dioxide and sulphur dioxide emissions. In addition, the bootstrapping approach is deployed to address the uncertainty surrounding DEA point estimates, and provide bias-corrected estimations and confidence intervals for the point estimates. The author revealed from the sample that the non-lignite-fired stations are on an average more efficient than the lignite-fired stations. Maethee Mekaroonreung and Andrew L. Johnson compare the relative performance of three DEA-based measures, which estimate production frontiers and evaluate the relative efficiency of 113 US petroleum refineries while considering undesirable outputs. Three inputs (capital, energy consumption, and crude oil consumption), two desirable outputs (gasoline and distillate generation), and an undesirable output (toxic release) are considered in the DEA models. The authors discover that refineries in the Rocky Mountain region performed the best, and about 60 percent of oil refineries in the sample could improve their efficiencies further. H. Omrani, A. Azadeh, S. F. Ghaderi, and S. Abdollahzadeh presented an integrated approach, combining DEA, corrected ordinary least squares (COLS), and principal component analysis (PCA) methods, to calculate the relative efficiency scores of 26 Iranian electricity distribution units from 2003 to 2006. Specifically, both DEA and COLS are used to check three internal consistency conditions, whereas PCA is used to verify and validate the final ranking results of either DEA (consistency) or DEA-COLS (non-consistency). Three inputs (network length, transformer capacity, and number of employees) and two outputs (number of customers and total electricity sales) are considered in the model. Virendra Ajodhia applied three DEA-based models to evaluate the relative performance of 20 electricity distribution firms from the UK and the Netherlands. The first model is a traditional DEA model for analyzing cost-only efficiency. The second model includes (inverse) quality by modelling total customer minutes lost as an input data. The third model is based on the idea of using total social costs, including the firm’s private costs and the interruption costs incurred by consumers, as an input. Both energy-delivered and number of consumers are treated as the outputs in the models. After five DEA papers, Stelios Grafakos, Alexandros Flamos, Vlasis Oikonomou, and D. Zevgolis presented a multiple criteria analysis weighting approach to evaluate the energy and climate policy. The proposed approach is akin to the analytic hierarchy process, which consists of pairwise comparisons, consistency verification, and criteria prioritization. In the approach, stakeholders and experts in the energy policy field are incorporated in the evaluation process by providing an interactive mean with verbal, numerical, and visual representation of their preferences. A total of 14 evaluation criteria were considered and classified into four objectives, such as climate change mitigation, energy effectiveness, socioeconomic, and competitiveness and technology. Finally, Borge Hess applied the stochastic frontier analysis approach to analyze the impact of various business strategies, including acquisition, holding structures, and joint ventures, on a firm’s efficiency within a sample of 47 natural gas transmission pipelines in the USA from 1996 to 2005. The author finds that there were no significant changes in the firm’s efficiency by an acquisition, and there is a weak evidence for efficiency improvements caused by the new shareholder. Besides, the author discovers that parent companies appear not to influence a subsidiary’s efficiency positively. In addition, the analysis shows a negative impact of a joint venture on technical efficiency of the pipeline company. To conclude, we are grateful to all the authors for their contribution, and all the reviewers for their constructive comments, which made this special issue possible. We hope that this issue would contribute significantly to performance improvement of the energy sector.

Accommodating special needs users in the evaluation of an m-Learning application:a case study

Adult illiteracy rates are alarmingly high worldwide. The portability, affordability, and ease of use of mobile (or handheld) devices offer a realistic opportunity to provide novel, context-sensitive literacy resources to adults with limited literacy skills. To this end, we developed the concept of ALEX – a mobile Adult Literacy support application for EXperiential learning (Lumsden et al., 2005). On the basis of a medium-fidelity prototype of this application, we conducted an evaluation of ALEX using participants from our in tended user group. This evaluation had two goals: (a) to assess the usefulness of the ALEX concept and the usability of its current design; and (b) to reflect on the appropriateness of our evaluation process given the literacy-related needs of our participants. This paper outlines our approach to this evaluation as well as the results we obtained and our reflections on the process.

Assessing an experimental approach to industrial policy evaluation:Applying RCT+ to the case of Creative Credits

Experimental methods of policy evaluation are well-established in social policy and development eco-nomics but are rare in industrial and innovation policy. In this paper, we consider the arguments forapplying experimental methods to industrial policy measures, and propose an experimental policy eval-uation approach (which we call RCT+). This approach combines the randomised assignment of firmsto treatment and control groups with a longitudinal data collection strategy incorporating quantitativeand qualitative data (so-called mixed methods). The RCT+ approach is designed to provide a causativerather than purely summative evaluation, i.e. to assess both ‘whether’ and ‘how’ programme outcomesare achieved. In this paper, we assess the RCT+ approach through an evaluation of Creative Credits – aUK business-to-business innovation voucher initiative intended to promote new innovation partnershipsbetween SMEs and creative service providers. The results suggest the potential value of the RCT+ approachto industrial policy evaluation, and the benefits of mixed methods and longitudinal data collection.

Uncertainty evaluation of an axi-symmetric measurement machine

This paper describes a method of uncertainty evaluation for axi-symmetric measurement machines which is compliant with GUM and PUMA methodologies. Specialized measuring machines for the inspection of axisymmetric components enable the measurement of properties such as roundness (radial runout), axial runout and coning. These machines typically consist of a rotary table and a number of contact measurement probes located on slideways. Sources of uncertainty include the probe calibration process, probe repeatability, probe alignment, geometric errors in the rotary table, the dimensional stability of the structure holding the probes and form errors in the reference hemisphere which is used to calibrate the system. The generic method is described and an evaluation of an industrial machine is described as a worked example. Type A uncertainties were obtained from a repeatability study of the probe calibration process, a repeatability study of the actual measurement process, a system stability test and an elastic deformation test. Type B uncertainties were obtained from calibration certificates and estimates. Expanded uncertainties, at 95% confidence, were then calculated for the measurement of; radial runout (1.2 µm with a plunger probe or 1.7 µm with a lever probe); axial runout (1.2 µm with a plunger probe or 1.5 µm with a lever probe); and coning/swash (0.44 arc seconds with a plunger probe or 0.60 arc seconds with a lever probe).