Semantic representation for comparison of performance measurement indicators

Indicators are widely used by organizations as a way of evaluating, measuring and classifying organizational performance. As part of performance evaluation systems, indicators are often shared or compared across internal sectors or with other organizations. However, indicators can be vague and imprecise, and also can lack semantics, making comparisons with other indicators difficult. Thus, this paper presents a knowledge model based on an ontology that may be used to represent indicators semantically and generically, dealing with the imprecision and vagueness, and thus facilitating better comparison. Semantic technologies are shown to be suitable for this solution, so that it could be able to represent complex data involved in indicators comparison.

Ontology for performance measurement indicators’ comparison

Indicators are widely used by organizations as a way of evaluating, measuring and classifying organizational performance. As part of performance evaluation systems, indicators are often shared or compared across internal sectors or with other organizations. However, indicators can be vague and imprecise, and also can lack semantics, making comparisons with other indicators difficult. Thus, this paper presents a knowledge model based on an ontology that may be used to represent indicators semantically and generically, dealing with the imprecision and vagueness, and thus facilitating better comparison. Semantic technologies are shown to be suitable for this solution, so that it could be able to represent complex data involved in indicators comparison.

Performance measurement with multiple interrelated variables and threshold target levels:evidence from retail firms in the US

In this study, we developed a DEA-based performance measurement methodology that is consistent with performance assessment frameworks such as the Balanced Scorecard. The methodology developed in this paper takes into account the direct or inverse relationships that may exist among the dimensions of performance to construct appropriate production frontiers. The production frontiers we obtained are deemed appropriate as they consist solely of firms with desirable levels for all dimensions of performance. These levels should be at least equal to the critical values set by decision makers. The properties and advantages of our methodology against competing methodologies are presented through an application to a real-world case study from retail firms operating in the US. A comparative analysis between the new methodology and existing methodologies explains the failure of the existing approaches to define appropriate production frontiers when directly or inversely related dimensions of performance are present and to express the interrelationships between the dimensions of performance.

What counts versus what can be counted:the complex interplay of market orientation and marketing performance measurement

Market orientation (MO) and marketing performance measurement (MPM) are two of the most widespread strategic marketing concepts among practitioners. However, some have questioned the benefits of extensive investments in MO and MPM. More importantly, little is known about which combinations of MO and MPM are optimal in ensuring high business performance. To address this research gap, the authors analyze a unique data set of 628 firms with a novel method of configurational analysis: fuzzy-set qualitative comparative analysis. In line with prior research, the authors find that MO is an important determinant of business performance. However, to reap its benefits, managers need to complement it with appropriate MPM, the level and focus of which vary across firms. For example, whereas large firms and market leaders generally benefit from comprehensive MPM, small firms may benefit from measuring marketing performance only selectively or by focusing on particular dimensions of marketing performance. The study also finds that many of the highest-performing firms do not follow any of the particular best practices identified.

Institutional complexity in Thai state-owned enterprises:the implementation of performance measurement systems

This study explores institutional complexity in Thai State-Owned Enterprises (SOEs). In doing so, a qualitative approach has been employed in this study in order to identify institutional logics in the field of Thai SOEs and to understand organisational and individual perceptions of institutional complexity in the implementation of performance measurement systems (PMS) and how they respond to the complexity. To achieve this goal, two Thai SOEs were studied, both of which faced challenges in the implementation of Economic Value Management (EVM) and Balance Scorecard (BSC) as well as difficulties in linking their individual BSC and incentive systems. The qualitative data were collected from semi-structured interviews and document reviews. The empirical aspects of this study reveal that the institutional logics in the field of Thai SOEs are the logic of bureaucracy, commercial operations, social activities, seniority and unity. Regarding the multiple institutional logics embedded, SOEs experienced the institutional complexity in the implementation of PMS. The results suggest that the organisations have decoupled the EVM and loosely coupled the BSC from organisational practices to cope with institutional complexity and conflict institutional demands. Also, the evidence shows that the institutional logics influence SOEs’ actions towards resisting changes incentive systems and the relationship between individual BSC and incentives.

Teljesítménymérés és döntéstámogatás az üzleti szférában = Performance measurement and decision support in business practice

Tanulmányunkban a hazai vállalatok teljesítménymérési és teljesítménymenedzsment gyakorlatát vizsgáljuk a Versenyben a világgal kutatási program adatainak felhasználásával. Célunk a döntéstámogatás hátterének vizsgálata: a vállalatok teljesítménymérési gyakorlatának jellemzése, konzisztenciájának értékelése, vizsgálva a korábbi kutatásaink során megfigyelt tendenciák további alakulását is. A vállalatvezetők által fontosnak/hasznosnak tartott, illetve rendszeresen használt információforrásokat, teljesítménymutatókat, elemzési eszközöket a korábbi kutatásainkhoz kialakított elemzési keret (orientáció, egyensúly, konzisztencia, támogató szerep) felhasználásával értékeltük. Az információs rendszer különböző tevékenységeket támogató szerepének az értékelése során a különböző területekért felelős vezetők véleményét is összevetettük, s különböző vállalatcsoportok sajátosságait is vizsgáltuk. --------- The paper analyses the performance measurement and performance management practice of Hungarian companies, based on data of the Competitiveness research program. Our goal was to evaluate the practice from the point of view of decision support, based on our previous framework, evaluating the orientation, the balance, the consistency and the supporting role of the performance measurement practice.

Mit mérünk és hogyan? – A vállalati teljesítménymérés szemléletmódja és eszköztára a döntéstámogatás tükrében = Performance measurement serving decision making – approach and practice of Hungarian firms

Tanulmányunkban a hazai vállalatok teljesítménymérési és teljesítménymenedzsment gyakorlatát vizsgáljuk a Versenyben a világgal kutatási program 2009. évi felmérése adatainak felhasználásával. Célunk a döntéstámogatás hátterének vizsgálata: a vállalatok teljesítménymérési gyakorlatának jellemzése, konzisztenciájának értékelése, vizsgálva a korábbi (1996, 1999 és 2004 évi hasonló) kutatásaink során megfigyelt tendenciák további alakulását is. A vállalati teljesítménymérés gyakorlatát, a vállalatvezetők által fontosnak/hasznosnak tartott, illetve rendszeresen használt információforrásokat, teljesítménymutatókat, elemzési eszközöket a korábbi kutatásainkhoz kialakított elemzési keret (orientáció, egyensúly, konzisztencia, támogató szerep) felhasználásával értékeltük. Az információs rendszer különböző tevékenységeket támogató szerepének az értékelése során a különböző területekért felelős vezetők véleményét is összevetettük, s különböző vállalati jellemzők (vállalatméret, tulajdonosok típusa, fő tevékenység stb.) sajátosságait is vizsgáltuk. ___________ The paper analyses the performance measurement and performance management practice of Hungarian companies, based on the data of the Competitiveness research program (2009). Our goal was to evaluate the practice from the point of view of decision support, based on our previous framework, evaluating the orientation, the balance, the consistency and the supporting role of the performance measurement practice.

Az egyéni teljesítményértékelési rendszer működésének tapasztalatai a magyar közigazgatásban (Operating experiences of the individual performance appraisal system in the Hungarian public sector)

A tanulmány – egy 2005 végén lefolytatott, országosan reprezentatív kérdőíves felmérés empirikus bázisán – a magyar közigazgatási dolgozók körében 2002-től bevezetett egyéni teljesítményértékelési rendszert vizsgálja. A rendszer egészét tekintve a vizsgálat végkövetkeztetései nem túl rózsásak: az eredmények arra utalnak, hogy a rendszer mint egész nem képes kitűzött fő célját, a munkateljesítmények javítását elérni. Az egyes részrendszerek, szervezettípusok szintjén differenciáltabb eredményeket kapunk, míg a minisztériumokban a rendszer egésze a szándékolttól alapvetően különböző célokat látszik szolgálni, addig a többi szervezettípusnál inkább „csak” a rendszer tökéletlen működéséről beszélhetünk. ____ On the basis of a questionnaire survey of a nationally representative sample of Hungarian civil servants, the study attempts to give a preliminary evaluation of the individual performance assessment system introduced in 2002 throughout the Hungarian civil service. The general conclusion of the analysis is that the performance assessment system is unlikely to reach its goals: its central element, the performance related pay incentives are overly dispersed and, on the average, insignificant in size, meanwhile the objectivity of performance assessments is also questionable. Moreover, comparative analysis of responses from different administrative branches reveals an interesting idiosyncrasy characteristic for central government ministries. Here, the main function of the incentive system seems to be ensuring the labor market competitiveness of the ministries as employers by enabling them to pay higher-than-usual salaries for employees having certain types of expertise.

Local officials' preferences of performance measurements: A study of local police services

The purpose of this study is to identify the determinants of local officials' preferences of performance measures under the assumption that public officials' consensus on performance measures can enhance the accountability in public service delivery. This research consists of two steps: multiple case studies and a survey. The author conducted the case studies in five general-purpose municipalities in Florida, interviewing 25 local officials, attending community meetings, and reviewing relevant local documents. Based on the case studies and the relevant literature, a survey was developed and sent to 445 local officials in 67 general-purpose municipalities in Dade, Broward, and Palm Beach Counties, Florida. The findings of the case studies and the survey suggest that local officials' preferences of performance measures are influenced by their perception of utilities of performance measures and their desire to measure the achievement of organizational goals. The author concludes that a consensus among local officials for outcome-oriented performance measures is easier to achieve if a prospective performance measurement system is designed for reporting and management purposes rather than for budgeting purposes. ^

A comparison of the teacher efficacy and performance of traditionally and alternatively certified first -year teachers

The purpose of this study was to compare the efficacy and performance evaluations of alternatively certified first-year teachers to traditionally certified first-year teachers. The participants were 25 first-year teachers in the Broward County Public School District (FL) who completed the Transition to Teaching alternative certification program and a comparison group of 32 first-year teachers in the same school district who completed a traditional university teacher preparation program. ^ The study was a mixed methods design (Creswell, 2003; Tashakkori & Teddlie, 1998). The quantitative data were collected during the 2002–2003 school year using the Teachers' Sense of Efficacy Scale (Tschannen-Moran & Hoy, 2001) and the Florida Performance Measurement System formative and summative instruments. The qualitative data consisted of focus group interviews that were conducted at the end of the 2002–2003 school year. ^ Data were analyzed using independent samples t tests to compare the means of the two populations on their efficacy scores and performance evaluations. Paired samples t tests and analysis of covariance (ANCOVA) were used to compare the efficacy scores for each certification type at the beginning of the school year to the efficacy scores at the end of the school year. A repeated measures analysis of variance (ANOVA) was used to compare the change in the efficacy scores of the teachers from the beginning of the school year to the end of the school year. Focus group interviews were conducted and transcribed, and the content was analyzed and categorized based on the four sources of self-efficacy described by Bandura (1986, 1997). ^ The results of this study revealed that no statistically significant differences existed between the two groups of teachers in their teacher efficacy or performance evaluations and that they reported similar sources of their efficacy. These findings add to the research base that supports alternative certification as a viable and effective pathway into teaching. ^

Mesure de la performance dans les organisations de réadaptation en déficience physique

La présente thèse vise à évaluer le degré d’implantation et d’utilisation de systèmes de mesure de la performance (SMP) par les décideurs des organisations de réadaptation et à comprendre les facteurs contextuels ayant influencé leur implantation. Pour ce faire, une étude de cas multiples a été réalisée comprenant deux sources de données: des entrevues individuelles avec des cadres supérieurs des organisations de réadaptation du Québec et des documents organisationnels. Le cadre conceptuel Consolidated Framework for Implementation Research a été utilisé pour guider la collecte et l’analyse des données. Une analyse intra-cas ainsi qu’une analyse inter-cas ont été réalisées. Nos résultats montrent que le niveau de préparation organisationnelle à l’implantation d’un SMP était élevé et que les SMP ont été implantés avec succès et utilisés de plusieurs façons. Les organisations les ont utilisés de façon passive (comme outil d’information), de façon ciblée (pour tenter d’améliorer des domaines sous-performants) et de façon politique (comme outil de négociation auprès des autorités gouvernementales). Cette utilisation diversifiée des SMP est suscitée par l’interaction complexe de facteurs provenant du contexte interne propre à chaque organisation, des caractéristiques du SMP, du processus d’implantation appliqué et du contexte externe dans lequel évoluent ces organisations. Au niveau du contexte interne, l’engagement continu et le leadership de la haute direction ont été décisifs dans l’implantation du SMP de par leur influence sur l’identification du besoin d’un SMP, l’engagement des utilisateurs visés dans le projet, la priorité organisationnelle accordée au SMP ainsi que les ressources octroyées à son implantation, la qualité des communications et le climat d’apprentissage organisationnel. Toutefois, même si certains de ces facteurs, comme les ressources octroyées à l’implantation, la priorité organisationnelle du SMP et le climat d’apprentissage se sont révélés être des barrières à l’implantation, ultimement, ces barrières n’étaient pas suffisamment importantes pour entraver l’utilisation du SMP. Cette étude a également confirmé l’importance des caractéristiques du SMP, particulièrement la perception de qualité et d’utilité de l’information. Cependant, à elles seules, ces caractéristiques sont insuffisantes pour assurer le succès d’implantation. Cette analyse d’implantation a également révélé que, même si le processus d’implantation ne suit pas des étapes formelles, un plan de développement du SMP, la participation et l’engagement des décideurs ainsi que la désignation d’un responsable de projet ont tous facilité son implantation. Cependant, l’absence d’évaluation et de réflexion collective sur le processus d’implantation a limité le potentiel d’apprentissage organisationnel, un prérequis à l’amélioration de la performance. Quant au contexte externe, le soutien d’un organisme externe s’est avéré un facilitateur indispensable pour favoriser l’implantation de SMP par les organisations de réadaptation malgré l’absence de politiques et incitatifs gouvernementaux à cet effet. Cette étude contribue à accroître les connaissances sur les facteurs contextuels ainsi que sur leurs interactions dans l’utilisation d’innovations tels les SMP et confirme l’importance d’aborder l’analyse de l’implantation avec une perspective systémique.

Cloud Base Height Measurement System Based on Stereo Vision with Automatic Calibration

Clouds are important in weather prediction, climate studies and aviation safety. Important parameters include cloud height, type and cover percentage. In this paper, the recent improvements in the development of a low-cost cloud height measurement setup are described. It is based on stereo vision with consumer digital cameras. The cameras positioning is calibrated using the position of stars in the night sky. An experimental uncertainty analysis of the calibration parameters is performed. Cloud height measurement results are presented and compared with LIDAR measurements.

Conceptual design of the integral measurement system of the radiation dose of the fuel elements for the ALFRED reactor.

Conceptual design of the integral measurement system of the radiation dose of the fuel elements for the ALFRED reactor.

How to monitor and improve Unilever JM Supply Chain processes to become the best of Portugal’s sector in 2015?

Unilever Jerónimo Martins is a Portuguese joint-venture leading firm in what concerns the supply chain industry of fast-moving consumer goods in Portugal. The scope of analysis of this Work Project is focusing on Unilever-JM operations and services in the Portuguese market regarding quality, efficiency and effectiveness over B2B customers. It will be analysed the possibility of development and implementation of a performance measurement system, Tableau de Bord, which will be crucial for the identification of potential opportunities of improvement with impact in the supply chain processes. This will be completed through the establishment of KPI’s to monitor and manage periodically logistics, planning and customer service processes’ performance, which are the ones where the bottlenecks are impacting more in the supply chain. In this work project the nexus causality for the problems will also be discussed and some recommendations will be prepared to tackle the inefficiencies found through the monitoring of the previous core processes, in order to improve efficacy and quality service of the supply chain.