Survey design: Insights from a public sector ERP success story

Research on the impact of Information Systems (IS) reported in both academic literature and popular press has reported confounding results. Some studies have reported encouraging results of IS, while others have reported nil or detrimental results. The contradictory results of these research studies can be partially attributed to the weaknesses in survey instruments. In an attempt to increase the validity of conclusions of IS assessment studies, survey instrument design should follow a rigorous and scientific procedure. This paper illustrates key validity and reliability issues in measuring Information Systems performance, using examples from a study designed to assess Enterprise Resource Planning systems success. The article emphasizes on the importance of the survey method and the theoretical considerations of item derivation, scale development and item evaluation. Examples are provided from the ERP assessment study to supplement the readers understanding of the theoretical concepts of survey design.

Key performance indicators for measuring construction success

The construction industry is dynamic in nature. The concept of project success has remained ambiguously defined in the construction industry. Project success is almost the ultimate goal for every project. However, it means different things to different people. While some writers consider time, cost and quality as predominant criteria, others suggest that success is something more complex. The aim of this paper is to develop a framework for measuring success of construction projects. In this paper, a set of key performance indicators (KPIs), measured both objectively and subjectively are developed through a comprehensive literature review. The validity of the proposed KPIs is also tested by three case studies. Then, the limitations of the suggested KPIs are discussed. With the development of KPIs, a benchmark for measuring the performance of a construction project can be set. It also provides significant insights into developing a general and comprehensive base for further research.

Measuring Consumer Loyalty : the loyalty orientation scale

Reflecting its importance to thc financial success of organisations, interest in consumer loyalty continues unabated. However, there are still many unanswered questions about its conceptualisation and measurement.These questions must he resolved before academics and practitioners can usefully apply the concept. We argue that consumer loyalty is best conceptualised as a multi-dimensional phenomenon. Based on this multi-dimensional view, we develop and test a new measure of consumer loyalty. We hypothesise a threedimensional structure containing affective, temporal and instrumental dimensions, Results from a preliminary test are reported. The results indicate that the construct can be reprcxeuted with two dimensions: affective and temporal loyally. As an additional check on the reliability of our results, we find significant correlations between these two dimensions and a measure of behavioural loyalty.

Measuring the use of information and communication technologies (ICTs) in the classroom

In 2003, the “ICT Curriculum Integration Performance Measurement Instrument” was developed froman extensive review ofthe contemporary international and Australian research pertaining to the definition and measurement of ICT curriculum integration in classrooms (Proctor, Watson, & Finger, 2003). The 45-item instrument that resulted was based on theories and methodologies identified by the literature review. This paper describes psychometric results from a large-scale evaluation of the instrument subsequently conducted, as recommended by Proctor, Watson, and Finger (2003). The resultant 20-item, two-factor instrument, now called “Learning with ICTs: Measuring ICT Use in the Curriculum,” is both statistically and theoretically robust. This paper should be read in association with the original paper published in Computers in the Schools(Proctor, Watson, & Finger, 2003) that described in detail the theoretical framework underpinning the development of the instrument.

Framework for measuring success of construction projects

The construction industry is dynamic in nature. The concept of project success has remained ambiguously defined in the construction industry. Project success means different things to different people. While some authors consider time, cost and quality as the predominant targets, others suggest that success is something more complex. The aim of this report is to develop a framework for measuring success of construction projects. A range of Key Performance Indicators (KPIs), measured both objectively and subjectively is developed. The identification of KPIs helps set a benchmark for measuring the performance of a construction project and provides significant insights into developing a general and comprehensive base for further research.

Safety culture research, lead indicators, and the development of safety effectiveness indicators in the construction sector

Construction sector application of Lead Indicators generally and Positive Performance Indicators (PPIs) particularly, are largely seen by the sector as not providing generalizable indicators of safety effectiveness. Similarly, safety culture is often cited as an essential factor in improving safety performance, yet there is no known reliable way of measuring safety culture. This paper proposes that the accurate measurement of safety effectiveness and safety culture is a requirement for assessing safe behaviours, safety knowledge, effective communication and safety performance. Currently there are no standard national or international safety effectiveness indicators (SEIs) that are accepted by the construction industry. The challenge is that quantitative survey instruments developed for measuring safety culture and/ or safety climate are inherently flawed methodologically and do not produce reliable and representative data concerning attitudes to safety. Measures that combine quantitative and qualitative components are needed to provide a clear utility for safety effectiveness indicators.

Measuring internal market orientation

Internal marketing has been discussed in the management and academic literature for over three decades, yet it remains ill defined and poorly operationalized. This paper responds to calls for research to develop a single clear understanding of the construct, for the development of a suitable instrument to measure it, and for empirical evidence of its impact. Existing, divergent conceptualization of internal marketing are explored, and a new, multidimensional construct, describing the managerial behaviors associated with internal marketing is developed, and termed internal market orientation (IMO). IMO represents the adaptation of market orientation to the context of employer-employee exchanges in the internal market. The paper describes the development of a valid and reliable measure of IMO in a retail services context. Five dimensions of IMO are identified and confirmed. These are 1) formal written information generation, 2) formal face-to-face information generation, 3) informal information generation, 4) communication and dissemination of information, and 5) responding to this internal market information. The impact of IMO on important organizational factors is also explored. Results indicate positive consequences for customer satisfaction, relative competitive position, staff attitudes, staff retention and staff compliance.