Validating the is-impact model in the Malaysian public sector

This research is one of several ongoing studies conducted within the IT Professional Services (ITPS) research programme at Queensland University of Technology (QUT). In 2003, ITPS introduced the IS-Impact model, a measurement model for measuring information systems success from the viewpoint of multiple stakeholders. The model, along with its instrument, is robust, simple, yet generalisable, and yields results that are comparable across time, stakeholders, different systems and system contexts. The IS-Impact model is defined as “a measure at a point in time, of the stream of net benefits from the Information System (IS), to date and anticipated, as perceived by all key-user-groups”. The model represents four dimensions, which are ‘Individual Impact’, ‘Organizational Impact’, ‘Information Quality’ and ‘System Quality’. The two Impact dimensions measure the up-to-date impact of the evaluated system, while the remaining two Quality dimensions act as proxies for probable future impacts (Gable, Sedera & Chan, 2008). To fulfil the goal of ITPS, “to develop the most widely employed model” this research re-validates and extends the IS-Impact model in a new context. This method/context-extension research aims to test the generalisability of the model by addressing known limitations of the model. One of the limitations of the model relates to the extent of external validity of the model. In order to gain wide acceptance, a model should be consistent and work well in different contexts. The IS-Impact model, however, was only validated in the Australian context, and packaged software was chosen as the IS understudy. Thus, this study is concerned with whether the model can be applied in another different context. Aiming for a robust and standardised measurement model that can be used across different contexts, this research re-validates and extends the IS-Impact model and its instrument to public sector organisations in Malaysia. The overarching research question (managerial question) of this research is “How can public sector organisations in Malaysia measure the impact of information systems systematically and effectively?” With two main objectives, the managerial question is broken down into two specific research questions. The first research question addresses the applicability (relevance) of the dimensions and measures of the IS-Impact model in the Malaysian context. Moreover, this research question addresses the completeness of the model in the new context. Initially, this research assumes that the dimensions and measures of the IS-Impact model are sufficient for the new context. However, some IS researchers suggest that the selection of measures needs to be done purposely for different contextual settings (DeLone & McLean, 1992, Rai, Lang & Welker, 2002). Thus, the first research question is as follows, “Is the IS-Impact model complete for measuring the impact of IS in Malaysian public sector organisations?” [RQ1]. The IS-Impact model is a multidimensional model that consists of four dimensions or constructs. Each dimension is represented by formative measures or indicators. Formative measures are known as composite variables because these measures make up or form the construct, or, in this case, the dimension in the IS-Impact model. These formative measures define different aspects of the dimension, thus, a measurement model of this kind needs to be tested not just on the structural relationship between the constructs but also the validity of each measure. In a previous study, the IS-Impact model was validated using formative validation techniques, as proposed in the literature (i.e., Diamantopoulos and Winklhofer, 2001, Diamantopoulos and Siguaw, 2006, Petter, Straub and Rai, 2007). However, there is potential for improving the validation testing of the model by adding more criterion or dependent variables. This includes identifying a consequence of the IS-Impact construct for the purpose of validation. Moreover, a different approach is employed in this research, whereby the validity of the model is tested using the Partial Least Squares (PLS) method, a component-based structural equation modelling (SEM) technique. Thus, the second research question addresses the construct validation of the IS-Impact model; “Is the IS-Impact model valid as a multidimensional formative construct?” [RQ2]. This study employs two rounds of surveys, each having a different and specific aim. The first is qualitative and exploratory, aiming to investigate the applicability and sufficiency of the IS-Impact dimensions and measures in the new context. This survey was conducted in a state government in Malaysia. A total of 77 valid responses were received, yielding 278 impact statements. The results from the qualitative analysis demonstrate the applicability of most of the IS-Impact measures. The analysis also shows a significant new measure having emerged from the context. This new measure was added as one of the System Quality measures. The second survey is a quantitative survey that aims to operationalise the measures identified from the qualitative analysis and rigorously validate the model. This survey was conducted in four state governments (including the state government that was involved in the first survey). A total of 254 valid responses were used in the data analysis. Data was analysed using structural equation modelling techniques, following the guidelines for formative construct validation, to test the validity and reliability of the constructs in the model. This study is the first research that extends the complete IS-Impact model in a new context that is different in terms of nationality, language and the type of information system (IS). The main contribution of this research is to present a comprehensive, up-to-date IS-Impact model, which has been validated in the new context. The study has accomplished its purpose of testing the generalisability of the IS-Impact model and continuing the IS evaluation research by extending it in the Malaysian context. A further contribution is a validated Malaysian language IS-Impact measurement instrument. It is hoped that the validated Malaysian IS-Impact instrument will encourage related IS research in Malaysia, and that the demonstrated model validity and generalisability will encourage a cumulative tradition of research previously not possible. The study entailed several methodological improvements on prior work, including: (1) new criterion measures for the overall IS-Impact construct employed in ‘identification through measurement relations’; (2) a stronger, multi-item ‘Satisfaction’ construct, employed in ‘identification through structural relations’; (3) an alternative version of the main survey instrument in which items are randomized (rather than blocked) for comparison with the main survey data, in attention to possible common method variance (no significant differences between these two survey instruments were observed); (4) demonstrates a validation process of formative indexes of a multidimensional, second-order construct (existing examples mostly involved unidimensional constructs); (5) testing the presence of suppressor effects that influence the significance of some measures and dimensions in the model; and (6) demonstrates the effect of an imbalanced number of measures within a construct to the contribution power of each dimension in a multidimensional model.

On the relationships between self-reported bicycling injuries and perceived risk among cyclists in Queensland, Australia

The focus of governments on increasing active travel has motivated renewed interest in cycling safety. Bicyclists are up to 20 times more likely to be involved in serious injury crashes than drivers so understanding the relationship among factors in bicyclist crash risk is critically important for identifying effective policy tools, for informing bicycle infrastructure investments, and for identifying high risk bicycling contexts. This study aims to better understand the complex relationships between bicyclist self reported injuries resulting from crashes (e.g. hitting a car) and non-crashes (e.g. spraining an ankle) and perceived risk of cycling as a function of cyclist exposure, rider conspicuity, riding environment, rider risk aversion, and rider ability. Self reported data from 2,500 Queensland cyclists are used to estimate a series of seemingly unrelated regressions to examine the relationships among factors. The major findings suggest that perceived risk does not appear to influence injury rates, nor do injury rates influence perceived risks of cycling. Riders who perceive cycling as risky tend not to be commuters, do not engage in group riding, tend to always wear mandatory helmets and front lights, and lower their perception of risk by increasing days per week of riding and by increasing riding proportion on bicycle paths. Riders who always wear helmets have lower crash injury risk. Increasing the number of days per week riding tends to decrease both crash injury and non crash injury risk (e.g. a sprain). Further work is needed to replicate some of the findings in this study.

Information technology and business value in developing economies: a study of intangible benefits of information technology investments in Fiji

Understanding how IT investments contribute to business value is an important issue, and this assists in the efficient use of technology resources in businesses. While there is an agreement that IT contributes to business value, we are unsure of how IT contributes to business value in the wider context, including developing countries. With the view that understanding the interaction between IT resources and the users may provide better insights on the potential of IT investments, this study investigates the businesses’ perception of the intangible benefits of their IT investments. The results indicate that businesses in developing countries perceive that their IT investments provide intangible benefits, especially at the process level, and this contributes to business value.

Commentary on Spence et al. : "Problem solving programme implemented by teachers may prevent depression in the short term, but longer term benefits are unclear"

This is a methodologically exemplary trial of a population based (universal) approach to preventing depression in young people. The programme used teachers in a classroom setting to deliver cognitive behavioural problem solving skills to a cohort of students. We have little knowledge about “best practice” to prevent depression in adolescence. Classroom-based universal approaches appear to offer advantages in recruitment rates and lack of stigmatisation over approaches that target specific groups of at risk students. Earlier research on a universal school-based approach to preventing depression in adolescents showed promise, but employed mental health professionals to teach cognitive behavioural coping skills in small groups.1 Using such an approach routinely would be economically unsustainable. Spence’s trial, with teachers as facilitators, therefore represents a “real world” intervention that could be routinely disseminated.

The use of dashboards in performance management : evidence from sales managers

The purpose of this paper is to identify and empirically examine the key features, purposes, uses, and benefits of performance dashboards. We find that only about a quarter of the sales managers surveyed1 in Finland used a dashboard, which was lower than previously reported. Dashboards were used for four distinct purposes: (i) monitoring, (ii) problem solving, (iii) rationalizing, and (iv) communication and consistency. There was a high correlation between the different uses of dashboards and user productivity indicating that dashboards were perceived as effective tools in performance management, not just for monitoring one‟s own performance but for other purposes including communication. The quality of the data in dashboards did not seem to be a concern (except for completeness) but it was a critical driver regarding its use. This is the first empirical study on performance dashboards in terms of adoption rates, key features, and benefits. The study highlights the research potential and benefits of dashboards, which could be valuable for future researchers and practitioners.

An analysis of tax expenditure versus direct expenditure

Each financial year concessions, benefits and incentives are delivered to taxpayers via the tax system. These concessions, benefits and incentives, referred to as tax expenditure, differ from direct expenditure because of the recurring fiscal impact without regular scrutiny through the federal budget process. There are approximately 270 different tax expenditures existing within the current tax regime with total measured tax expenditures in the 2005-06 financial year estimated to be around $42.1 billion, increasing to $52.7 billion by 2009-10. Each year, new tax expenditures are introduced, while existing tax expenditures are modified and deleted. In recognition of some of the problems associated with tax expenditure, a Tax Expenditure Statement, as required by the Charter of Budget Honesty Act 1988, is produced annually by the Australian Federal Treasury. The Statement details the various expenditures and measures in the form of concessions, benefits and incentives provided to taxpayers by the Australian Government and calculates the tax expenditure in terms of revenue forgone. A similar approach to reporting tax expenditure, with such a report being a legal requirement, is followed by most OECD countries. The current Tax Expenditure Statement lists 270 tax expenditures and where it is able to, reports on the estimated pecuniary value of those expenditures. Apart from the annual Tax Expenditure Statement, there is very little other scrutiny of Australia’s Federal tax expenditure program. While there has been various academic analysis of tax expenditure in Australia, when compared to the North American literature, it is suggested that the Australian literature is still in its infancy. In fact, one academic author who has contributed to tax expenditure analysis recently noted that there is ‘remarkably little secondary literature which deals at any length with tax expenditures in the Australian context.’ Given this perceived gap in the secondary literature, this paper examines fundamental concept of tax expenditure and considers the role it plays in to the current tax regime as a whole, along with the effects of the introduction of new tax expenditures. In doing so, tax expenditure is contrasted with direct expenditure. An analysis of tax expenditure versus direct expenditure is already a sophisticated and comprehensive body of work stemming from the US over the last three decades. As such, the title of this paper is rather misleading. However, given the lack of analysis in Australia, it is appropriate that this paper undertakes a consideration of tax expenditure versus direct expenditure in an Australian context. Given this proposition, rather than purport to undertake a comprehensive analysis of tax expenditure which has already been done, this paper discusses the substantive considerations of any such analysis to enable further investigation into the tax expenditure regime both as a whole and into individual tax expenditure initiatives. While none of the propositions in this paper are new in a ‘tax expenditure analysis’ sense, this debate is a relatively new contribution to the Australian literature on the tax policy. Before the issues relating to tax expenditure can be determined, it is necessary to consider what is meant by ‘tax expenditure’. As such, part two if this paper defines ‘tax expenditure’. Part three determines the framework in which tax expenditure can be analysed. It is suggested that an analysis of tax expenditure must be evaluated within the framework of the design criteria of an income tax system with the key features of equity, efficiency, and simplicity. Tax expenditure analysis can then be applied to deviations from the ideal tax base. Once it is established what is meant by tax expenditure and the framework for evaluation is determined, it is possible to establish the substantive issues to be evaluated. This paper suggests that there are four broad areas worthy of investigation; economic efficiency, administrative efficiency, whether tax expenditure initiatives achieve their policy intent, and the impact on stakeholders. Given these areas of investigation, part four of this paper considers the issues relating to the economic efficiency of the tax expenditure regime, in particular, the effect on resource allocation, incentives for taxpayer behaviour and distortions created by tax expenditures. Part five examines the notion of administrative efficiency in light of the fact that most tax expenditures could simply be delivered as direct expenditures. Part six explores the notion of policy intent and considers the two questions that need to be asked; whether any tax expenditure initiative reaches its target group and whether the financial incentives are appropriate. Part seven examines the impact on stakeholders. Finally, part eight considers the future of tax expenditure analysis in Australia.

The role of physical activity in the lives of people with lymphoedema following cancer treatment : a social constructionist study

Lymphoedema is a chronic condition predominantly affecting the limbs, although it can involve the trunk and other areas of the body. It is characterised by swelling due to excess accumulation of fluid in body tissues. Secondary lymphoedema, which arises following cancer treatment, is the more common form of lymphoedema in developed countries. At least 20% of those diagnosed with the most common cancers will develop lymphoedema. This is a concern in Australia as incidence of these cancers is increasing. Cancer survival rates are also increasing. Currently, this equates to 9 300 new cases of secondary lymphoedema diagnosed each year. Considerable physical and psychosocial impacts of lymphoedema have been reported and its subsequent impact on health-related quality of life can exacerbate other side effects of cancer treatment. Exercise following cancer treatment has been shown to significantly reduce the impact of treatment side effects, improve quality of life and physical status. While participating in exercise does not increase risk nor exacerbate existing lymphoedema, reductions in incidence of lymphoedema exacerbations and associated symptoms have been observed in women participating in regular weight lifting following breast cancer treatment. Despite these benefits, lymphoedema prevention and management advice cautions people with lymphoedema against „repetitive use. or „overuse. of their affected arm. It is possible that this advice creates a barrier to participation in physical activity; however, little is known about the relationship between physical activity and lymphoedema. In addition, the majority of studies examining the experiences of people living with lymphoedema and the impact of the condition have been predominantly conducted internationally and have focused on women following breast cancer. This study sought to explore firstly, how men and women construct their experience of living with lymphoedema following treatment for a range of cancers in the context of everyday life in Australia; and secondly, to analyse the role of physical activity in the lives of those living with lymphoedema following cancer treatment. A social constructivist grounded theory approach was taken to explore these objectives as it is acknowledged that human actions and the meanings associated with these actions are influenced by the interaction between the self and the social world. It is also acknowledged that the research process itself is a social construction between the researcher and participant. Purposive sampling techniques were used to recruit a total of 29 participants from a variety of sources. Telephone interviews and focus groups were conducted to collect data. Data were concurrently collected and analysed and analysis was conducted using the constant comparative method. The core category that developed in objective one was „sense of self‟. The self was defined by perceptions participants held of themselves and their identity prior to a lymphoedema diagnosis and changes to their perceptions and identity since diagnosis. Three conceptual categories which related to each other and to „sense of self‟ were developed through the process of coding that represented the process of how participants constructed their experiences living with secondary lymphoedema in the context of everyday life. Firstly, altered normalcy reflected the physical and psychosocial changes experienced and the effect it had on their lives. Secondly, „accidental journey‟ reflected participants‟ journey with the heath care system prior to diagnosis through to longer term management. Thirdly, renegotiating control revealed participants perceived control over lymphoedema and their ability to participate in daily activities previously enjoyed. These findings revealed the failure of the broader health system to recognise the significant and chronic nature of a lymphoedema diagnosis following cancer treatment with greater understanding, knowledge and support from health professionals being needed. The findings also reveal access to health professionals trained in lymphoedema management, a comprehensive approach encompassing both physical and psychosocial needs and provision of practical and meaningful guidelines supported by scientific evidence would contribute to improved treatment and management of the condition. The key findings for objective two were that people with lymphoedema define physical activity in different ways. Physical activity post-diagnosis was perceived as important by most for a variety of reasons ranging from everyday functioning, to physical and psychosocial health benefits. Issues relating to the impact of lymphoedema on physical activity related to the impact on peoples‟ ability to be physically active, confusion about acceptable forms of physical activity and barriers that lymphoedema presented to being physically active. A relationship between how people construct their experiences with lymphoedema and the role of physical activity was also established. The contribution of physical activity to the lives of people living with lymphoedema following cancer treatment appeared to be influenced by their sense of self as socially constructed through their experiences prior to diagnosis and following diagnosis with lymphoedema. The influence of pre-lymphoedema habits, norms and beliefs suggests the importance of effective health promotion messages to encourage physical activity among the general population and specific messages and guidelines particular to the needs of those diagnosed with lymphoedema following cancer treatment. The influence of participant.s social constructions on the lymphoedema experience highlights the importance of improving interactions between the overall health care system and patients, providing a clear treatment plan, providing evidence-based and clear advice about participation in appropriate physical activity, which in doing so will limit the physical and psychosocial effect of lymphoedema and providing comprehensive physical and psychosocial support to those living with the condition and their families. This study has contributed to a deep understanding of people.s experiences with lymphoedema following cancer treatment and the role of physical activity in the context of daily life in Australia. Findings from this study lead to recommendations for advocacy, a comprehensive approach to diagnosis, treatment and management, and specific areas for future research.

Benefits and issues of urban network travel time prediction

This paper presents the benefits and issues related to travel time prediction on urban network. Travel time information quantifies congestion and is perhaps the most important network performance measure. Travel time prediction has been an active area of research for the last five decades. The activities related to ITS have increased the attention of researchers for better and accurate real-time prediction of travel time. Majority of the literature on travel time prediction is applicable to freeways where, under non-incident conditions, traffic flow is not affected by external factors such as traffic control signals and opposing traffic flows. On urban environment the problem is more complicated due to conflicting areas (intersections), mid-link sources and sinks etc. and needs to be addressed.

ACE research vignette 001 : benefits and drawbacks of start-up team heterogeneity

This series of research vignettes is aimed at sharing current and interesting research findings from our team of international Entrepreneurship researchers. In this vignette, Dr. Micheal Stuetzer considers some of the benefits and drawbacks associated with team start-up.

Bicycling injuries and perceived risk

Introduction Government promotion of active transport has renewed interest in cycling safety. Research has shown that bicyclists are up to 20 times more likely to be involved in serious injury crashes than drivers. On-road cycling injuries are under-reported in police data, and many non-serious injuries are not recorded in any official database. This study aims to explore the relationships between rider characteristics and environmental factors that influence per kilometre risk of bicycle-related crash and non-crash injuries. Method A survey of 2,532 Queensland adults who had ridden at least once in the past year was conducted from October 2009 to March 2010, with most responses received online (99.3%). Riders were asked where they rode (footpath, bike path, road etc.), average travel speed, purpose of riding, type of bike ridden, how far and how often they rode in. Measures of rider experience, skill, safety perceptions, safety behaviours, crash involvement and demographic characteristics were also collected. RESULTS Increasing exposure and having more expensive bicycles were shown to reduce the risk per km of crash and non-crash injury rates, and to reduce perceived risk. Never wearing bright coloured clothing related to increased crash risk, use of fluorescent and reflective clothing had no effect on crash risk. Riding in low-speed environments, never using a front light, and riding in low-speed environments were associated with reduced non-crash injury risk. Perceived risk was influenced by exposure, use of conspicuity aids and helmets, riding for utilitarian reasons, and group-riding behaviours. DISCUSSION Perceived risk does not appear to influence injury rates and injury rates do not appear to influence the perceived risk of cycling. Riders who perceive cycling to be risky tend not to be commuters, do not engage in group riding and always wear helmets. Not all measures of conspicuity were associated with risk, with rear lights found to have no relationship to injury. The risks of experiencing a crash or non-crash injury were similar, therefore injury prevention strategies should expand their scope to include other factors such as the importance of bicycle set-up.

Measuring the realization of benefits from enterprise architecture management

Enterprise architecture management (EAM) has become an intensively discussed approach to manage enterprise transformations. While many organizations employ EAM, a notable insecurity about the value of EAM remains. In this paper, we propose a model to measure the realization of benefits from EAM. We identify EAM success factors and EAM benefits through a comprehensive literature review and eleven explorative expert interviews. Based on our findings, we integrate the EAM success factors and benefits with the established DeLone & McLean IS success model resulting in a model that explains the realization of EAM benefits. This model aids organizations as a benchmark and framework for identifying and assessing the setup of their EAM initiatives and whether and how EAM benefits are materialized. We see our model also as a first step to gain insights in and start a discussion on the theory of EAM benefit realization.

Benefits of publicly available data

The National Morbidity, Mortality, and Air Pollution Study (NMMAPS) was designed to examine the health effects of air pollution in the United States. The primary question was whether particulate matter was responsible for the associations between air pollution and daily mortality. Secondary questions concerned measurement error in air pollution and mortality displacement.1 Since then, NMMAPS has been used to answer many important questions in environmental epidemiology...

Modeling perceived collision risk in port water navigation

An increase in the likelihood of navigational collisions in port waters has put focus on the collision avoidance process in port traffic safety. The most widely used on-board collision avoidance system is the automatic radar plotting aid which is a passive warning system that triggers an alert based on the pilot’s pre-defined indicators of distance and time proximities at the closest point of approaches in encounters with nearby vessels. To better help pilot in decision making in close quarter situations, collision risk should be considered as a continuous monotonic function of the proximities and risk perception should be considered probabilistically. This paper derives an ordered probit regression model to study perceived collision risks. To illustrate the procedure, the risks perceived by Singapore port pilots were obtained to calibrate the regression model. The results demonstrate that a framework based on the probabilistic risk assessment model can be used to give a better understanding of collision risk and to define a more appropriate level of evasive actions.

Hierarchical modeling of perceived collision risks in port fairways

Navigational collisions are one of the major safety concerns in many seaports. Despite the extent of recent works done on port navigational safety research, little is known about harbor pilot’s perception of collision risks in port fairways. This paper uses a hierarchical ordered probit model to investigate associations between perceived risks and the geometric and traffic characteristics of fairways and the pilot attributes. Perceived risk data, collected through a risk perception survey conducted among the Singapore port pilots, are used to calibrate the model. Intra-class correlation coefficient justifies use of the hierarchical model in comparison with an ordinary model. Results show higher perceived risks in fairways attached to anchorages, and in those featuring sharper bends and higher traffic operating speeds. Lesser risks are perceived in fairways attached to shoreline and confined waters, and in those with one-way traffic, traffic separation scheme, cardinal marks and isolated danger marks. Risk is also found to be perceived higher in night.

Realizing benefits from enterprise architecture : a measurement model

Enterprise architecture (EA) management has become an intensively discussed approach to manage enterprise transformations. Despite the popularity and potential of EA, both researchers and practitioners lament a lack of knowledge about the realization of benefits from EA. To determine the benefits from EA, we explore the various dimensions of EA benefit realization and report on the development of a validated and robust measurement instrument. In this paper, we test the reliability and construct validity of the EA benefit realization model (EABRM), which we have designed based on the DeLone & McLean IS success model and findings from exploratory interviews. A confirmatory factor analysis confirms the existence of an impact of five distinct and individually important dimensions on the benefits derived from EA: EA artefact quality, EA infrastructure quality, EA service quality, EA culture, and EA use. The analysis presented in this paper shows that the EA benefit realization model is an instrument that demonstrates strong reliability and validity.