Survey design: Insights from a public sector ERP success story

Research on the impact of Information Systems (IS) reported in both academic literature and popular press has reported confounding results. Some studies have reported encouraging results of IS, while others have reported nil or detrimental results. The contradictory results of these research studies can be partially attributed to the weaknesses in survey instruments. In an attempt to increase the validity of conclusions of IS assessment studies, survey instrument design should follow a rigorous and scientific procedure. This paper illustrates key validity and reliability issues in measuring Information Systems performance, using examples from a study designed to assess Enterprise Resource Planning systems success. The article emphasizes on the importance of the survey method and the theoretical considerations of item derivation, scale development and item evaluation. Examples are provided from the ERP assessment study to supplement the readers understanding of the theoretical concepts of survey design.

ERP success: Does organisation size matter?

Organisations invest enormous sums of money in acquiring Enterprise Resource Planning (ERP) systems, presumably expecting positive impacts to the organisation and its functions. Despite the optimistic motives some ERP projects have reported nil or detrimental impacts. This paper studies the proposition that the size of an organisation (e.g. small, large) may have contributed to the differences in receiving benefits reported in prior studies in this domain. The alleged differences in organisational performance are empirically measured using a prior validated model, using five constructs and fortytwo sub-constructs. Information is gathered from three hundred and ten respondents representing twenty-seven public sector organisations. Results suggests that (1) larger organisations have received more benefits compared to small organisations, (2) small organisations demonstrated higher reliance on their ERP systems, (3) employment cohorts demonstrate significant differences in perceived benefits in small and large organisations.