Survey design: Insights from a public sector ERP success story

Research on the impact of Information Systems (IS) reported in both academic literature and popular press has reported confounding results. Some studies have reported encouraging results of IS, while others have reported nil or detrimental results. The contradictory results of these research studies can be partially attributed to the weaknesses in survey instruments. In an attempt to increase the validity of conclusions of IS assessment studies, survey instrument design should follow a rigorous and scientific procedure. This paper illustrates key validity and reliability issues in measuring Information Systems performance, using examples from a study designed to assess Enterprise Resource Planning systems success. The article emphasizes on the importance of the survey method and the theoretical considerations of item derivation, scale development and item evaluation. Examples are provided from the ERP assessment study to supplement the readers understanding of the theoretical concepts of survey design.

ERP success: Does organisation size matter?

Organisations invest enormous sums of money in acquiring Enterprise Resource Planning (ERP) systems, presumably expecting positive impacts to the organisation and its functions. Despite the optimistic motives some ERP projects have reported nil or detrimental impacts. This paper studies the proposition that the size of an organisation (e.g. small, large) may have contributed to the differences in receiving benefits reported in prior studies in this domain. The alleged differences in organisational performance are empirically measured using a prior validated model, using five constructs and fortytwo sub-constructs. Information is gathered from three hundred and ten respondents representing twenty-seven public sector organisations. Results suggests that (1) larger organisations have received more benefits compared to small organisations, (2) small organisations demonstrated higher reliance on their ERP systems, (3) employment cohorts demonstrate significant differences in perceived benefits in small and large organisations.

Knowledge management for ERP success

The business value of Enterprise Resource Planning (ERP) systems and in general large software implementations has been extensively debated in both popular press and academic literature for over three decades. Despite the positive motives for adoption, various organizations have reported negative impacts from these large investments. This ‘disconnect’ between large IS investments and firms’ organizational performance may be attributable to the economic transition from an era of competitive advantage based on information to one that is based on Knowledge. This paper discusses the initial findings of a two-phased study that focuses on empirically assessing the impact of knowledge management on the success of Enterprise Resource Planning systems. The research study uses information gathered from twenty-seven public sector organizations in Queensland, Australia. Validation of the a priori model constructs through factor analysis identified two dimensions of knowledge management. Further analysis assessed the comparative differences in perceptions of knowledge management in ERP, across four employment cohorts.