Formative and reflective measurement and validation mismatch in survey research : an archival analysis of information systems success constructs 1985-2007

The generic IS-success constructs first identified by DeLone and McLean (1992) continue to be widely employed in research. Yet, recent work by Petter et al (2007) has cast doubt on the validity of many mainstream constructs employed in IS research over the past 3 decades; critiquing the almost universal conceptualization and validation of these constructs as reflective when in many studies the measures appear to have been implicitly operationalized as formative. Cited examples of proper specification of the Delone and McLean constructs are few, particularly in light of their extensive employment in IS research. This paper introduces a four-stage formative construct development framework: Conceive > Operationalize > Respond > Validate (CORV). Employing the CORV framework in an archival analysis of research published in top outlets 1985-2007, the paper explores the extent of possible problems with past IS research due to potential misspecification of the four application-related success dimensions: Individual-Impact, Organizational-Impact, System-Quality and Information-Quality. Results suggest major concerns where there is a mismatch of the Respond and Validate stages. A general dearth of attention to the Operationalize and Respond stages in methodological writings is also observed.

Survey research

This book aims to provide an overview of approaches to assist researchers and practitioners to explore ways of undertaking research in the information literacy field. The first chapter provides an introductory overview of research by Dr Kirsty Williamson (author of Research Methods for Students, Academics and Professionals: Information Management and Systems) and this sets the scene for the rest of the chapters where each author explores the key aspects of a specific method and explains how it may be applied in practice. The methods covered include those representing qualitative, quantitative and mixed methods. Both a chapter on the topical evidence-based practice approach, and another critiquing it, are also included. The final chapter points the way towards potential new directions for the burgeoning field

Establishing content validity of a survey research instrument : the older patients in acute care survey - United States

Geriatric nursing competency in the acute care setting is a social mandate for the 21st century. This article reports on the content validation of an Australian research instrument, the Older Patients in Acute Care Survey (OPACS) that examines the attitudes, the knowledge, and the practices of nurses working with acute care patients. The OPACS tool was developed primarily to assist nurse educators to assess attitudes, knowledge, and practices of nursing staff in caring for older patients in the acute care setting; to evaluate the implementation of institution-specific educational interventions; and to improve quality of care given to older patients. An overall content validity index (CVI) for the OPACS was calculated (CVI = .918), revealing high content validity. Opinions (CVI = .92) and practices (CVI = .97) subconstructs revealed high content validity as well. Therefore, results indicate that the OPACS has high content validity in the U.S. acute care setting and could assist nurse educators in establishing and enhancing nurse competency in the care for geriatric patients in the future.

Survey research methods

book review

Survey research and sociology

Sociologisk Forsknings digitala arkiv

Small business perceptions of postal and online survey research

Concerns over the overall cost of marketing research and the cost per usable response have in large measure caused marketing practitioners to turn to online marketing research techniques, either as a solus technique, or in a mixed mode application. However, the use of e-mail and mixed mode surveys such as postal invitations to complete online questionnaires present both familiar and new issues, as the extant literature illustrates. This paper examines an earlier study before reporting findings from the present study, which employs a method that ascertains the probability of commissioning four survey research methods, described in scenarios and delivered using e-mail and the World Wide Web (Web). It is evident that while perceptions of e-mail, the Internet, and privacy have changed since early use of the Internet and more particularly the World Wide Web, and there is acknowledgement in the literature concerning the lower costs and faster response speeds of online marketing research, small businesses do appear to discriminate in favour of targeted online survey methods over postal surveys, portrayed as scenarios in this study, but that this perception does not apply to all hybrid survey modes.

Improving gambling survey research using dual-frame sampling of landline and mobile phone numbers

Gambling prevalence studies are typically conducted within a single (landline) telephone sampling frame. This practice continues, despite emerging evidence that significant differences exist between landline and mobile (cell) phone only households. This study utilised a dual-frame (landline and mobile) telephone sampling methodology to cast light on the extent of differences across groups of respondents in respect to demographic, health, and gambling characteristics.

A total of 2,014 participants from across Australian states and territories ranging in age from 18 to 96 years participated. Interviews were conducted using computer assisted telephone interviewing technology where 1,012 respondents from the landline sampling frame and 1,002 from the mobile phone sampling frame completed a questionnaire about gambling and other health behaviours. Responses across the landline sampling frame, the mobile phone sampling frame, and the subset of the mobile phone sampling frame that possessed a mobile phone only (MPO) were contrasted.

The findings revealed that although respondents in the landline sample (62.7 %) did not significantly differ from respondents in the mobile phone sample (59.2 %) in gambling participation in the previous 12 months, they were significantly more likely to have gambled in the previous 12 months than the MPO sample (56.4 %). There were no significant differences in internet gambling participation over the previous 12 months in the landline sample (4.7 %), mobile phone sample (4.7 %) and the MPO sample (5.0 %). However, endorsement of lifetime problem gambling on the NODS-CLiP was significantly higher within the mobile sample (10.7 %) and the MPO sample (14.8 %) than the landline sample (6.6 %).

Our research supports previous findings that reliance on a traditional landline telephone sampling approach effectively excludes distinct subgroups of the population from being represented inresearch findings. Consequently, we suggest that research best practice necessitates the use of a dual- rame sampling methodology. Despite inherent logistical and cost issues, this approach  needs to become the norm in gambling survey research.

Survey Research Center National Elections Study

l-r Philip Converse, asst. study director, Warren E. Miller research associate, Angus Campbell, dir.