Formative and reflective measurement and validation mismatch in survey research : an archival analysis of information systems success constructs 1985-2007

The generic IS-success constructs first identified by DeLone and McLean (1992) continue to be widely employed in research. Yet, recent work by Petter et al (2007) has cast doubt on the validity of many mainstream constructs employed in IS research over the past 3 decades; critiquing the almost universal conceptualization and validation of these constructs as reflective when in many studies the measures appear to have been implicitly operationalized as formative. Cited examples of proper specification of the Delone and McLean constructs are few, particularly in light of their extensive employment in IS research. This paper introduces a four-stage formative construct development framework: Conceive > Operationalize > Respond > Validate (CORV). Employing the CORV framework in an archival analysis of research published in top outlets 1985-2007, the paper explores the extent of possible problems with past IS research due to potential misspecification of the four application-related success dimensions: Individual-Impact, Organizational-Impact, System-Quality and Information-Quality. Results suggest major concerns where there is a mismatch of the Respond and Validate stages. A general dearth of attention to the Operationalize and Respond stages in methodological writings is also observed.

Identity and disciplinarity : Multi-disciplinary student cohorts in Higher Education [Abstract]

This paper will describe a research project that examines the implications of multidisciplinary student cohorts on teaching and learning within undergraduate and postgraduate units in higher education. Whist students generally specialise in one discipline, it is also common that, at some point during their degree, they will choose to undertake subjects that are outside their specialist area. Students may choose a multidisciplinary learning experience either out of interest or because the subject is seen as complementary to their core discipline. When the lens of identity is applied to the multi-disciplinary cohorts in undergraduate and postgraduate units, it assists in identifying learning needs. The nature of disciplinarity, and the impact it has on students’ academic identity, presents challenges to both students and teachers when they engage in teaching and learning, impacting on curriculum design, assessment practices and teaching delivery strategies (Winberg, 2008). This project aims to identify the barriers that exist to effective teaching and learning in units that have multidisciplinary student cohorts. It will identify the particular needs of students in multidisciplinary student cohorts and determine a teaching and learning model that meets the needs of such cohorts. References Becher, T. & Trowler, P.R. (2001). Academic tribes and territories: Intellectual enquiry and the culture of the discipline. Buckingham, UK: Open University Press. Light, G. & Cox, R. (2001). Learning and teaching in higher education: A reflective professional. Thousand Oaks, CA: Sage. Neumann, R. (2001). Disciplinary differences and university teaching. Studies in Higher Education, 26 (2), 135-46. Neumann, R., Parry, S. & Becher, T. (2002). Teaching and Learning in their disciplinary contexts: A conceptual analysis. Studies in Higher Education, 27(4), 405-417. Taylor, P.G. (1999) Making Sense of Academic Life: Academics, Universities and Change. Buckingham, UK: Open University Press. Winberg, C. (2008). Teaching engineering/engineering teaching: interdisciplinary collaboration and the construction of academic identities. Teaching in Higher Education, 13(3), 353 - 367.

Writing together, learning together : the value and effectiveness of a research writing group for doctoral students

The high level of scholarly writing required for a doctoral thesis is a challenge for many research students. However, formal academic writing training is not a core component of many doctoral programs. Informal writing groups for doctoral students may be one method of contributing to the improvement of scholarly writing. In this paper, we report on a writing group that was initiated by an experienced writer and higher degree research supervisor to support and improve her doctoral students’ writing capabilities. Over time, this group developed a workable model to suit their varying needs and circumstances. The model comprised group sessions, an email group, and individual writing. Here, we use a narrative approach to explore the effectiveness and value of our research writing group model in improving scholarly writing. The data consisted of doctoral students’ reflections to stimulus questions about their writing progress and experiences. The stimulus questions sought to probe individual concerns about their own writing, what they had learned in the research writing group, the benefits of the group, and the disadvantages and challenges to participation. These reflections were analysed using thematic analysis. Following this analysis, the supervisor provided her perspective on the key themes that emerged. Results revealed that, through the writing group, members learned technical elements (e.g., paragraph structure), non-technical elements (e.g., working within limited timeframes), conceptual elements (e.g., constructing a cohesive arguments), collaborative writing processes, and how to edit and respond to feedback. In addition to improved writing quality, other benefits were opportunities for shared writing experiences, peer support, and increased confidence and motivation. The writing group provides a unique social learning environment with opportunities for: professional dialogue about writing, peer learning and review, and developing a supportive peer network. Thus our research writing group has proved an effective avenue for building doctoral students’ capability in scholarly writing. The proposed model for a research writing group could be applicable to any context, regardless of the type and location of the university, university faculty, doctoral program structure, or number of postgraduate students. It could also be used within a group of students with diverse research abilities, needs, topics and methodologies. However, it requires a group facilitator with sufficient expertise in scholarly writing and experience in doctoral supervision who can both engage the group in planned writing activities and also capitalise on fruitful lines of discussion related to students’ concerns as they arise. The research writing group is not intended to replace traditional supervision processes nor existing training. However it has clear benefits for improving scholarly writing in doctoral research programs particularly in an era of rapidly increasing student load.

A QUT experience in combining sustainability research with educational activities and professional practice

The paper discusses the development and delivery of a university subject on sustainable construction, using related research projects as case studies and learning materials. It exposed students from a variety of disciplines to real life scenarios, to group around project cases, and learn to work with one another in solving sustainable development problems. The problem based learning approach directly responds to the new trends of learning by practising which, in the area of sustainability education, is particularly appropriate because of the need for multidisciplinary approach to complex issues, and the impetus for research and development to provide timely input for education in this growing discipline with a relatively short history. Collaboration of students from cross-disciplines, the engagement of industry and practitioners, the concept of using project cases and student design competition, and the tangible improvement of students’ comprehension of the sustainability phenomenon as a whole, have been the highlights of this Australian experience.

Survey research

This book aims to provide an overview of approaches to assist researchers and practitioners to explore ways of undertaking research in the information literacy field. The first chapter provides an introductory overview of research by Dr Kirsty Williamson (author of Research Methods for Students, Academics and Professionals: Information Management and Systems) and this sets the scene for the rest of the chapters where each author explores the key aspects of a specific method and explains how it may be applied in practice. The methods covered include those representing qualitative, quantitative and mixed methods. Both a chapter on the topical evidence-based practice approach, and another critiquing it, are also included. The final chapter points the way towards potential new directions for the burgeoning field

Towards authorisation models for secure information sharing : a survey and research agenda

This article presents a survey of authorisation models and considers their ‘fitness-for-purpose’ in facilitating information sharing. Network-supported information sharing is an important technical capability that underpins collaboration in support of dynamic and unpredictable activities such as emergency response, national security, infrastructure protection, supply chain integration and emerging business models based on the concept of a ‘virtual organisation’. The article argues that present authorisation models are inflexible and poorly scalable in such dynamic environments due to their assumption that the future needs of the system can be predicted, which in turn justifies the use of persistent authorisation policies. The article outlines the motivation and requirement for a new flexible authorisation model that addresses the needs of information sharing. It proposes that a flexible and scalable authorisation model must allow an explicit specification of the objectives of the system and access decisions must be made based on a late trade-off analysis between these explicit objectives. A research agenda for the proposed Objective-based Access Control concept is presented.

Teaching cause-of-death certification : lessons from international experience

The accuracy of cause-of-death statistics substantially depends on the quality of cause-of-death information in death certificates, primarily completed by medical doctors. Deficiencies in cause-of-death certification have been observed across the world, and over time. Despite educational interventions targeting to improve the quality of death certification, their intended impacts are rarely evaluated. This review aims to provide empirical evidence that could guide the modification of existing educational programs, or the development of new interventions, which are necessary to improve the capacity of certifiers as well as the quality of cause-of-death certification, and thereby, the quality of mortality statistics.

Establishing content validity of a survey research instrument : the older patients in acute care survey - United States

Geriatric nursing competency in the acute care setting is a social mandate for the 21st century. This article reports on the content validation of an Australian research instrument, the Older Patients in Acute Care Survey (OPACS) that examines the attitudes, the knowledge, and the practices of nurses working with acute care patients. The OPACS tool was developed primarily to assist nurse educators to assess attitudes, knowledge, and practices of nursing staff in caring for older patients in the acute care setting; to evaluate the implementation of institution-specific educational interventions; and to improve quality of care given to older patients. An overall content validity index (CVI) for the OPACS was calculated (CVI = .918), revealing high content validity. Opinions (CVI = .92) and practices (CVI = .97) subconstructs revealed high content validity as well. Therefore, results indicate that the OPACS has high content validity in the U.S. acute care setting and could assist nurse educators in establishing and enhancing nurse competency in the care for geriatric patients in the future.

Does research into sensitive areas do harm? Experiences of research participation after a child’s diagnosis with Ewing’s Sarcoma

Objective: To investigate family members’ experiences of involvement in a previous study (conducted August 1995 to June 1997) following their child’s diagnosis with Ewing’s sarcoma. Design: Retrospective survey, conducted between 1 November and 30 November 1997, using a postal questionnaire. Participants: Eighty-one of 97 families who had previously completed an in-depth interview as part of a national case–control study of Ewing’s sarcoma. Main outcome measures: Participants’ views on how participation in the previous study had affected them and what motivated them to participate. Results: Most study participants indicated that taking part in the previous study had been a positive experience. Most (n = 79 [97.5%]) believed their involvement would benefit others and were glad to have participated, despite expecting and finding some parts of the interview to be painful. Parents whose child was still alive at the time of the interview recalled participation as more painful than those whose child had died before the interview. Parents who had completed the interview less than a year before our study recalled it as being more painful than those who had completed it more than a year before. Conclusions: That people suffering bereavement are generally eager to participate in research and may indeed find it a positive experience is useful information for members of ethics review boards and other “gatekeepers”, who frequently need to determine whether studies into sensitive areas should be approved. Such information may also help members of the community to make an informed decision regarding participation in such research.

Medications and driving : community knowledge, perceptions and experience

There is increasing awareness of the potential for any medication that acts on the central nervous system to impair judgement and motor functioning, including driving performance. This paper reports community knowledge, perceptions and experience in relation to driving while taking medications. A community-based survey (n=316) revealed that of those who had taken any type of medication in the last 7 days (n=193), a quarter (24%) had driven while taking a medication that they thought could affect them. Of those who drove for work, a quarter (26%) of the respondents reported that they had changed or stopped their work-related driving because they were taking a medication that displayed a warning label about driving. Outside of work, a third (35%) of the total number of respondents reported that they had done so. Of those who had taken any type of medication in the last 7 days, 62 were taking on a daily basis one or more medications classified as being likely to have a warning label about driving, such as sedatives, tranquilizers, antidepressants, analgesics and anticonvulsives. This paper will examine community knowledge, perceptions and experience surrounding medications and driving with particular reference to those persons who were taking drugs with a warning label, and the barriers to following such warnings.

Network structure, knowledge governance, and firm performance : evidence from innovation networks and SMEs in the UK

It is increasingly understood that learning and thus innovation often occurs via highly interactive, iterative, network-based processes. Simultaneously, economic development policy is increasingly focused on small and medium-sized enterprises (SMEs) as a means of generating growth, creating a clear research issue in terms of the roles and interactions of government policy, universities, and other sources of knowledge, SMEs, and the creation and dissemination of innovation. This paper analyses the contribution of a range of actors in an SME innovation creation and dissemination framework, reviewing the role of various institutions therein, exploring the contribution of cross-locality networks, and identifying the mechanisms required to operationalise such a framework. Bivariate and multivariate (regression) techniques are employed to investigate both innovation and growth outcomes in relation to these structures; data are derived from the survey responses of over 450 SMEs in the UK. Results are complex and dependent upon the nature of institutions involved, the type of knowledge sought, and the spatial level of the linkages in place but overall highlight the value of cross-locality networks, network governance structures, and certain spillover effects from universities. In general, we find less support for the factors predicting SME growth outcomes than is the case for innovation. Finally, we outline an agenda for further research in the area.

Examining research productivity of Chinese TEFL academics across departments and institutes

This study aims to benchmark Chinese TEFL academics’ research productivities, as a way to identify and, subsequently, address research productivity issues. This study investigated 182 Chinese TEFL academics’ research outputs and perceptions about research across three Chinese higher education institutions using a literature-based survey. ANOVA, t-tests and descriptive statistics were used to analyse data from and between the three institutions. Findings indicated that more than 70% of the TEFL academics had produced no research in 10 of the 12 research output fields during 2004-2008. The English Language and Literature Department in the national university outperformed all other departments at the three institutes for most of the research output categories. While a majority of the participants seemed to hold positive perceptions about research, t-tests and ANOVA indicated that their research perceptions were significantly different across institutes and departments. Developing TEFL research capacity requires tertiary institutions to provide research-learning opportunities.

Mobile phones in PNG villages : an island village experience

As a new communication technology expands in a disadvantaged, rural area of a developing country, changes take place in the lives of the people in the area. The paper examines the introduction of mobile telephony into a rural village in Papua New Guinea, and contains findings from field research conducted in February 2009. The analysis is undertaken through a social lens, providing an understanding of the roles of mobile phones in this community by foregrounding the feelings, thoughts and attitudes expressed by the village people. This in turn enables a deeper understanding of the sociological effects related to the uptake of mobile telephony.