Clinical research 5: quantitative data collection and analysis

This six-part research series is aimed at clinicians who wish to develop research skills, or who have a particular clinical problem that they think could be addressed through research. The series aims to provide insight into the decisions that researchers make in the course of their work, and to also provide a foundation for decisions that nurses may make in applying the findings of a study to practice in their own Unit or Department. The series emphasises the practical issues encountered when undertaking research in critical care settings; readers are encouraged to source research methodology textbooks for more detailed guidance on specific aspects of the research process.

A couple of points:

1. It is artificial to describe research as qualitative or quantitative. Studies often include both dimensions. However, for the purposes of this paper/series, this distinction is drawn for clarity of writing.

2. It is common practice for quantitative studies to refer to study ‘subjects’ and qualitative studies to refer to study ‘participants’. For ease of reading, the latter term will be used throughout this series.

Easier analysis and better reporting : modelling ordinal data in mathematics education research

This article presents an examination of the use of Rasch modelling in a major research project, 'Improving Middle Years Mathematics and Science' (IMYMS). It is unarguable that it is important to take students' perceptions, or views, into account when planning learning and teaching for them. The IMYMS student perceptions survey is an attempt to make visible these student viewpoints, and report them in a way that is accessible to teachers and researchers involved in the project. The project involves four clusters of schools from urban and regions of Victoria to investigate the role of mathematics and science knowledge and subject cultures in mediating change processes in the middle years of schooling. There are five secondary and twenty-eight primary schools. The project has generated both qualitative and quantitative data, with much of the qualitative data being ordinal in nature. Reporting the results of analyses for a range of audiences necessitates careful, well-designed report formats. Some useful new report formats based on Rasch modeling -the Modified Variable Map, the Ordinal Map, the Threshold Map, and the Annotated Ordinal Map - are illustrated using data from the IMYMS project. The Rasch analysis and the derived reporting formats avoid the pitfalls that exist when working with ordinal data and provide insights into the respondents' views about their experiences in schools unavailable by other approaches.

Adopting web-based learning and teaching: a case study in higher education

Most universities worldwide are becoming distance education providers through adopting web-based learning and teaching via the introduction of learning management systems that enable them to open their courses to both on- and off-campus students. Whether this is an effective introduction depends on factors that enable and impede the adoption of such systems and their related pedagogical strategies. This study examines such factors related to adopting a learning management system in a large multicampus urban Australian university. The research method used case study approaches and purposively selected the sample consisting of innovative teaching academics from across the university, who used web-based approaches to teach both on- and off-campus learners. The data were analyzed using a combination of Rogers' theory of diffusion of innovations and actor-network theory and revealed a series of enabling and impeding factors faced by pioneering technology-adopter teaching academics, some of which are technology related while others are policy related and common to large multicampus institutions. The study found that safe adoption environments recognizing career priorities of academics are a result of the continuous negotiation between the evolving institution and its innovative and creative staff. The article concludes with a series of conditions that would form a safe, enabling, and encouraging environment for technology-adopter teaching academics in a large multicampus higher education setting.

What have sampling and data collection got to do with good qualitative research?

Objective: To highlight the importance of sampling and data collection  processes in qualitative interview studies, and to discuss the contribution of  these processes to determining the strength of the evidence generated and  thereby to decisions for public health practice and policy.

Approach: This discussion is informed by a hierarchy-of-evidence-for-practice  model. The paper provides succinct guidelines for key sampling and data  collection considerations in qualitative research involving interview studies. The  importance of allowing time for immersion in a given community to become  familiar with the context and population is discussed, as well as the practical  constraints that sometimes operate against this stage. The role of theory in  guiding sample selection is discussed both in terms of identifying likely sources  of rich data and in understanding the issues emerging from the data. It is noted  that sampling further assists in confirming the developing evidence and also  illuminates data that does not seem to fit. The importance of reporting sampling  and data collection processes is highlighted clearly to enable others to assess  both the strength of the evidence and the broader applications of the findings.

Conclusion: Sampling and data collection processes are critical to determining  the quality of a study and the generalisability of the findings. We argue that  these processes should operate within the parameters of the research goal, be  guided by emerging theoretical considerations, cover a range of relevant   participant perspectives, and be clearly outlined in research reports with an  explanation of any research limitations.

Preparing to not to be a footballer : higher education and professional sport

In the commercialised and professionalised world of elite sport, issues associated with career pathways and post sporting career options have a particular resonance. In various football codes, an unexpected knock, twist, bend or break can profoundly impact a player's career. In this high risk and high consequence environment, a number of sports entertainment industries have instituted player development and education programmes to educate and prepare elite level performers for life after football. Drawing on Foucault's later work on governmentality and the care of the self, this paper will discuss findings from a research project funded by the Australian Football League (AFL). The paper presents data that suggests that, elite performers are so focused on establishing and prolonging a career as an elite performer, that other aspects of identity are seen as something to be complied with as a consequence of industry expectations. An industry emphasis on higher education raises issues for the sports industries that promote player enrolment in higher education and for the higher education institutions that must manage this lack of engagement.

Declining foreign enrollment at higher education institutions in the United States : a research note

When the Institute of International Education reported a drop of 2.4% in international student enrollment in the United States in 2003/2004, the first absolute decline in foreign enrollments since 1971/1972 (Open Doors, 2004), many were quick to point fingers at visa policies instituted after the September 11, 2001 attacks. The "Visas Mantis" review—a security clearance required for foreign students studying any of roughly 200 scientific fields—was blamed for tarnishing the view of the United States as a welcoming place for international students. Although the review has certainly been the cause of increased visa delays and rejections, this article takes the view that it is not the only cause for the dip in foreign enrollments in the United States. Through econometric analyses, it is shown that other than the visa quagmires, improved access to domestic education opportunities and tuition fee increases can indeed explain the drop in foreign enrollments.

Action research in higher education : the advancement of university learning and teaching

This thesis aims to contribute to the improvement and advancement of university learning, teaching, and staff development; to integrate educational theory and the practice of university teaching; and to contribute to the establishment of a new, emerging paradigm in higher education. The strategy towards achieving these aims comprises (1) an alternative research methodology in the interpretive, non-positivist paradigm; (2) an integrated framework drawing on a variety of previously unrelated theories to form an alternative model of university education; and (3) reference to the dialectical relationship between educational theory and teaching practice and their integration through action research in higher education. The thesis is not so much a critique of the traditional paradigm and of existing functionalist-structuralist approaches to higher education, but more a development and clarification of an alternative, dialectical, human action approach to higher education. The original contribution of this thesis to the theory and practice of higher education lies in the development (1) of an alternative model of university education based on an integration of previously unrelated domains of theory; (2) of a theoretical model of professional development as action research (the CRASP Model: Critical attitude, Research into teaching, Accountability, Self-evaluation, Professionalism); and (3) of action research projects in higher education. Action research is research by the university teachers themselves into their teaching practice, i.e. into problems of the curriculum and student learning. The case studies included in and appended to this thesis show that in one educational setting at least it was possible to improve and advance university learning and teaching through action research. The evidence for this advancement is provided in a number of previously published case studies compiled in the Appendix.

Changes in higher education and valuing the job : the views of accounting academics in Australia

In a previous article (Bellamy et al., 2003), the authors reported on survey research that investigated reasons why academics from business disciplines enter and remain in academia, and the conditions they deem necessary to creating ideal work satisfaction. For both entering and remaining, as well as in achieving ideal work satisfaction, the most important factors were found to be autonomy and flexibility, with teaching and research the next most important factors. In a subsequent analysis of the data, reported in this article, the authors identify and explore significant differences between accounting academics and other business academics in the relative importance placed on these key factors. The findings may be used to inform policy makers and university administrators of the importance of discipline differences when identifying key factors for recruitment and retention of accounting academics specifically, and business academics generally.

Environmental attitudes of pre-service teachers : a conceptual and methodological dilemma in cross-cultural data collection

Human generated environmental problems are significant issues of global concern. Despite this, varying attitudes towards environments continue to exist across the globe, impacting on environmental decision-making and action at local, national and international levels. This paper probes some of the similarities and differences in environmental attitudes amongst pre-service teachers in Australia, Republic of Maldives and Indonesia. Data were collected using an established environmental attitude questionnaire and individual interviews. The three communities exhibited a similar range of environmental attitudes using the established questionnaire but significant differences emerged when the interview data were analysed phenomenographically. These differences reflect diversity within and across cultural groups that cannot be satisfactorily explained by the theory underpinning the established questionnaire. Consequently, a revised conceptual framework is proposed.

Utility as a first principle for education research : reworking autonomy in Australian higher education

The focus of this paper is on the community impact of education research, as conceived specifically within a changing context of research assessment in Australia, first mooted by the previous Federal Coalition (conservative) Government within a new Research Quality Framework (RQF), and now to be reworked by the Excellence in Research for Australia (ERA) initiated by the incoming Federal Labour (progressive) Government. Convinced that a penchant for the utility of research will not go away, irrespective of the political orientations of government, our interest is in exploring: the assumption that research, particularly in areas such as education, should have an impact in the community (as this was first defined within the RQF); the difficulties much education research (despite its “applied” characterisation) has in complying with this ideal; and what a community impact requirement means for the kinds of education research that will be privileged in the future. In particular, we are concerned about the potential narrowing of education research directed at or by community impact and what is lost in the process. One potential loss or weakening is in the positional autonomy of higher education to conduct independent education research.

Challenging Australian higher education : three places to begin

I want to begin by thanking Professor Johnson for this opportunity to rehearse and indeed expand on the comments I made earlier this year at the Universities Australia meeting of Vice‐Chancellors in Brisbane. My comments then and now are in part speculative, given that they comment on what might be, although they are also cognizant of what we already know about student equity issues in Australian higher education and of the research data currently available, including research undertaken by the National Centre but also research available more widely, nationally and internationally. Informed by this work, the central thesis that I want to put to you today and to open up to discussion is that if the Australian higher education sector is to take seriously the federal government’s 20/40 targets, then there are three main challenges that need to be confronted.

First, that expansion of higher education provision and of a particular mix, will need to be done in the context of limited excess student demand, certainly compared with previous periods of expansion by the sector. Second, that the 20/40 targets have brought into sharp relief the problems with our current set of definitions and measurements of students: of equity groups (including socioeconomic status) but also student achievement and aspiration. And third, that universities will need to confront the teaching and learning that is higher education. This is the very thing – or at least one of them – for which we would hope school students would aspire.