Meta-analysis and research synthesis in education

This bibliography begins with this introduction followed by a general overview of meta-analysis and research synthesis methods in education. The third section cites references to illustrate how the concept of statistical integration of research findings dates back to early 20th century. Citations in the fourth section highlight early calls from educational researchers to recognize the process of synthesizing research as a scholarly endeavor in its own right. As evident from the citations in the fifth section, it was in the 1980s when monographs exclusively devoted to research synthesis methods started to be published. Since then, a number of books have been published on research synthesis methods. The sixth section cites some of the most comprehensive books on research synthesis methods and includes contributions from key players of meta-analysis current at the time. The citations in the seventh section illustrate how meta-analysis has become very popular over time. Several large organizations have been set up and software developed to support systematic reviews of research. These are cited in the eighth section. Citations in the ninth section illustrate critiques of systematic reviews. As qualitative research is becoming popular in education, sophisticated discussions of issues associated with synthesizing qualitative research have also been published, some of which are cited in the tenth section. The eleventh section presents a methodologically inclusive account of current developments in research synthesis methods. The final section cites examples of journals exclusively devoted to publishing research reviews and exemplary research synthesis with different methodologies. Individual methods of research synthesis are discussed chronologically as they became popular in educational research. Accordingly, this bibliography starts with a discussion of statistical methods of integrating research that parallels the dominance of quantitative research in education until the 1970s. As the popularity and diversity of qualitative research methods have been increasing in educational research, more methodologically inclusive discussions of research synthesis methods are becoming popular as described in the later sections of this bibliography.

Performing beginning teachers’ ‘firsts’: exploring a theatre-based research method

Theatre-based research methods have been employed in a variety of ways to transcend more traditional research methods, and bring research findings to a broader and relevant audience. Performing research to an 'expert' audience is transformative in nature. The audience share a collective understanding of the material presented, where their understandings can be challenged or confirmed. The ethical responsibilities of the theatre-based researcher are therefore paramount in presenting the research in a manner that respects the research participants, and allows the audience to make informed judgements.This paper outlines my experience in devising and performing 'The First Time' - a performance about twelve beginning teachers' firsts. The performance was constructed from their interview data and performed by teachers - most of who are drama teachers – in order to sensitively represent the real stories of the research participants. The research was framed within a practice theory approach (Schatzki 2001) with a focus on the transformation of practices situated within a particular time and place. The method of performing the research to an 'expert' audience of performing arts practitioners, teachers, and teacher educators created an opportunity for both the transformation of teaching practice and the transformation of theatre.The research findings focus on the importance of creativity and flexibility in an approach to both research and teaching. The outcomes of my research have implications for theatre-based researchers, as well as teacher educators, in-service teachers, and beginning teachers. All these practitioners are continually negotiating the waters of their ever-changing professions.

The essential role of social theory in qualitative public health research

OBJECTIVE: To define the role of social theory and examine how research studies using qualitative methods can use social theory to generalize their results beyond the setting of the study or to other social groups. APPROACH: The assumptions underlying public health research using qualitative methods derive from a range of social theories that include conflict theory, structural functionalism, symbolic interactionism, the sociology of knowledge and feminism. Depending on the research problem, these and other social theories provide conceptual tools and models for constructing a suitable research framework, and for collecting and analysing data. In combination with the substantive health literature, the theoretical literature provides the conceptual bridge that links the conclusions of the study to other social groups and settings. CONCLUSION: While descriptive studies using qualitative research methods can generate important insights into social experience, the use of social theory in the construction and conduct of research enables researchers to extrapolate their findings to settings and groups broader than the ones in which the research was conducted.

Development, implementation and evaluation of a clinical research engagement and leadership capacity building program in a large Australian health care service

BACKGROUND: Health professionals need to be integrated more effectively in clinical research to ensure that research addresses clinical needs and provides practical solutions at the coal face of care. In light of limited evidence on how best to achieve this, evaluation of strategies to introduce, adapt and sustain evidence-based practices across different populations and settings is required. This project aims to address this gap through the co-design, development, implementation, evaluation, refinement and ultimately scale-up of a clinical research engagement and leadership capacity building program in a clinical setting with little to no co-ordinated approach to clinical research engagement and education.

METHODS/DESIGN: The protocol is based on principles of research capacity building and on a six-step framework, which have previously led to successful implementation and long-term sustainability. A mixed methods study design will be used. Methods will include: (1) a review of the literature about strategies that engage health professionals in research through capacity building and/or education in research methods; (2) a review of existing local research education and support elements; (3) a needs assessment in the local clinical setting, including an online cross-sectional survey and semi-structured interviews; (4) co-design and development of an educational and support program; (5) implementation of the program in the clinical environment; and (6) pre- and post-implementation evaluation and ultimately program scale-up. The evaluation focuses on research activity and knowledge, attitudes and preferences about clinical research, evidence-based practice and leadership and post implementation, about their satisfaction with the program. The investigators will evaluate the feasibility and effect of the program according to capacity building measures and will revise where appropriate prior to scale-up.

DISCUSSION: It is anticipated that this clinical research engagement and leadership capacity building program will enable and enhance clinically relevant research to be led and conducted by health professionals in the health setting. This approach will also encourage identification of areas of clinical uncertainty and need that can be addressed through clinical research within the health setting.

Two-group randomised, parallel trial of cognitive and exposure therapies for problem gambling: a research protocol

BACKGROUND: Problem gambling is a serious public health concern at an international level where population prevalence rates average 2% or more and occurs more frequently in younger populations. The most empirically established treatments until now are combinations of cognitive and behavioural techniques labelled cognitive behaviour therapy (CBT). However, there is a paucity of high quality evidence for the comparative efficacy of core CBT interventions in treating problem gamblers. This study aims to isolate and compare cognitive and behavioural (exposure-based) techniques to determine their relative efficacy.

METHODS: A sample of 130 treatment-seeking problem gamblers will be allocated to either cognitive or exposure therapy in a two-group randomised, parallel design. Repeated measures will be conducted at baseline, mid and end of treatment (12 sessions intervention period), and at 3, 6 and 12 months (maintenance effects). The primary outcome measure is improvement in problem gambling severity symptoms using the Victorian Gambling Screen (VGS) harm to self-subscale. VGS measures gambling severity on an extensive continuum, thereby enhancing sensitivity to change within and between individuals over time.

DISCUSSION: This article describes the research methods, treatments and outcome measures used to evaluate gambling behaviours, problems caused by gambling and mechanisms of change. This study will be the first randomised, parallel trial to compare cognitive and exposure therapies in this population.

ETHICS AND DISSEMINATION: The study was approved by the Southern Adelaide Health Service/Flinders University Human Research Ethics Committee. Study findings will be disseminated through peer-reviewed publications and conference presentations.

Harnessing the potential of community-based participatory research approaches in bipolar disorder

BACKGROUND: Despite the rapid growth in the sophistication of research on bipolar disorder (BD), the field faces challenges in improving quality of life (QoL) and symptom outcomes, adapting treatments for marginalized communities, and disseminating research insights into real-world practice. Community-based participatory research (CBPR)-research that is conducted as a partnership between researchers and community members-has helped address similar gaps in other health conditions. This paper aims to improve awareness of the potential benefits of CBPR in BD research. METHODS: This paper is a product of the International Society for Bipolar Disorders (ISBD) Taskforce on Community Engagement which includes academic researchers, healthcare providers, people with lived experience of BD, and stakeholders from BD community agencies. Illustrative examples of CBPR in action are provided from two established centres that specialize in community engagement in BD research: the Collaborative RESearch Team to study psychosocial issues in BD (CREST.BD) in Canada, and the Spectrum Centre for Mental Health Research in the United Kingdom. RESULTS AND DISCUSSION: We describe the philosophy of CBPR and then introduce four core research areas the BD community has prioritized for research: new treatment approaches, more comprehensive outcome assessments, tackling stigma, and enhanced understanding of positive outcomes. We then describe ways in which CBPR is ideal for advancing each of these research areas and provide specific examples of ways that CBPR has already been successfully applied in these areas. We end by noting potential challenges and mitigation strategies in the application of CBPR in BD research. CONCLUSIONS: We believe that CBPR approaches have significant potential value for the BD research community. The observations and concerns of people with BD, their family members, and supports clearly represent a rich source of information. CBPR approaches provide a collaborative, equitable, empowering orientation to research that builds on the diversity of strengths amongst community stakeholders. Despite the potential merits of this approach, CBPR is as yet not widely used in the BD research field, representing a missed opportunity.

Sport consumer behavior research: improving our game

Sport consumer behavior (SCB) research continues to grow in both popularity and sophistication. A guiding principle in much of this research has focused on the nature of sport-related experiences and the benefits sport consumers derive from these experiences. This emphasis has generated new knowledge and insights into the needs and wants of sport consumers. Although these efforts have contributed to the field's understanding of SCB, the vast majority of this research has centered on psychological phenomena and the evaluative and affective components of these sport experiences. Approaches to this work have also narrowed, with SCB research predominately relying on cross-sectional studies and attitudinal surveys to collect information. This has resulted in limited findings that seldom account for how various situational or environmental factors might influence attitudinal data patterns at the individual and group level. This special issues seeks to deepen our understanding of SCB by providing seven papers that demonstrate or validate findings using multiple studies or data collections.

Generalization in IS research: a critique of the conflicting positions of Lee & Baskerville and Tsang & Williams

This edited two-volume collection presents the most interesting and compelling articles pertaining to the formulation of research methods used to study information systems from the 30-year publication history of the Journal of Information Technology.

Doing educational research in Bangladesh: challenges in applying Western research methodology

Research methods are closely linked to specific cultures (Kee, 2004). Recognition of cultural values in the knowledge generation process is important if researchers are to produce culturally diverse interpretations of reality that facilitate meaningful progression. Asian scholars often depend on Western theories for understanding issues and creating knowledge in their own contexts (Papoutsaki, 2006). Many scholars relate this influence of the West on the non-West to neocolonization (Nguyen et al., 2009), neo-imperialism (Balogh, 1962) and globalization (Rizvi, 2004; Campbell, 2012). Scholars also see this influence as a unidirectional cultural flow, from 'the West' to 'the Rest' (Rizvi, 2004, p. 159). Such Western influences on knowledge-generating practices often pose challenges for researchers fro1n non-Western, particularly Asian, contexts when they employ Western methodologies in their own contexts. These challenges are embedded in differences in cultural values, beliefs and norms, as well as differences in orientation to research, because each society is unique in character and has specific knowledge needs that are culturally appropriate. Societal and local knowledge is, essentially, a contributory factor if research is to be locally appropriate and globally acceptable (Ma Rhea, 2004).

Use of the My Health Record by people with communication disability in Australia: A review to inform the design and direction of future research

BACKGROUND: People with communication disability often struggle to convey their health information to multiple service providers and are at increased risk of adverse health outcomes related to the poor exchange of health information. OBJECTIVE: The purpose of this article was to (a) review the literature informing future research on the Australian personally controlled electronic health record, 'My Health Record' (MyHR), specifically to include people with communication disability and their family members or service providers, and (b) to propose a range of suitable methodologies that might be applied in research to inform training, policy and practice in relation to supporting people with communication disability and their representatives to engage in using MyHR. METHOD: The authors reviewed the literature and, with a cross-disciplinary perspective, considered ways to apply sociotechnical, health informatics, and inclusive methodologies to research on MyHR use by adults with communication disability. RESEARCH OUTCOMES: This article outlines a range of research methods suitable for investigating the use of MyHR by people who have communication disability associated with a range of acquired or lifelong health conditions, and their family members, and direct support workers. CONCLUSION: In planning the allocation of funds towards the health and well-being of adults with disabilities, both disability and health service providers must consider the supports needed for people with communication disability to use MyHR. There is an urgent need to focus research efforts on MyHR in populations with communication disability, who struggle to communicate their health information across multiple health and disability service providers. The design of studies and priorities for future research should be set in consultation with people with communication disability and their representatives.

Peer research with young Muslims and the politics of knowledge production

Purpose – The purpose of this paper is to draw on the authors’ experiences as a team made up of both “insiders” and “outsiders” in order to investigate how an insider-outsider peer research method facilitates productive forms of research into the lives of young Muslims, and to contribute to debates about ways of knowing youth. The authors aim to shift focus from a common claim that peer research methods simply improve research about youth to more deeply investigate how they enable, as well as limit, the production of particular kinds of knowledge, in this case, about Muslim youth in Australia. Design/methodology/approach – The research aimed to explore how “ordinary” young Australian Muslims engage in civic life. Yet the authors were faced with the challenge of accessing and recruiting “ordinary” youth in times of Islamophobia, wherein Muslim communities expressed serious concerns about their voices being misinterpreted, misused and misappropriated. Therefore, the authors sought to utilise an approach of outsider-designed and guided research that was then shaped and executed by insider peer researchers. It is this research design and its execution that the authors interrogate in this paper. Findings – As well as affording the authors access and the elicitation of rich, complex and high-quality data, the approach also fostered more complex stories about young Muslim identities and experiences, and enabled the authors to contest some common and homogenising representations. It also allowed opportunities for fundamental issues inherent in these kinds of qualitative research methods to be made explicit. These include the politics of performativity and issues of positionality in the peer research process. The authors suggest that the “insider” and “outsider” approach succeeded not so much because it got the authors closer to the “truth” about young Muslims’ civic lives, but because it revealed some of the mechanics of the ways stories are constructed and represented in youth research. Originality/value – The originality and value of this paper lie in its contribution to a debate about the politics of knowledge production about young people and Muslims in particular, and in its effort to move forward a discussion about how to be accountable in youth research to the various communities and to one another in insider-outsider research teams.

Genetic variation and obesity in Australian women: A prospective study.

Objective: A number of candidate genes have been implicated in the pathogenesis of obesity in humans. This study examines associations between longitudinal changes in body mass and composition and the presence of polymorphisms in the ß-3 adrenergic receptor, tumor necrosis factor-α, leptin, and leptin receptor (Lepr) in a cohort of Australian women.

Research Methods and Procedures: Healthy white Australian women (n = 335) were randomly selected from the Barwon region of Victoria and underwent baseline anthropometry and double-energy X-ray absorptiometry for assessment of body mass and adiposity. These measurements were repeated again at 2-year follow-up. Genomic DNA was extracted and used for polymerase chain reaction-based genotyping of all polymorphisms.

Results: The Pro1019Pro Lepr polymorphism was associated with longitudinal increases in body weight (p = 0.02), fat mass (p = 0.05), and body mass index (p = 0.01) in this study, and individuals homozygous for the A allele at this locus had a greater propensity to gain body fat over time. The largest effects on body composition seemed to be in individuals already obese at baseline. Changes in body weight, fat mass, percent body fat, and body mass index over a 2-year period were not associated with genetic variation in the ß-3 adrenergic receptor (Trp64Arg), tumor necrosis factor-α promoter, or leptin genes in non-obese or obese women.

Discussion: These results suggest that a Lepr polymorphism is involved in the regulation of body mass and adiposity in obese Australian white women, which may have implications for the treatment of obesity in this population.

Relationship between body mass index and the use of healthcare services in Australia

Objective: To examine the relationship between body mass index (BMI) and the use of medical and preventive health services. Research Methods and Procedures: This study involved secondary analysis of weighted data from the Australian 1995 National Health Survey. The study was a population survey designed to obtain national benchmark information about a range of health-related issues. Data were available from 17,033 men and 17,174 women, 20 years or age. BMI, based on self-reported weight and height, was analyzed in relation to the use of medical services and preventive health services. Results: A positive relationship was found between BMI and medical service use, such as medication use, visits to hospital accident and emergency departments (for women only); doctor visits, visits to a hospital outpatient clinics; and visits to other health professionals (for women only). A negative relationship was found in women between BMI and preventive health services. Underweight women were found to be significantly less likely to have Papanicolaou smear tests, breast examinations, and mammograms. Discussion: This research shows that people who fall outside the healthy weight range are more likely to use a range of medical services. Given that the BMI of industrialized populations appears to be increasing, this has important ramifications for health service planning and reinforces the need for obesity prevention strategies at a population level.

The role of puberty, media and popularity with peers on strategies to increase weight, decrease weight and increase muscle tone among adolescent boys and girls

The present study was concerned with the impact of pubertal development, relationships with peers and perceived pressure from the media on body dissatisfaction and body change behaviors among adolescent boys and girls. In particular, the study investigated the underresearched area of strategies to increase weight and muscle. The exploration of body change strategies among adolescent boys has been a neglected area of research. Methods: Respondents were 1185 adolescents (527 males, 598 females) who were enrolled in Grades 7 and 9. Participants completed measures of pubertal development, media and peer influence, body dissatisfaction and strategies to lose weight, increase weight and to increase muscle. Results: The findings demonstrated that girls were more likely than boys to adopt strategies to lose weight, whereas boys were more likely to adopt strategies to increase muscle tone (but not weight). For boys in both Years 7 and 9, the main predictors of body change strategies were puberty and, to a lesser extent, perceived popularity with peers. The major influences for Years 7 and 9 girls were puberty and the media, but these mainly focused on weight loss. For Year 9 girls, perceived popularity with opposite-sex peers also predicted body dissatisfaction and strategies to increase muscle tone. Conclusion: The implications of these findings for understanding factors related to a range of body change strategies for adolescent boys and girls are discussed.