Mixed methods research:don't "just do it"

Purpose The purpose of this paper is to identify some of the dilemmas involved in the debate on the how, when and why of mixed methods research. Design/methodology/approach The authors' starting point is formed by developments in the philosophy of science literature, and recent publications on mixed methods research outside of the management accounting domain. Findings Contrary to recent claims made in the management accounting literature, the authors assert that uncovering points of disagreement between methods may be as far as researchers can go by combining them. Being reflexive can help to provide a deeper understanding of the research process and the researcher's role in this process. Research limitations/implications The paper should extend the debate among management accounting researchers about mixed methods research. One of the lessons drawn is that researchers are actively immersed in the research process and cannot purge their own interests and views. Accepting this lesson casts doubt on what the act of research may imply and achieve. Practical implications The paper shows that combinations of research methods should not be made based on a "whatever works" attitude, since this approach ultimately is still infused with ontological and epistemological considerations that researchers have, and should try to explicate. Originality/value The value of this paper lies in the provision of philosophical underpinnings that have not been widely considered in the management accounting literature on mixed methods to date. © 2011 Emerald Group Publishing Limited. All rights reserved.

Broadening the evidence base and the mind when thinking about mixed methods research

On behalf of my coauthors, Dr Michael Larkin and Professor Paul Flowers, and I would like to thank Dr Pierre Pluye for his letter in response to our article.1 Dr Pluye supported our argument that a broader evidence base is needed in evidence-based healthcare. He provided the readers of this journal with important additional information which updates them on the progress in the area of mixed studies reviews and further detail about the Mixed Methods Appraisal Tool (MMAT).2 Since writing our …

“Mind the gap”: Qualitative Researchers and Mixed Methods Research

This paper presents a heuristic investigation of mixed methods organized around three pairs of opposing standpoints: methods (qualitative vs. quantitative), paradigms (constructivist vs. post positive), and inquiry approaches (dialectical vs. pragmatic).

Kava Anxiety Depression Spectrum Study (KADSS): a mixed methods RCT using an aqueous extract of Piper methysticum

Objectives: To report on the design, significance and potential impacts of the first documented human clinical trial assessing the anxiolytic and thymoleptic efficacy of an aqueous monoextract of Piper methysticum (kava). The significance of the qualitative element of our clinical trial is also explored. The Kava Anxiety Depression Spectrum Study (KADSS) is a 3-week placebocontrolled, double-blind, cross-over trial involving 60 adult participants (18—65) with elevated stable anxiety and varying levels of depressive symptoms. Aims: The aims of KADSS are: (1) to determine whether an aqueous standardised extract of kava is effective for the treatment of anxiety; (2) to assess the effects of kava on differing levels of depression; and (3) to explore participants’ experience of taking kava via qualitative research. The study also provides preliminary assessment of the safety of an aqueous extract of kava in humans. Conclusion: If results reveal that the aqueous kava preparation exerts significant anxiolytic effects and appears safe, potentially beneficial impacts may occur. Data supporting a safe and effective kava extract may encourage a re-introduction of kava to Europe, UK and Canada. This may provide a major socioeconomic benefit to Pacific Island nations, and to sufferers of anxiety disorders.

Developing a best practice model for partnership practice between specialist palliative care and intellectual disability services: a mixed methods study

Background: The lack of access to good quality palliative care for people with intellectual disabilities is highlighted in the international literature. In response, more partnership practice in end-of-life care is proposed. 
Aim: This study aimed to develop a best practice model to guide and promote partnership practice between specialist palliative care and intellectual disability services. 
Design: A mixed methods research design involving two phases was used, underpinned by a conceptual model for partnership practice. 
Setting/participants: Phase 1 involved scoping end-of-life care to people with intellectual disability, based on self-completed questionnaires. In all, 47 of 66 (71.2%) services responded. In Phase 2, semi-structured interviews were undertaken with a purposive sample recruited of 30 health and social care professionals working in intellectual disability and palliative care services, who had provided palliative care to someone with intellectual disability. For both phases, data were collected from primary and secondary care in one region of the United Kingdom. 
Results: In Phase 1, examples of good practice were apparent. However, partnership practice was infrequent and unmet educational needs were identified. Four themes emerged from the interviews in Phase 2: challenges and issues in end-of-life care, sharing and learning, supporting and empowering and partnership in practice. 
Conclusion: Joint working and learning between intellectual disability and specialist palliative care were seen as key and fundamental. A framework for partnership practice between both services has been developed which could have international applicability and should be explored with other services in end-of-life care.

Exploring Variations in Teachers' Work, Lives and Their Effects on Pupils: Key Findings and Implications from a Longitudinal Mixed Methods Study

This article outlines the research design of a large‐scale, longitudinal research study in England intended to describe and explore variations in teachers' work, lives and their effects on pupils' educational outcomes. The study, funded by the Department for Education and Skills (DfES) and incorporated into the Teaching and Learning Research Programme (TLRP) as an ‘Associate Project’, used an innovative mixed‐methods research design to create case studies of 300 teachers in Years 2, 6 and 9. The research was conducted over three consecutive academic years and collected a wide range of data through interviews, questionnaire surveys of teachers' and pupils' views and assessment data on pupils' attainments in English and mathematics. The text summarises the main findings from the research in relation to four interconnected themes of the study: Professional Life Phases; Professional Identity; Relative Effectiveness; and Resilience and Commitment. The influence of school context, in terms of level of social disadvantage of pupil intake, is also investigated. Key findings and their implications for policy and practice are highlighted.

The effects of quality and environmental management on competitive advantage: A mixed methods study in the hotel industry

This paper reports results derived from a mixed methods study where 13 hotel managers were initially interviewed, followed by a quantitative study of 355 additional managers. Data were analysed using partial least squares path modelling. The research question related to the relationship between quality and environmental management and the competitive advantage sought by hotels. The results indicate that quality management and environmental management permit the improvement of competitive advantage in terms of both costs and differentiation. Moreover, hotels implementing quality programmes find fewer obstacles in implementing environmental management.

Navigating health sources on the Internet: A mixed-methods examination of online consumer reviews and expert text on psychotropic drugs

Purpose. The Internet has provided an unprecedented opportunity for psychotropic medication consumers, a traditionally silenced group in clinical trial research, to have voice by contributing to the construction of drug knowledge in an immediate, direct manner. Currently, there are no systematic appraisals of the potential of online consumer drug reviews to contribute to drug knowledge. The purpose of this research was to explore the content of drug information on various websites representing themselves as consumer- and expert-constructed, and as a practical consideration, to examine how each source may help and hinder treatment decision-making.^ Methodology. A mixed-methods research strategy utilizing a grounded theory approach was used to analyze drug information on 5 exemplar websites (3 consumer- and 2 expertconstructed) for 2 popularly prescribed psychotropic drugs (escitalopram and quetiapine). A stratified simple random sample was used to select 1,080 consumer reviews from the websites (N=7,114) through February 2009. Text was coded using QDA Miner 3.2 software by Provalis Research. A combination of frequency tables, descriptive excerpts from text, and chi-square tests for association were used throughout analyses.^ Findings. The most frequently mentioned effects by consumers taking either drug were related to psychological/behavioral symptoms and sleep. Consumers reported many of the same effects as found on expert health sites, but provided more descriptive language and situational examples. Expert labels of less serious on certain effects were not congruent with the sometimes tremendous burden described by consumers. Consumers mentioned more than double the themes mentioned in expert text, and demonstrated a diversity and range of discourses around those themes.^ Conclusions. Drug effects from each source were complete relative to the information provided in the other, but each also offered distinct advantages. Expert health sites provided concise summaries of medications’ effects, while consumer reviews had the added advantage of concrete descriptions and greater context. In short, consumer reviews better prepared potential consumers for what it’s like to take psychotropic drugs. Both sources of information benefit clinicians and consumers in making informed treatment-related decisions. Social work practitioners are encouraged to thoughtfully utilize online consumer drug reviews as a legitimate additional source for assisting clients in learning about treatment options.^

Pedagogical Perceptions of Classroom Performance in the Teacher Evaluative Process: A Mixed Methods Study

This sequential explanatory, mixed methods research design examines the role teachers should enact in the development process of the teacher evaluation system in Louisiana. These insights will ensure teachers are catalysts in the classroom to significantly increase student achievement and allow policymakers, practitioners, and instructional leaders to direct as learned decision makers.

Vocabulary learning through use of the picture-word inductive model for young English learners in China: A mixed methods examination using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world's largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users' needs (i.e., communicative competence and skills in speaking and writing). ^ This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. ^ I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. ^ As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers' resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.^

Vocabulary Learning through Use of the Picture-Word Inductive Model for Young English Learners in China: A Mixed Methods Examination Using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world’s largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users’ needs (i.e., communicative competence and skills in speaking and writing). This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers’ resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.

Agent-based simulation as a component of mixed methods in entrepreneurship research

As a new research method supplementing the existing qualitative and quantitative approaches, agent-based modelling and simulation (ABMS) may fit well within the entrepreneurship field because the core concepts and basic premises of entrepreneurship coincide with the characteristics of ABMS (McKelvey, 2004; Yang & Chandra, 2013). Agent-based simulation is a simulation method based on agent-based models. The agentbased models are composed of heterogeneous agents and their behavioural rules. By repeatedly carrying out agent-based simulations on a computer, the simulations reproduce each agent’s behaviour, their interactive process, and the emerging macroscopic phenomenon according to the flow of time. Using agent-based simulations, researchers may investigate temporal or dynamic effects of each agent’s behaviours.