The use of mixed methods research in the behavioral sciences field

Mixed methods research involves the combined use of quantitative and qualitative methods in the same research study, and it is becoming increasingly important in several scientific areas. The aim of this paper is to review and compare through a mixed methods multiple-case study the application of this methodology in three reputable behavioural science journals: the Journal of Organizational Behavior, Addictive Behaviors and Psicothema. A quantitative analysis was carried out to review all the papers published in these journals during the period 2003-2008 and classify them into two blocks: theoretical and empirical, with the latter being further subdivided into three subtypes (quantitative, qualitative and mixed). A qualitative analysis determined the main characteristics of the mixed methods studies identified, in order to describe in more detail the ways in which the two methods are combined based on their purpose, priority, implementation and research design. From the journals selected, a total of 1.958 articles were analysed, the majority of which corresponded to empirical studies, with only a small number referring to research that used mixed methods. Nonetheless, mixed methods research does appear in all the behavioural science journals studied within the period selected, showing a range of designs, where the sequential equal weight mixed methods research design seems to stand out.

The use of mixed methods research in interdisciplinary educational journals

Mixed methods research is becoming increasingly important in several scientific areas. The analysis of prevalence rates is a new line of research that has emerged in mixed methods research, and this methodological approach has only been applied carefully in a handful of journals. The purpose of this article was to analyse the prevalence of mixed methods research in interdisciplinary educational journals. Moreover, the main characteristics of the mixed methods articles identified were examined. This study used a mixed methods approach to analyse these aspects. Specifically, a partially mixed sequential equal status multiple-case study design was applied with a development mixed methods purpose. Three educational journals in different disciplines were reviewed from 2005 to 2010 (Academy of Management Learning and Education, Educational Psychology Review, Journal of the Learning Sciences). The findings show differences among the journals in the prevalence rates and characteristics of the mixed methods studies

Mixed methods research:don't "just do it"

Purpose The purpose of this paper is to identify some of the dilemmas involved in the debate on the how, when and why of mixed methods research. Design/methodology/approach The authors' starting point is formed by developments in the philosophy of science literature, and recent publications on mixed methods research outside of the management accounting domain. Findings Contrary to recent claims made in the management accounting literature, the authors assert that uncovering points of disagreement between methods may be as far as researchers can go by combining them. Being reflexive can help to provide a deeper understanding of the research process and the researcher's role in this process. Research limitations/implications The paper should extend the debate among management accounting researchers about mixed methods research. One of the lessons drawn is that researchers are actively immersed in the research process and cannot purge their own interests and views. Accepting this lesson casts doubt on what the act of research may imply and achieve. Practical implications The paper shows that combinations of research methods should not be made based on a "whatever works" attitude, since this approach ultimately is still infused with ontological and epistemological considerations that researchers have, and should try to explicate. Originality/value The value of this paper lies in the provision of philosophical underpinnings that have not been widely considered in the management accounting literature on mixed methods to date. © 2011 Emerald Group Publishing Limited. All rights reserved.

Broadening the evidence base and the mind when thinking about mixed methods research

On behalf of my coauthors, Dr Michael Larkin and Professor Paul Flowers, and I would like to thank Dr Pierre Pluye for his letter in response to our article.1 Dr Pluye supported our argument that a broader evidence base is needed in evidence-based healthcare. He provided the readers of this journal with important additional information which updates them on the progress in the area of mixed studies reviews and further detail about the Mixed Methods Appraisal Tool (MMAT).2 Since writing our …

“Mind the gap”: Qualitative Researchers and Mixed Methods Research

This paper presents a heuristic investigation of mixed methods organized around three pairs of opposing standpoints: methods (qualitative vs. quantitative), paradigms (constructivist vs. post positive), and inquiry approaches (dialectical vs. pragmatic).

The effects of quality and environmental management on competitive advantage: A mixed methods study in the hotel industry

This paper reports results derived from a mixed methods study where 13 hotel managers were initially interviewed, followed by a quantitative study of 355 additional managers. Data were analysed using partial least squares path modelling. The research question related to the relationship between quality and environmental management and the competitive advantage sought by hotels. The results indicate that quality management and environmental management permit the improvement of competitive advantage in terms of both costs and differentiation. Moreover, hotels implementing quality programmes find fewer obstacles in implementing environmental management.

Navigating health sources on the Internet: A mixed-methods examination of online consumer reviews and expert text on psychotropic drugs

Purpose. The Internet has provided an unprecedented opportunity for psychotropic medication consumers, a traditionally silenced group in clinical trial research, to have voice by contributing to the construction of drug knowledge in an immediate, direct manner. Currently, there are no systematic appraisals of the potential of online consumer drug reviews to contribute to drug knowledge. The purpose of this research was to explore the content of drug information on various websites representing themselves as consumer- and expert-constructed, and as a practical consideration, to examine how each source may help and hinder treatment decision-making.^ Methodology. A mixed-methods research strategy utilizing a grounded theory approach was used to analyze drug information on 5 exemplar websites (3 consumer- and 2 expertconstructed) for 2 popularly prescribed psychotropic drugs (escitalopram and quetiapine). A stratified simple random sample was used to select 1,080 consumer reviews from the websites (N=7,114) through February 2009. Text was coded using QDA Miner 3.2 software by Provalis Research. A combination of frequency tables, descriptive excerpts from text, and chi-square tests for association were used throughout analyses.^ Findings. The most frequently mentioned effects by consumers taking either drug were related to psychological/behavioral symptoms and sleep. Consumers reported many of the same effects as found on expert health sites, but provided more descriptive language and situational examples. Expert labels of less serious on certain effects were not congruent with the sometimes tremendous burden described by consumers. Consumers mentioned more than double the themes mentioned in expert text, and demonstrated a diversity and range of discourses around those themes.^ Conclusions. Drug effects from each source were complete relative to the information provided in the other, but each also offered distinct advantages. Expert health sites provided concise summaries of medications’ effects, while consumer reviews had the added advantage of concrete descriptions and greater context. In short, consumer reviews better prepared potential consumers for what it’s like to take psychotropic drugs. Both sources of information benefit clinicians and consumers in making informed treatment-related decisions. Social work practitioners are encouraged to thoughtfully utilize online consumer drug reviews as a legitimate additional source for assisting clients in learning about treatment options.^

Pedagogical Perceptions of Classroom Performance in the Teacher Evaluative Process: A Mixed Methods Study

This sequential explanatory, mixed methods research design examines the role teachers should enact in the development process of the teacher evaluation system in Louisiana. These insights will ensure teachers are catalysts in the classroom to significantly increase student achievement and allow policymakers, practitioners, and instructional leaders to direct as learned decision makers.

Vocabulary learning through use of the picture-word inductive model for young English learners in China: A mixed methods examination using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world's largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users' needs (i.e., communicative competence and skills in speaking and writing). ^ This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. ^ I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. ^ As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers' resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.^

Vocabulary Learning through Use of the Picture-Word Inductive Model for Young English Learners in China: A Mixed Methods Examination Using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world’s largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users’ needs (i.e., communicative competence and skills in speaking and writing). This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers’ resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.

Using multilevel modeling and mixed methods to make theoretical progress in microfoundations for strategy research

The microfoundations research agenda presents an expanded theoretical perspective because it considers individuals, their characteristics, and their interactions as relevant variables to help us understand firm-level strategic issues. However, microfoundations empirical research faces unique challenges because processes take place at different levels of analysis and these multilevel processes must be considered simultaneously. We describe multilevel modeling and mixed methods as methodological approaches whose use will allow for theoretical advancements. We describe key issues regarding the use of these two types of methods and, more importantly, discuss pressing substantive questions and topics that can be addressed with each of these methodological approaches with the goal of making theoretical advancements regarding the microfoundations research agenda and strategic management studies in general.