The use of mixed methods research in the behavioral sciences field

Mixed methods research involves the combined use of quantitative and qualitative methods in the same research study, and it is becoming increasingly important in several scientific areas. The aim of this paper is to review and compare through a mixed methods multiple-case study the application of this methodology in three reputable behavioural science journals: the Journal of Organizational Behavior, Addictive Behaviors and Psicothema. A quantitative analysis was carried out to review all the papers published in these journals during the period 2003-2008 and classify them into two blocks: theoretical and empirical, with the latter being further subdivided into three subtypes (quantitative, qualitative and mixed). A qualitative analysis determined the main characteristics of the mixed methods studies identified, in order to describe in more detail the ways in which the two methods are combined based on their purpose, priority, implementation and research design. From the journals selected, a total of 1.958 articles were analysed, the majority of which corresponded to empirical studies, with only a small number referring to research that used mixed methods. Nonetheless, mixed methods research does appear in all the behavioural science journals studied within the period selected, showing a range of designs, where the sequential equal weight mixed methods research design seems to stand out.

The use of mixed methods research in interdisciplinary educational journals

Mixed methods research is becoming increasingly important in several scientific areas. The analysis of prevalence rates is a new line of research that has emerged in mixed methods research, and this methodological approach has only been applied carefully in a handful of journals. The purpose of this article was to analyse the prevalence of mixed methods research in interdisciplinary educational journals. Moreover, the main characteristics of the mixed methods articles identified were examined. This study used a mixed methods approach to analyse these aspects. Specifically, a partially mixed sequential equal status multiple-case study design was applied with a development mixed methods purpose. Three educational journals in different disciplines were reviewed from 2005 to 2010 (Academy of Management Learning and Education, Educational Psychology Review, Journal of the Learning Sciences). The findings show differences among the journals in the prevalence rates and characteristics of the mixed methods studies

Mother-Child Spiritual Discourse: A Mixed Methods Study

Parents and children, starting at very young ages, discuss religious and spiritual issues¿where we come from, what happens to us after we die, is there a God, and so on. Unfortunately, few studies have analyzed the content and structure of parent-child conversation about religion and spirituality (Boyatzis & Janicki, 2003; Dollahite & Thatcher, 2009), and most studies have relied on self-report with no direct observation. The current study examined mother-child (M-C) spiritual discourse to learn about its content, structure, and frequency through a survey inventory in combination with direct video observation using a novel structured task. We also analyzed how mothers¿ religiosity along several major dimensions related to their communication behaviors within both methods. Mothers (N = 39, M age = 40) of children aged 3-12 completed a survey packet on M-C spiritual discourse and standard measures of mothers¿ religious fundamentalism, intrinsic religiosity, sanctification of parenting (how much the mother saw herself as doing God¿s work as a parent), and a new measure of parental openness to children¿s spirituality. Then, in a structured task in our lab, mothers (N = 33) and children (M age = 7.33) watched a short film or read a short book that explored death in an age-appropriate manner and then engaged in a videotaped conversation about the movie or book and their religious or spiritual beliefs. Frequency of M-C spiritual discourse was positively related to mothers¿ religious fundamentalism (r = .71, p = .00), intrinsic religiosity (r = .77, p = .00), and sanctification of parenting (r = .79, p = .00), but, surprisingly, was inversely related to mothers¿ v openness to child¿s spirituality (r = -.52, p = .00). Survey data showed that the two most common topics discussed were God (once a week) and religion as it relates to moral issues (once a week). According to mothers their children¿s most common method of initiating spiritual discourse was to repeat what he or she has heard parents or family say about religious issues (M = 2.97; once a week); mothers¿ most common method was to describe their own religious/spiritual beliefs (M = 2.92). Spiritual discourse most commonly occurred either at bedtime or mealtime as reported by 26% of mothers, with the most common triggers reported as daily routine/random thoughts (once a week) and observations of nature (once a week). Mothers¿ most important goals for spiritual discourse were to let their children know that they love them (M = 3.72; very important) and to help them become a good and moral person (M = 3.67; very important). A regression model showed that significant variance in frequency of mother-child spiritual discourse (R2 = .84, p = .00) was predicted by the mothers¿ importance of goals during discourse (ß = 0.46, p = .00), frequency that the mother¿s spirituality was deepened through spiritual discourse (ß = 0.39, p = .00), and the mother¿s fundamentalism (ß = 0.20, p = .05). In a separate regression, the mother¿s comfort in the structured task (ß = 0.70, p = .00), and the number of open-ended questions she asked (ß = -0.26, p = .03) predicted the reciprocity between mother and child (R2 = .62, p = .00). In addition, the mother¿s age (ß = 0.22, p = .059) and comfort during the task (ß = 0.73, p = .00) predicted the child¿s engagement within the structured task. Other findings and theoretical and methodological implications will be discussed.

Mixed methods research:don't "just do it"

Purpose The purpose of this paper is to identify some of the dilemmas involved in the debate on the how, when and why of mixed methods research. Design/methodology/approach The authors' starting point is formed by developments in the philosophy of science literature, and recent publications on mixed methods research outside of the management accounting domain. Findings Contrary to recent claims made in the management accounting literature, the authors assert that uncovering points of disagreement between methods may be as far as researchers can go by combining them. Being reflexive can help to provide a deeper understanding of the research process and the researcher's role in this process. Research limitations/implications The paper should extend the debate among management accounting researchers about mixed methods research. One of the lessons drawn is that researchers are actively immersed in the research process and cannot purge their own interests and views. Accepting this lesson casts doubt on what the act of research may imply and achieve. Practical implications The paper shows that combinations of research methods should not be made based on a "whatever works" attitude, since this approach ultimately is still infused with ontological and epistemological considerations that researchers have, and should try to explicate. Originality/value The value of this paper lies in the provision of philosophical underpinnings that have not been widely considered in the management accounting literature on mixed methods to date. © 2011 Emerald Group Publishing Limited. All rights reserved.

Broadening the evidence base and the mind when thinking about mixed methods research

On behalf of my coauthors, Dr Michael Larkin and Professor Paul Flowers, and I would like to thank Dr Pierre Pluye for his letter in response to our article.1 Dr Pluye supported our argument that a broader evidence base is needed in evidence-based healthcare. He provided the readers of this journal with important additional information which updates them on the progress in the area of mixed studies reviews and further detail about the Mixed Methods Appraisal Tool (MMAT).2 Since writing our …

“Mind the gap”: Qualitative Researchers and Mixed Methods Research

This paper presents a heuristic investigation of mixed methods organized around three pairs of opposing standpoints: methods (qualitative vs. quantitative), paradigms (constructivist vs. post positive), and inquiry approaches (dialectical vs. pragmatic).

Navigating health sources on the Internet: A mixed-methods examination of online consumer reviews and expert text on psychotropic drugs

Purpose. The Internet has provided an unprecedented opportunity for psychotropic medication consumers, a traditionally silenced group in clinical trial research, to have voice by contributing to the construction of drug knowledge in an immediate, direct manner. Currently, there are no systematic appraisals of the potential of online consumer drug reviews to contribute to drug knowledge. The purpose of this research was to explore the content of drug information on various websites representing themselves as consumer- and expert-constructed, and as a practical consideration, to examine how each source may help and hinder treatment decision-making.^ Methodology. A mixed-methods research strategy utilizing a grounded theory approach was used to analyze drug information on 5 exemplar websites (3 consumer- and 2 expertconstructed) for 2 popularly prescribed psychotropic drugs (escitalopram and quetiapine). A stratified simple random sample was used to select 1,080 consumer reviews from the websites (N=7,114) through February 2009. Text was coded using QDA Miner 3.2 software by Provalis Research. A combination of frequency tables, descriptive excerpts from text, and chi-square tests for association were used throughout analyses.^ Findings. The most frequently mentioned effects by consumers taking either drug were related to psychological/behavioral symptoms and sleep. Consumers reported many of the same effects as found on expert health sites, but provided more descriptive language and situational examples. Expert labels of less serious on certain effects were not congruent with the sometimes tremendous burden described by consumers. Consumers mentioned more than double the themes mentioned in expert text, and demonstrated a diversity and range of discourses around those themes.^ Conclusions. Drug effects from each source were complete relative to the information provided in the other, but each also offered distinct advantages. Expert health sites provided concise summaries of medications’ effects, while consumer reviews had the added advantage of concrete descriptions and greater context. In short, consumer reviews better prepared potential consumers for what it’s like to take psychotropic drugs. Both sources of information benefit clinicians and consumers in making informed treatment-related decisions. Social work practitioners are encouraged to thoughtfully utilize online consumer drug reviews as a legitimate additional source for assisting clients in learning about treatment options.^

The effects of quality and environmental management on competitive advantage: A mixed methods study in the hotel industry

This paper reports results derived from a mixed methods study where 13 hotel managers were initially interviewed, followed by a quantitative study of 355 additional managers. Data were analysed using partial least squares path modelling. The research question related to the relationship between quality and environmental management and the competitive advantage sought by hotels. The results indicate that quality management and environmental management permit the improvement of competitive advantage in terms of both costs and differentiation. Moreover, hotels implementing quality programmes find fewer obstacles in implementing environmental management.

Pedagogical Perceptions of Classroom Performance in the Teacher Evaluative Process: A Mixed Methods Study

This sequential explanatory, mixed methods research design examines the role teachers should enact in the development process of the teacher evaluation system in Louisiana. These insights will ensure teachers are catalysts in the classroom to significantly increase student achievement and allow policymakers, practitioners, and instructional leaders to direct as learned decision makers.

Vocabulary learning through use of the picture-word inductive model for young English learners in China: A mixed methods examination using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world's largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users' needs (i.e., communicative competence and skills in speaking and writing). ^ This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. ^ I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. ^ As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers' resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.^

Vocabulary Learning through Use of the Picture-Word Inductive Model for Young English Learners in China: A Mixed Methods Examination Using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world’s largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users’ needs (i.e., communicative competence and skills in speaking and writing). This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers’ resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.

Customer References as Marketing Practice in Company Web sites - Content and Discourse Analysis

Työn tarkoituksena oli tutkia sisältö- ja diskurssianalyysin avulla kuinka yritykset viestivät asiakasreferenssejä verkkosivuillaan. Työssä keskityttiin tutkimaan yritysten referenssikuvausten teemoja ja diskursseja, sekä sitä kuinka referenssisuhde rakentuu diskursiivisesti referenssikuvauksissa. Tutkimukseen valittiin kolme suomalaista ICT-alan yritystä: Nokia, TietoEnator ja F-Secure. Aineisto koostuu 140:stä yritysten WWW-sivuilta kerätystä referenssikuvauksesta. Sisältöanalyysin tuloksena havaittiin, että referenssikuvaukset keskittyvät kuvaamaan yksittäisiä tuote- tai projektitoimituksia referenssiasiakkaille kyseisten asiakassuhteiden valossa. Analyysin tuloksena tunnistettiin kolme diskurssia: hyötydiskurssi, sitoutumisen diskurssi sekä teknologisen eksperttiyden diskurssi. Diskurssit paljastavat referenssikuvausten retoriset keinot ja konstruoivat referenssisuhteen ja toimittajan subjektiposition eri näkökulmista. Pääpaino referenssikuvauksissa on toimittajan ratkaisun tuomissa hyödyissä. Diskurssit tuottavat referenssisuhteesta kuvan hyötyjä tuovana ja läheisenä asiakassuhteena, joka tarjoaa väylän ulkopuolisiin kyvykkyyksiin ja teknologioihin. Toimittaja esitetään referenssikuvauksissa diskurssista riippuen hyötyjen tuojana, luotettavana partnerina sekä kokeneena eksperttinä. Referenssiasiakas sen sijaan esitetään vain yhdestä näkökulmasta stereotyyppisesti tärkeänä ja tyytyväisenä asiakkaana.