“Mind the gap”: Qualitative Researchers and Mixed Methods Research

This paper presents a heuristic investigation of mixed methods organized around three pairs of opposing standpoints: methods (qualitative vs. quantitative), paradigms (constructivist vs. post positive), and inquiry approaches (dialectical vs. pragmatic).

Navigating health sources on the Internet: A mixed-methods examination of online consumer reviews and expert text on psychotropic drugs

Purpose. The Internet has provided an unprecedented opportunity for psychotropic medication consumers, a traditionally silenced group in clinical trial research, to have voice by contributing to the construction of drug knowledge in an immediate, direct manner. Currently, there are no systematic appraisals of the potential of online consumer drug reviews to contribute to drug knowledge. The purpose of this research was to explore the content of drug information on various websites representing themselves as consumer- and expert-constructed, and as a practical consideration, to examine how each source may help and hinder treatment decision-making.^ Methodology. A mixed-methods research strategy utilizing a grounded theory approach was used to analyze drug information on 5 exemplar websites (3 consumer- and 2 expertconstructed) for 2 popularly prescribed psychotropic drugs (escitalopram and quetiapine). A stratified simple random sample was used to select 1,080 consumer reviews from the websites (N=7,114) through February 2009. Text was coded using QDA Miner 3.2 software by Provalis Research. A combination of frequency tables, descriptive excerpts from text, and chi-square tests for association were used throughout analyses.^ Findings. The most frequently mentioned effects by consumers taking either drug were related to psychological/behavioral symptoms and sleep. Consumers reported many of the same effects as found on expert health sites, but provided more descriptive language and situational examples. Expert labels of less serious on certain effects were not congruent with the sometimes tremendous burden described by consumers. Consumers mentioned more than double the themes mentioned in expert text, and demonstrated a diversity and range of discourses around those themes.^ Conclusions. Drug effects from each source were complete relative to the information provided in the other, but each also offered distinct advantages. Expert health sites provided concise summaries of medications’ effects, while consumer reviews had the added advantage of concrete descriptions and greater context. In short, consumer reviews better prepared potential consumers for what it’s like to take psychotropic drugs. Both sources of information benefit clinicians and consumers in making informed treatment-related decisions. Social work practitioners are encouraged to thoughtfully utilize online consumer drug reviews as a legitimate additional source for assisting clients in learning about treatment options.^

Pedagogical Perceptions of Classroom Performance in the Teacher Evaluative Process: A Mixed Methods Study

This sequential explanatory, mixed methods research design examines the role teachers should enact in the development process of the teacher evaluation system in Louisiana. These insights will ensure teachers are catalysts in the classroom to significantly increase student achievement and allow policymakers, practitioners, and instructional leaders to direct as learned decision makers.

Vocabulary learning through use of the picture-word inductive model for young English learners in China: A mixed methods examination using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world's largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users' needs (i.e., communicative competence and skills in speaking and writing). ^ This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. ^ I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. ^ As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers' resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.^

Vocabulary Learning through Use of the Picture-Word Inductive Model for Young English Learners in China: A Mixed Methods Examination Using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world’s largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users’ needs (i.e., communicative competence and skills in speaking and writing). This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers’ resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.

A content analysis of selected recreational therapy journals from 1990 to 1998: The extent to which children and youth are included

This paper presents an analysis of articles involving children and youth in the last 9 years (1990–1998) of professional literature in recreational therapy. A total of 539 articles were analyzed to examine the authors, subjects, methods, and outcomes of therapeutic recreation studies published in three selected journals: Therapeutic Recreation Journal, Leisure Studies , and Leisure Sciences. A central finding was that the literature involving children and youth was very under-represented in the journals. Only 6.5% of the articles targeted children and youth; of this group, approximately two thirds were research-based; the remaining articles were conceptual papers. The findings are discussed in terms of the need for future scholarships in recreational therapy to target children and youth, including those with disabilities. ^

Customer relationship management: A content analysis of issues and best practices

This dissertation is a study of customer relationship management theory and practice. Customer Relationship Management (CRM) is a business strategy whereby companies build strong relationships with existing and prospective customers with the goal of increasing organizational profitability. It is also a learning process involving managing change in processes, people, and technology. CRM implementation and its ramifications are also not completely understood as evidenced by the high number of failures in CRM implementation in organizations and the resulting disappointments. ^ The goal of this dissertation is to study emerging issues and trends in CRM, including the effect of computer software and the accompanying new management processes on organizations, and the dynamics of the alignment of marketing, sales and services, and all other functions responsible for delivering customers a satisfying experience. ^ In order to understand CRM better a content analysis of more than a hundred articles and documents from academic and industry sources was undertaken using a new methodological twist to the traditional method. An Internet domain name (http://crm.fiu.edu) was created for the purpose of this research by uploading an initial one hundred plus abstracts of articles and documents onto it to form a knowledge database. Once the database was formed a search engine was developed to enable the search of abstracts using relevant CRM keywords to reveal emergent dominant CRM topics. The ultimate aim of this website is to serve as an information hub for CRM research, as well as a search engine where interested parties can enter CRM-relevant keywords or phrases to access abstracts, as well as submit abstracts to enrich the knowledge hub. ^ Research questions were investigated and answered by content analyzing the interpretation and discussion of dominant CRM topics and then amalgamating the findings. This was supported by comparisons within and across individual, paired, and sets-of-three occurrences of CRM keywords in the article abstracts. ^ Results show that there is a lack of holistic thinking and discussion of CRM in both academics and industry which is required to understand how the people, process, and technology in CRM impact each other to affect successful implementation. Industry has to get their heads around CRM and holistically understand how these important dimensions affect each other. Only then will organizational learning occur, and overtime result in superior processes leading to strong profitable customer relationships and a hard to imitate competitive advantage. ^

Analysis of Housing Partnerships using the Balanced Scorecard framework

Housing Partnerships (HPs) are collaborative arrangements that assist communities in the delivery of affordable housing by combining the strengths of the public and private sectors. They emerged in several states, counties, and cities in the eighties as innovative solutions to the challenges in affordable housing resulting from changing dynamics of delivery and production. ^ My study examines HPs with particular emphasis upon the identification of those factors associated with the successful performance of their mission of affordable housing. I will use the Balanced Scorecard (BSC) framework in this study. The identification of performance factors facilitates a better understanding of how HPs can be successful in achieving their mission. The identification of performance factors is significant in the context of the current economic environment because HPs can be viewed as innovative institutional mechanisms in the provision of affordable housing. ^ The present study uses a mixed methods research approach, drawing on data from the IRS Form 990 tax returns, a survey of the chief executives of HPs, and other secondary sources. The data analysis is framed according to the four perspectives of BSC: the financial, customer, internal business, and learning and growth. Financially, revenue diversification affects the financial health of HPs and overall performance. Although HPs depend on private and government funding, they also depend on service fees to carry out their mission. From a customer perspective, the HPs mainly serve low and moderate income households, although some serve specific groups such as seniors, homeless, veterans, and victims of domestic violence. From an internal business perspective, HPs’ programs are oriented toward affordable housing needs, undertaking not only traditional activities such as construction, loan provision, etc., but also advocacy and educational programs. From an employee and learning growth perspective, the HPs are small in staff size, but undertake a range of activities with the help of volunteers. Every part of the HP is developed to maximize resources, knowledge, and skills in order to assist communities in the delivery of affordable housing and related needs. Overall, housing partnerships have played a key role in affordable housing despite the housing market downturn since 2006. Their expenses on affordable housing activities increased despite the decrease in their revenues.^

Microteaching Lesson Study: Mentor interaction structure and its relation to elementary preservice mathematics teacher knowledge development

This study investigated Microteaching Lesson Study (MLS) and three possible MLS mentor interaction structures during the debriefing sessions in relation to elementary preservice teacher development of knowledge for teaching. One hundred three elementary preservice teachers enrolled in five different sections of a mathematics methods course at a southern urban university were part of the study. This included 72 participants who completed MLS across three different mentor interaction structures as part of their course requirements and 31 elementary preservice teachers who did not complete MLS as part of their methods course and served as a comparison group for a portion of the study. A sequential mixed-methods research design was used to analyze the relationship between MLS mentor interaction structure and growth in preservice teachers' mathematics teacher knowledge. Data sources included pre and post assessments, group developed lesson plans and final reports, a feedback survey with Likert-type and open-ended questions, and transcripts of audio-recorded debriefing sessions. The pre and post assessments were analyzed using Analysis of Variance (ANOVA) and descriptive statistics were used to analyze the Likert-type feedback survey questions. Group MLS lesson plans, final reports, and transcripts of debriefing sessions along with the open-ended questions from the feedback survey were coded in a three-step process as described by Miles and Huberman (1994). In alignment with findings from M. Fernandez (2005, 2010), elementary preservice teachers participating in MLS grew in content knowledge related to MLS topics taught by one another. Results from the analysis of pre and post content knowledge assessments revealed that participants grew in their understanding of the mathematics topics taught during MLS irrespective of their mentor interaction structure and when compared to the participants who did not complete MLS in their methods course. Findings from the analysis of lesson plans for growth in pedagogical content knowledge revealed the most growth in this area occurred for participants assigned to the interaction structure in which the MLS mentor participated in the first two debriefing sessions. Analysis of the transcripts of the discourse during the debriefing sessions and the feedback surveys support the finding that the elementary preservice teachers assigned to the interaction structure in which the MLS mentor participated in the first and second debriefing sessions benefited more from the MLS experience when compared to elementary preservice teachers assigned to the other two interaction structures (MLS mentor participated in only the first debriefing session and MLS mentor participated in only the last debriefing session).

Content Analysis of Outcome Assessment of Global Learning Foundations Courses: A Case Study

This study used content analysis to interpret and evaluate outcome evaluation matrices of undergraduate Global Learning foundations courses. The findings revealed a lack of uniformity in the faculty members’ interpretation and implementation of global learning components in the coursework. Successful teaching practices and challenges were identified and classified.

A Content Analysis of Sustainability Dimensions in Annual Reports

This study examines the triple bottom line of sustainability, in the context of both profit-oriented and non-profit oriented organizations. Sustainability is a compound result of interaction between economic, environmental, and social dimensions. Sustainability cannot be achieved without balance between all three dimensions, which has implications for measuring sustainability and prioritizing goals. This study demonstrates a method for measuring organizational sustainability achievement in these three dimensions of sustainability. Content analysis of the annual reports of corporations from the United States, Continental Europe (and Scandinavia), and Asia reveals that the economic dimension remains the preeminent aspect, and corporations still have a long way to go to reach comprehensive sustainability by maintaining a balance between the three dimensions of sustainability. The analysis also shows a high level of isomorphism in the sustainability practices of corporations, suggesting that even the most sustainable corporations are taking a somewhat passive role in prioritizing sustainability goals. A list of 25 terms for each dimension of sustainability (economic, environmental, and social) has been developed which can be used by corporations to develop and communicate their sustainability practices most effectively to the maximum number of their stakeholders. In contrast, botanical gardens demonstrate more balance among the three dimensions of sustainability.

A meta -analysis of empirical research studies on resilience among students at -risk for school failure

Being at-risk is a growing problem in the U.S. because of disturbing societal trends such as unemployment, divorce, substance abuse, child abuse and neglect, and the new threat of terrorist violence. Resilience characterizes individuals who rebound from or adapt to adversities such as these, and academic resilience distinguishes at-risk students who succeed in school despite hardships. ^ The purpose of this research was to perform a meta-analysis to examine the power of resilience and to suggest ways educators might improve academic resilience, which was operationalized by satisfactory test scores and grades. In order to find all studies that were relevant to academic resilience in at-risk kindergarten through 12th-grade students, extensive electronic and hardcopy searches were conducted, and these resulted in a database of 421 articles. Two hundred eighty seven of these were rejected quickly, because they were not empirical research. Upon further examination, another 106 were rejected for not meeting study protocol criteria. Ultimately, 28 studies were coded for study level descriptors and effect size variables. ^ Protective factors for resilience were found to originate in physical, psychological, and behavioral domains on proximal/intraindividual, transitional/intrafamilial, or distal/extrafamilial levels. Effect sizes (ESs) for these were weighted and the means for each level or category were interpreted by commonly accepted benchmarks. Mean effect sizes for proximal (M = .27) and for transitional (M = .15) were small but significant. The mean effect size for the distal level was insignificant. This supported the hypotheses that the proximal level was the source of most protective factors for academic resilience in at-risk students followed by the transitional level. The distal effect size warranted further research particularly in light of the small number of studies (n = 11) contributing effect sizes to that category. A homogeneity test indicated a search for moderators, i.e., study variables affecting outcomes, was justified. “Category” was the largest moderator. Graphs of weighted mean effect sizes in the physical, psychological, and behavioral domains were plotted for each level to better illustrate the findings of the meta-analysis. Suggestions were made for combining resilience development with aspects of positive psychology to promote resilience in the schools. ^

A content analysis of food and nutrition television advertisements

Television (TV) reaches more people than any other medium which makes it an important source of health information. Since TV ads often offer information obliquely, this study investigated implied health messages found in food and nutrition TV ads. The goals were to determine the proportion of food and nutrition ads among all TV advertising and to use content analysis to identify their implied messages and health claims. A randomly selected sample of TV ads were collected over a 28-day period beginning May 8, 1987. The sample contained 3547 ads; 725 (20%) were food-related. All were analyzed. About 10% of food-related TV ads contained a health claim. Twenty-five representative ads of the 725 food ads were also reviewed by 10 dietitians to test the reliability of the instrument. Although the dietitians agreed upon whether a health claim existed in a televised food ad, their agreement was poor when evaluating the accuracy of the claim. The number of food-related ads dropped significantly on Saturday, but the number of alcohol ads rose sharply on Saturday and Sunday. Snack ads were shown more often on Thursday, but snack commercials were also numerous on Saturday morning and afternoon, as were cereal ads. Ads for snack foods accounted for the greatest proportion of ads (20%) while fast food accounted for only 7%. Alcohol constituted about 9% of all food and nutrition ads.

Factors that differentiate persistence beyond the first session at a for-profit university

An increasing number of students are selecting for-profit universities to pursue their education (Snyder, Tan & Hoffman, 2006). Despite this trend, little empirical research attention has focused on these institutions, and the literature that exists has been classified as rudimentary in nature (Tierney & Hentschke, 2007). The purpose of this study was to investigate the factors that differentiated students who persisted beyond the first session at a for-profit university. A mixed methods research design consisting of three strands was utilized. Utilizing the College Student Inventory, student’s self-reported perceptions of what their college experience would be like was collected during strand 1. The second strand of the study utilized a survey design focusing on the beliefs that guided participants’ decisions to attend college. Discriminant analysis was utilized to determine what factors differentiated students who persisted from those who did not. A purposeful sample and semi-structured interview guide was used during the third strand. Data from this strand were analyzed thematically. Students’ self-reported dropout proneness, predicted academic difficulty, attitudes toward educators, sense of financial security, verbal confidence, gender and number of hours worked while enrolled in school differentiated students who persisted in their studies from those who dropped out. Several themes emerged from the interview data collected. Participants noted that financial concerns, how they would balance the demands of college with the demands of their lives, and a lack of knowledge about how colleges operate were barriers to persistence faced by students. College staff and faculty support were reported to be the most significant supports reported by those interviewed. Implications for future research studies and practice are included in this study.

Examining argumentative coherence in essays by undergraduate students of English as a foreign language in Mainland China and their English speaking peers in the United States

I conducted this study to provide insights toward deepening understanding of association between culture and writing by building, assessing, and refining a conceptual model of second language writing. To do this, I examined culture and coherence as well as the relationship between them through a mixed methods research design. Coherence has been an important and complex concept in ESL/EFL writing. I intended to study the concept of coherence in the research context of contrastive rhetoric, comparing the coherence quality in argumentative essays written by undergraduates in Mainland China and their U.S. peers. In order to analyze the complex concept of coherence, I synthesized five linguistic theories of coherence: Halliday and Hasan's cohesion theory, Carroll's theory of coherence, Enkvist's theory of coherence, Topical Structure Analysis, and Toulmin's Model. Based upon the synthesis, 16 variables were generated. Across these 16 variables, Hotelling t-test statistical analysis was conducted to predict differences in argumentative coherence between essays written by two groups of participants. In order to complement the statistical analysis, I conducted 30 interviews of the writers in the studies. Participants' responses were analyzed with open and axial coding. By analyzing the empirical data, I refined the conceptual model by adding more categories and establishing associations among them. The study found that U.S. students made use of more pronominal reference. Chinese students adopted more lexical devices of reiteration and extended paralleling progression. The interview data implied that the difference may be associated with the difference in linguistic features and rhetorical conventions in Chinese and English. As far as Toulmin's Model is concerned, Chinese students scored higher on data than their U.S. peers. According to the interview data, this may be due to the fact that Toulmin's Model, modified as three elements of arguments, have been widely and long taught in Chinese writing instruction while U.S. interview participants said that they were not taught to write essays according to Toulmin's Model. Implications were generated from the process of textual data analysis and the formulation of structural model defining coherence. These implications were aimed at informing writing instruction, assessment, peer-review, and self-revision.