“Mind the gap”: Qualitative Researchers and Mixed Methods Research

This paper presents a heuristic investigation of mixed methods organized around three pairs of opposing standpoints: methods (qualitative vs. quantitative), paradigms (constructivist vs. post positive), and inquiry approaches (dialectical vs. pragmatic).

Navigating health sources on the Internet: A mixed-methods examination of online consumer reviews and expert text on psychotropic drugs

Purpose. The Internet has provided an unprecedented opportunity for psychotropic medication consumers, a traditionally silenced group in clinical trial research, to have voice by contributing to the construction of drug knowledge in an immediate, direct manner. Currently, there are no systematic appraisals of the potential of online consumer drug reviews to contribute to drug knowledge. The purpose of this research was to explore the content of drug information on various websites representing themselves as consumer- and expert-constructed, and as a practical consideration, to examine how each source may help and hinder treatment decision-making.^ Methodology. A mixed-methods research strategy utilizing a grounded theory approach was used to analyze drug information on 5 exemplar websites (3 consumer- and 2 expertconstructed) for 2 popularly prescribed psychotropic drugs (escitalopram and quetiapine). A stratified simple random sample was used to select 1,080 consumer reviews from the websites (N=7,114) through February 2009. Text was coded using QDA Miner 3.2 software by Provalis Research. A combination of frequency tables, descriptive excerpts from text, and chi-square tests for association were used throughout analyses.^ Findings. The most frequently mentioned effects by consumers taking either drug were related to psychological/behavioral symptoms and sleep. Consumers reported many of the same effects as found on expert health sites, but provided more descriptive language and situational examples. Expert labels of less serious on certain effects were not congruent with the sometimes tremendous burden described by consumers. Consumers mentioned more than double the themes mentioned in expert text, and demonstrated a diversity and range of discourses around those themes.^ Conclusions. Drug effects from each source were complete relative to the information provided in the other, but each also offered distinct advantages. Expert health sites provided concise summaries of medications’ effects, while consumer reviews had the added advantage of concrete descriptions and greater context. In short, consumer reviews better prepared potential consumers for what it’s like to take psychotropic drugs. Both sources of information benefit clinicians and consumers in making informed treatment-related decisions. Social work practitioners are encouraged to thoughtfully utilize online consumer drug reviews as a legitimate additional source for assisting clients in learning about treatment options.^

Pedagogical Perceptions of Classroom Performance in the Teacher Evaluative Process: A Mixed Methods Study

This sequential explanatory, mixed methods research design examines the role teachers should enact in the development process of the teacher evaluation system in Louisiana. These insights will ensure teachers are catalysts in the classroom to significantly increase student achievement and allow policymakers, practitioners, and instructional leaders to direct as learned decision makers.

Vocabulary learning through use of the picture-word inductive model for young English learners in China: A mixed methods examination using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world's largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users' needs (i.e., communicative competence and skills in speaking and writing). ^ This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. ^ I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. ^ As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers' resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.^

Vocabulary Learning through Use of the Picture-Word Inductive Model for Young English Learners in China: A Mixed Methods Examination Using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world’s largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users’ needs (i.e., communicative competence and skills in speaking and writing). This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers’ resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.

Community Development Districts: The entrepreneurial side of government

In an effort to reduce the cost and size of government public service delivery has become more decentralized, flexible and responsive. Public entrepreneurship entailed, among other things, the establishment of special-purpose governments to finance public services and carry out development projects. Community Development Districts (CDDs) are a type of special-purpose governments whose purpose is to manage and finance infrastructure improvements in the State of Florida. They have important implications for the way both growth management and service delivery occur in the United States. This study examined the role of CDDs for growth management policy and service delivery by analyzing the CDD profile and activity, the contribution of CDDs to the growth management and infrastructure development as well as the way CDD perceived pluses and minuses impact service delivery. The study used a mixed methods research approach, drawing on secondary data pertaining to CDD features and activity, semi-structured interviews with CDD representatives and public officials as well as on a survey of public officials within the counties and cities that have established CDDs. Findings indicated that the CDD institutional model is both a policy and a service delivery tool for infrastructure provision that can be adopted by states across the United States. Results showed that CDDs inhibit rather than foster growth management through their location choices, type and pattern of development. CDDs contributed to the infrastructure development in Florida by providing basic infrastructure services for the development they supported and by building and dedicating facilities to general-purpose governments. Districts were found to be both funding mechanisms and management tools for infrastructure services. The study also pointed to the fact that specialized governance is more responsive and more flexible but less effective than general-purpose governance when delivering services. CDDs were perceived as being favorable for developers and residents and not as favorable for general-purpose governments. Overall results indicated that the CDD is a flexible institutional mechanism for infrastructure delivery which has both advantages and disadvantages. Decision-makers should balance districts’ institutional flexibility with their unintended consequences for growth management when considering urban public policies.

Factors that differentiate persistence beyond the first session at a for-profit university

An increasing number of students are selecting for-profit universities to pursue their education (Snyder, Tan & Hoffman, 2006). Despite this trend, little empirical research attention has focused on these institutions, and the literature that exists has been classified as rudimentary in nature (Tierney & Hentschke, 2007). The purpose of this study was to investigate the factors that differentiated students who persisted beyond the first session at a for-profit university. A mixed methods research design consisting of three strands was utilized. Utilizing the College Student Inventory, student’s self-reported perceptions of what their college experience would be like was collected during strand 1. The second strand of the study utilized a survey design focusing on the beliefs that guided participants’ decisions to attend college. Discriminant analysis was utilized to determine what factors differentiated students who persisted from those who did not. A purposeful sample and semi-structured interview guide was used during the third strand. Data from this strand were analyzed thematically. Students’ self-reported dropout proneness, predicted academic difficulty, attitudes toward educators, sense of financial security, verbal confidence, gender and number of hours worked while enrolled in school differentiated students who persisted in their studies from those who dropped out. Several themes emerged from the interview data collected. Participants noted that financial concerns, how they would balance the demands of college with the demands of their lives, and a lack of knowledge about how colleges operate were barriers to persistence faced by students. College staff and faculty support were reported to be the most significant supports reported by those interviewed. Implications for future research studies and practice are included in this study.

Analysis of Housing Partnerships using the Balanced Scorecard framework

Housing Partnerships (HPs) are collaborative arrangements that assist communities in the delivery of affordable housing by combining the strengths of the public and private sectors. They emerged in several states, counties, and cities in the eighties as innovative solutions to the challenges in affordable housing resulting from changing dynamics of delivery and production. ^ My study examines HPs with particular emphasis upon the identification of those factors associated with the successful performance of their mission of affordable housing. I will use the Balanced Scorecard (BSC) framework in this study. The identification of performance factors facilitates a better understanding of how HPs can be successful in achieving their mission. The identification of performance factors is significant in the context of the current economic environment because HPs can be viewed as innovative institutional mechanisms in the provision of affordable housing. ^ The present study uses a mixed methods research approach, drawing on data from the IRS Form 990 tax returns, a survey of the chief executives of HPs, and other secondary sources. The data analysis is framed according to the four perspectives of BSC: the financial, customer, internal business, and learning and growth. Financially, revenue diversification affects the financial health of HPs and overall performance. Although HPs depend on private and government funding, they also depend on service fees to carry out their mission. From a customer perspective, the HPs mainly serve low and moderate income households, although some serve specific groups such as seniors, homeless, veterans, and victims of domestic violence. From an internal business perspective, HPs’ programs are oriented toward affordable housing needs, undertaking not only traditional activities such as construction, loan provision, etc., but also advocacy and educational programs. From an employee and learning growth perspective, the HPs are small in staff size, but undertake a range of activities with the help of volunteers. Every part of the HP is developed to maximize resources, knowledge, and skills in order to assist communities in the delivery of affordable housing and related needs. Overall, housing partnerships have played a key role in affordable housing despite the housing market downturn since 2006. Their expenses on affordable housing activities increased despite the decrease in their revenues.^

Examining argumentative coherence in essays by undergraduate students of English as a foreign language in Mainland China and their English speaking peers in the United States

I conducted this study to provide insights toward deepening understanding of association between culture and writing by building, assessing, and refining a conceptual model of second language writing. To do this, I examined culture and coherence as well as the relationship between them through a mixed methods research design. Coherence has been an important and complex concept in ESL/EFL writing. I intended to study the concept of coherence in the research context of contrastive rhetoric, comparing the coherence quality in argumentative essays written by undergraduates in Mainland China and their U.S. peers. In order to analyze the complex concept of coherence, I synthesized five linguistic theories of coherence: Halliday and Hasan's cohesion theory, Carroll's theory of coherence, Enkvist's theory of coherence, Topical Structure Analysis, and Toulmin's Model. Based upon the synthesis, 16 variables were generated. Across these 16 variables, Hotelling t-test statistical analysis was conducted to predict differences in argumentative coherence between essays written by two groups of participants. In order to complement the statistical analysis, I conducted 30 interviews of the writers in the studies. Participants' responses were analyzed with open and axial coding. By analyzing the empirical data, I refined the conceptual model by adding more categories and establishing associations among them. The study found that U.S. students made use of more pronominal reference. Chinese students adopted more lexical devices of reiteration and extended paralleling progression. The interview data implied that the difference may be associated with the difference in linguistic features and rhetorical conventions in Chinese and English. As far as Toulmin's Model is concerned, Chinese students scored higher on data than their U.S. peers. According to the interview data, this may be due to the fact that Toulmin's Model, modified as three elements of arguments, have been widely and long taught in Chinese writing instruction while U.S. interview participants said that they were not taught to write essays according to Toulmin's Model. Implications were generated from the process of textual data analysis and the formulation of structural model defining coherence. These implications were aimed at informing writing instruction, assessment, peer-review, and self-revision.

Microteaching Lesson Study: Mentor interaction structure and its relation to elementary preservice mathematics teacher knowledge development

This study investigated Microteaching Lesson Study (MLS) and three possible MLS mentor interaction structures during the debriefing sessions in relation to elementary preservice teacher development of knowledge for teaching. One hundred three elementary preservice teachers enrolled in five different sections of a mathematics methods course at a southern urban university were part of the study. This included 72 participants who completed MLS across three different mentor interaction structures as part of their course requirements and 31 elementary preservice teachers who did not complete MLS as part of their methods course and served as a comparison group for a portion of the study. A sequential mixed-methods research design was used to analyze the relationship between MLS mentor interaction structure and growth in preservice teachers' mathematics teacher knowledge. Data sources included pre and post assessments, group developed lesson plans and final reports, a feedback survey with Likert-type and open-ended questions, and transcripts of audio-recorded debriefing sessions. The pre and post assessments were analyzed using Analysis of Variance (ANOVA) and descriptive statistics were used to analyze the Likert-type feedback survey questions. Group MLS lesson plans, final reports, and transcripts of debriefing sessions along with the open-ended questions from the feedback survey were coded in a three-step process as described by Miles and Huberman (1994). In alignment with findings from M. Fernandez (2005, 2010), elementary preservice teachers participating in MLS grew in content knowledge related to MLS topics taught by one another. Results from the analysis of pre and post content knowledge assessments revealed that participants grew in their understanding of the mathematics topics taught during MLS irrespective of their mentor interaction structure and when compared to the participants who did not complete MLS in their methods course. Findings from the analysis of lesson plans for growth in pedagogical content knowledge revealed the most growth in this area occurred for participants assigned to the interaction structure in which the MLS mentor participated in the first two debriefing sessions. Analysis of the transcripts of the discourse during the debriefing sessions and the feedback surveys support the finding that the elementary preservice teachers assigned to the interaction structure in which the MLS mentor participated in the first and second debriefing sessions benefited more from the MLS experience when compared to elementary preservice teachers assigned to the other two interaction structures (MLS mentor participated in only the first debriefing session and MLS mentor participated in only the last debriefing session).

Sustainable rural development through alternative economic networks: Redefining relations in the commodity chain for export vegetables in western Guatemala

The current research considers the capacity of a local organic food system for producer and consumer empowerment and sustainable development outcomes in western Guatemala. Many have argued that the forging of local agricultural networks linking farmers, consumers, and supporting institutions is an effective tool for challenging the negative economic, environmental, and sociopolitical impacts associated with industrial models of global food production. But does this work in the context of agrarian development in the developing world? Despite the fact that there is extensive literature concerning local food system formation in the global north, there remains a paucity of research covering how the principles of local food systems are being integrated into agricultural development projects in developing countries. My work critically examines claims to agricultural sustainability and actor empowerment in a local organic food system built around non-traditional agricultural crops in western Guatemala. Employing a mixed methods research design involving twenty months of participant observation, in-depth interviewing, surveying, and a self-administered questionnaire, the project evaluates the sustainability of this NGO-led development initiative and local food movement along several dimensions. Focusing on the unique economic and social networks of actors and institutions at each stage of the commodity chain, this research shows how the growth of an alternative food system continues to be shaped by context specific processes, politics, and structures of conventional food systems. Further, it shows how the specifics of context also produce new relationships of cooperation and power in the development process. Results indicate that structures surrounding agrarian development in the Guatemalan context give rise to a hybrid form of development that at the same time contests and reinforces conventional models of food production and consumption. Therefore, participation entails a host of compromises and tradeoffs that result in mixed successes and setbacks, as actors attempt to refashion conventional commodity chains through local food system formation.^

No Child Left Behind, Stereotype Threat, and the Standardized Testing of African American Third-Graders

Stereotype threat theory proposes that the possibility of being judged in terms of a negative stereotype in a particular domain negatively affects one’s performance. The proposed mixed-methods research will investigate the influences of stereotype threat on African American third-graders in a post-No Child Left Behind environment.

The role of *language in early childhood mathematics

Math literacy is imperative to succeed in society. Experience is key for acquiring math literacy. A preschooler's world is full of mathematical experiences. Children are continually counting, sorting and comparing as they play. As children are engaged in these activities they are using language as a tool to express their mathematical thinking. If teachers are aware of these teachable moments and help children bridge their daily experiences to mathematical concepts, math literacy may be enhanced. This study described the interactions between teachers and preschoolers, determining the extent to which teachers scaffold children's everyday language into expressions of mathematical concepts. Of primary concern were the teachers' responsive interactions to children's expressions of an implicit mathematical utterance made while engaged in block play. The parallel mixed methods research design consisted of two strands. Strand 1 of the study focused on preschoolers' use of everyday language and the teachers' responses after a child made a mathematical utterance. Twelve teachers and 60 students were observed and videotaped while engaged in block play. Each teacher worked with five children for 20 minutes, yielding 240 minutes of observation. Interaction analysis was used to deductively analyze the recorded observations and field notes. Using a priori codes for the five mathematical concepts, it was found children produced 2,831 mathematical utterances. Teachers ignored 60% of these utterances and responded to, but did not mediate 30% of them. Only 10% of the mathematical utterances were mediated to a mathematical concept. Strand 2 focused on the teacher's view of the role of language in early childhood mathematics. The 12 teachers who had been observed as part of the first strand of the study were interviewed. Based on a thematic analysis of these interviews three themes emerged: (a) the importance of a child's environment, (b) the importance of an education in society, and (c) the role of math in early childhood. Finally, based on a meta-inference of both strands, three themes emerged: (a) teacher conception of math, (b) teacher practice, and (c) teacher sensitivity. Implications based on the findings involve policy, curriculum, and professional development.

Predicting the in-term persistence of community college English-as-a-second-language students

The English-as-a-second-language (ESL) community college student population has increased notably in the past decade, but a decreasing number of these students are completing courses, programs, or degrees (Erisman & Looney, 2008). These students come to college with unique background experiences, and once in college, deal with challenging linguistic, academic, and social integration issues. Though they are not linguistically homogenous, and they do not have a common purpose, ESL students share the common goal of attending community college to learn to speak English (Szelényi & Chang, 2002). Course completion is a primary measure of progress toward that goal, and is therefore an issue of concern for both ESL students and community colleges, which continue to be the access point for language-minority students progressing into higher education (Laden, 2004).^ The purpose of this study was to investigate the factors that predict in-term persistence of community college ESL students. A mixed methods research design consisting of two phases was utilized, and participants in this study were ESL students enrolled in a large community college in south Florida. Phase 1 students completed the Community College ESL Student Questionnaire (CCSEQ), which collected demographic data and data on entry characteristics, academic integration, and social integration. Discriminant and descriptive analyses were used to report the data collected in Phase I. Phase 2 students were a matching cohort of completing and non-completing students who participated in semi-structured interviews at the end of the term. Data collected in the interviews were analyzed thematically, using a constant comparative method as described by Glaser and Strauss (1967).^ Students’ self reported demographic data, background characteristics, goal commitment, and integration factors on the CCSEQ showed no significance between the students who completed the term and the students who did not complete the term. However, several differentiating themes emerged from the interview data, which indicated differences in goal commitment and integration between the two groups. The focus of non-completers on getting good grades rather than completing the course, and the commitment of completers to the goal of finishing the class in order to go forward, both raise questions for future research studies.^

GRE as a predictor of graduate student success at a Hispanic serving institution of higher education

Accurately predicting the success of graduate students is an important aspect of determining which students should be admitted into graduate programs. The GRE is a pivotal factor to examine since it is one of the most widely used criteria for graduate school admission. Even though the GRE is advertised as an accurate tool for predicting first year graduate GPA, there is a lack of research on long term success factors such as time to degree and graduate rate (Luthy, 1996; Powers, 2004). Furthermore, since most studies have low minority sample sizes, the validity of the GRE may not be the same across all groups (ETS, 2008b; Kuncel, Hezlett, & Ones, 2001). Another gap in GRE studies is that few researchers analyze student characteristics, which may alter or moderate the prediction validity of the GRE. Thus, student characteristics such as degree of academic involvement, mentorship interactions, and other academic and social experiences have not been widely examined in this context. These gaps in the analysis of GRE validity are especially relevant given the high attrition rates within of some graduate programs (e.g., an estimated 68% of doctoral student never complete their programs in urban universities; Lovitts, 2001). A sequential mixed methods design was used to answer the research questions in two phases. The quantitative phase used student data files to analyze the relationship of two success variables (graduation rate and graduate GPA) to the GRE scores as well as other academic and demographic graduate student characteristics. The qualitative phase served to complement the first phase by describing a wider range of characteristics from the 11 graduate students who were interviewed. Both proximal and distal moderators influence student behaviors and success in graduate school. In the first phase of the study, the GRE was the distal facilitator under analysis. Findings suggested that both the GRE Quantitative and the GRE Verbal were predictors of success for master’s students, but the GRE Quantitative was not predictive of success for doctoral students. Other student characteristics such as demographic variables and disciplinary area were also predictors of success for the population of students studied. In the second phase of the study, it was inconclusive whether the GRE was predictive of graduate student success; though it did influence access to graduate programs. Furthermore, proximal moderators such as student involvement, faculty/peer interactions, motivational factors, and program structure were perceived to be facilitators and/or detractors for success.