“Mind the gap”: Qualitative Researchers and Mixed Methods Research

This paper presents a heuristic investigation of mixed methods organized around three pairs of opposing standpoints: methods (qualitative vs. quantitative), paradigms (constructivist vs. post positive), and inquiry approaches (dialectical vs. pragmatic).

Vocabulary learning through use of the picture-word inductive model for young English learners in China: A mixed methods examination using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world's largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users' needs (i.e., communicative competence and skills in speaking and writing). ^ This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. ^ I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. ^ As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers' resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.^

Vocabulary Learning through Use of the Picture-Word Inductive Model for Young English Learners in China: A Mixed Methods Examination Using Cognitive Load Theory

English has been taught as a core and compulsory subject in China for decades. Recently, the demand for English in China has increased dramatically. China now has the world’s largest English-learning population. The traditional English-teaching method cannot continue to be the only approach because it merely focuses on reading, grammar and translation, which cannot meet English learners and users’ needs (i.e., communicative competence and skills in speaking and writing). This study was conducted to investigate if the Picture-Word Inductive Model (PWIM), a new pedagogical method using pictures and inductive thinking, would benefit English learners in China in terms of potential higher output in speaking and writing. With the gauge of Cognitive Load Theory (CLT), specifically, its redundancy effect, I investigated whether processing words and a picture concurrently would present a cognitive overload for English learners in China. I conducted a mixed methods research study. A quasi-experiment (pretest, intervention for seven weeks, and posttest) was conducted using 234 students in four groups in Lianyungang, China (58 fourth graders and 57 seventh graders as an experimental group with PWIM and 59 fourth graders and 60 seventh graders as a control group with the traditional method). No significant difference in the effects of PWIM was found on vocabulary acquisition based on grade levels. Observations, questionnaires with open-ended questions, and interviews were deployed to answer the three remaining research questions. A few students felt cognitively overloaded when they encountered too many writing samples, too many new words at one time, repeated words, mismatches between words and pictures, and so on. Many students listed and exemplified numerous strengths of PWIM, but a few mentioned weaknesses of PWIM. The students expressed the idea that PWIM had a positive effect on their English teaching. As integrated inferences, qualitative findings were used to explain the quantitative results that there were no significant differences of the effects of the PWIM between the experimental and control groups in both grade levels, from four contextual aspects: time constraints on PWIM implementation, teachers’ resistance, how to use PWIM and PWIM implemented in a classroom over 55 students.

Navigating health sources on the Internet: A mixed-methods examination of online consumer reviews and expert text on psychotropic drugs

Purpose. The Internet has provided an unprecedented opportunity for psychotropic medication consumers, a traditionally silenced group in clinical trial research, to have voice by contributing to the construction of drug knowledge in an immediate, direct manner. Currently, there are no systematic appraisals of the potential of online consumer drug reviews to contribute to drug knowledge. The purpose of this research was to explore the content of drug information on various websites representing themselves as consumer- and expert-constructed, and as a practical consideration, to examine how each source may help and hinder treatment decision-making.^ Methodology. A mixed-methods research strategy utilizing a grounded theory approach was used to analyze drug information on 5 exemplar websites (3 consumer- and 2 expertconstructed) for 2 popularly prescribed psychotropic drugs (escitalopram and quetiapine). A stratified simple random sample was used to select 1,080 consumer reviews from the websites (N=7,114) through February 2009. Text was coded using QDA Miner 3.2 software by Provalis Research. A combination of frequency tables, descriptive excerpts from text, and chi-square tests for association were used throughout analyses.^ Findings. The most frequently mentioned effects by consumers taking either drug were related to psychological/behavioral symptoms and sleep. Consumers reported many of the same effects as found on expert health sites, but provided more descriptive language and situational examples. Expert labels of less serious on certain effects were not congruent with the sometimes tremendous burden described by consumers. Consumers mentioned more than double the themes mentioned in expert text, and demonstrated a diversity and range of discourses around those themes.^ Conclusions. Drug effects from each source were complete relative to the information provided in the other, but each also offered distinct advantages. Expert health sites provided concise summaries of medications’ effects, while consumer reviews had the added advantage of concrete descriptions and greater context. In short, consumer reviews better prepared potential consumers for what it’s like to take psychotropic drugs. Both sources of information benefit clinicians and consumers in making informed treatment-related decisions. Social work practitioners are encouraged to thoughtfully utilize online consumer drug reviews as a legitimate additional source for assisting clients in learning about treatment options.^

A gender study investigating physics self-efficacy

The underrepresentation of women in physics has been well documented and a source of concern for both policy makers and educators. My dissertation focuses on understanding the role self-efficacy plays in retaining students, particularly women, in introductory physics. I use an explanatory mixed methods approach to first investigate quantitatively the influence of self-efficacy in predicting success and then to qualitatively explore the development of self-efficacy. In the initial quantitative studies, I explore the utility of self-efficacy in predicting the success of introductory physics students, both women and men. Results indicate that self-efficacy is a significant predictor of success for all students. I then disaggregate the data to examine how self-efficacy develops differently for women and men in the introductory physics course. Results show women rely on different sources of self-efficacy than do men, and that a particular instructional environment, Modeling Instruction, has a positive impact on these sources of self-efficacy. In the qualitative phase of the project, this dissertation focuses on the development of self-efficacy. Using the qualitative tool of microanalysis, I introduce a methodology for understanding how self-efficacy develops moment-by-moment using the lens of self-efficacy opportunities. I then use the characterizations of self-efficacy opportunities to focus on a particular course environment and to identify and describe a mechanism by which Modeling Instruction impacts student self-efficacy. Results indicate that the emphasizing the development and deployment of models affords opportunities to impact self-efficacy. The findings of this dissertation indicate that introducing key elements into the classroom, such as cooperative group work, model development and deployment, and interaction with the instructor, create a mechanism by which instructors can impact the self-efficacy of their students. Results from this study indicate that creating a model to impact the retention rates of women in physics should include attending to self-efficacy and designing activities in the classroom that create self-efficacy opportunities.

Factors influencing the implementation of substance use prevention programs in elementary schools

Prevention scientists have called for more research on the factors affecting the implementation of substance use prevention programs. Given the lack of literature in this area, coupled with evidence that children as early as elementary school engage in substance use, the purpose of this study was to identify the factors that influence the implementation of substance use prevention programs in elementary schools. This study involved a mixed methods approach comprised of a survey and in-person interviews. Sixty-five guidance counselors and teachers completed the survey, and 9 guidance counselors who completed the survey were interviewed individually. Correlation analyses and hierarchical multiple regression were conducted. Quantitative findings revealed ease of implementation most frequently influenced program implementation, followed by beliefs about the program's effectiveness. Qualitative findings showed curriculum modification as an important theme, as well as difficulty of program implementation. The in-person interviews also shed light on three interrelated themes influencing program implementation – The Wheel, time, and scheduling. Results indicate the majority of program providers modified the curriculum in some way. Implications for research, policy, and practice are discussed, and areas for future research are suggested.^

Not getting by: Poverty management and homelessness in Miami

Urban inequality has emerged as one of the dominant themes of modern life and globalization. More than three million people experienced homelessness in the United States last year; in Miami-Dade, more than 15,000 individuals were homeless. Surviving extreme poverty, and exiting or avoiding homelessness, involves negotiating a complex mix of public and private assistance. However, a range of factors influence what types of help are available and how they can be accessed. Frequently, larger social structures determine which resource are available, leaving many choices entirely out of the individual's control. For single men, who are ineligible for many benefits, homelessness can be difficult to avoid and even harder to exit. My study seeks to better understand how adult, minority men living in extreme poverty in Miami-Dade negotiate their daily survival. Specific research questions address: Do black and Hispanic men who are homeless or at risk of homelessness have different personal characteristics and different experiences in avoiding or exiting homelessness? How does Miami's response to extreme poverty/homelessness, including availability of public benefits and public and private service organizations, either maximize or constrain the choices available to this population? And, what is the actual experience of single, adult men who are homeless or at risk of homelessness, in negotiating their daily survival? A mixed methods approach combines quantitative survey data from 7,605 homeless men, with qualitative data from 54 semi-structured interviews incorporating the visual ethnography techniques of Photo Elicitation Interviewing. Results show the differences experienced by black and Hispanic men who are poor and homeless in Miami. Findings also highlight how the community's official and unofficial responses to homelessness intersect with the actual experiences of the persons targeted by the policies and programs, challenging preconceived notions regarding the lives of persons living in extreme poverty. It adds to the existing body of literature by focusing on the urban Miami context, emphasizing disparities amongst racial and ethnic groups. Findings are intended to provide an empirically grounded thesis that humanizes the subjects and illuminates their personal experiences, helping to inform public policy around the needs of extremely poor populations.

Socio-ecological vulnerability to climate change in South Florida

Awareness of extreme high tide flooding in coastal communities has been increasing in recent years, reflecting growing concern over accelerated sea level rise. As a low-lying, urban coastal community with high value real estate, Miami often tops the rankings of cities worldwide in terms of vulnerability to sea level rise. Understanding perceptions of these changes and how communities are dealing with the impacts reveals much about vulnerability to climate change and the challenges of adaptation. ^ This empirical study uses an innovative mixed-methods approach that combines ethnographic observations of high tide flooding, qualitative interviews and analysis of tidal data to reveal coping strategies used by residents and businesses as well as perceptions of sea level rise and climate change, and to assess the relationship between measurable sea levels and perceptions of flooding. I conduct a case study of Miami Beach's storm water master planning process which included sea level rise projections, one of the first in the nation to do so, that reveals the different and sometimes competing logics of planners, public officials, activists, residents and business interests with regards to climate change adaptation. By taking a deeply contextual account of hazards and adaptation efforts in a local area I demonstrate how this approach can be effective at shedding light on some of the challenges posed by anthropogenic climate change and accelerated rates of sea level rise. ^ The findings highlight challenges for infrastructure planning in low-lying, urban coastal areas, and for individual risk assessment in the context of rapidly evolving discourse about the threat of sea level rise. Recognition of the trade-offs and limits of incremental adaptation strategies point to transformative approaches, at the same time highlighting equity concerns in adaptation governance and planning. This new impact assessment method contributes to the integration of social and physical science approaches to climate change, resulting in improved understanding of socio-ecological vulnerability to environmental change.^

Pedagogical Perceptions of Classroom Performance in the Teacher Evaluative Process: A Mixed Methods Study

This sequential explanatory, mixed methods research design examines the role teachers should enact in the development process of the teacher evaluation system in Louisiana. These insights will ensure teachers are catalysts in the classroom to significantly increase student achievement and allow policymakers, practitioners, and instructional leaders to direct as learned decision makers.

Factors Influencing the Implementation of Substance Use Prevention Programs in Elementary Schools

Prevention scientists have called for more research on the factors affecting the implementation of substance use prevention programs. Given the lack of literature in this area, coupled with evidence that children as early as elementary school engage in substance use, the purpose of this study was to identify the factors that influence the implementation of substance use prevention programs in elementary schools. This study involved a mixed methods approach comprised of a survey and in-person interviews. Sixty-five guidance counselors and teachers completed the survey, and 9 guidance counselors who completed the survey were interviewed individually. Correlation analyses and hierarchical multiple regression were conducted. Quantitative findings revealed ease of implementation most frequently influenced program implementation, followed by beliefs about the program’s effectiveness. Qualitative findings showed curriculum modification as an important theme, as well as difficulty of program implementation. The in-person interviews also shed light on three interrelated themes influencing program implementation – The Wheel, time, and scheduling. Results indicate the majority of program providers modified the curriculum in some way. Implications for research, policy, and practice are discussed, and areas for future research are suggested.

Not Getting By: Poverty Management and Homelessness in Miami

Urban inequality has emerged as one of the dominant themes of modern life and globalization. More than three million people experienced homelessness in the United States last year; in Miami-Dade, more than 15,000 individuals were homeless. Surviving extreme poverty, and exiting or avoiding homelessness, involves negotiating a complex mix of public and private assistance. However, a range of factors influence what types of help are available and how they can be accessed. Frequently, larger social structures determine which resource are available, leaving many choices entirely out of the individual’s control. For single men, who are ineligible for many benefits, homelessness can be difficult to avoid and even harder to exit. My study seeks to better understand how adult, minority men living in extreme poverty in Miami-Dade negotiate their daily survival. Specific research questions address: Do black and Hispanic men who are homeless or at risk of homelessness have different personal characteristics and different experiences in avoiding or exiting homelessness? How does Miami’s response to extreme poverty/homelessness, including availability of public benefits and public and private service organizations, either maximize or constrain the choices available to this population? And, what is the actual experience of single, adult men who are homeless or at risk of homelessness, in negotiating their daily survival? A mixed methods approach combines quantitative survey data from 7,605 homeless men, with qualitative data from 54 semi-structured interviews incorporating the visual ethnography techniques of Photo Elicitation Interviewing. Results show the differences experienced by black and Hispanic men who are poor and homeless in Miami. Findings also highlight how the community’s official and unofficial responses to homelessness intersect with the actual experiences of the persons targeted by the policies and programs, challenging preconceived notions regarding the lives of persons living in extreme poverty. It adds to the existing body of literature by focusing on the urban Miami context, emphasizing disparities amongst racial and ethnic groups. Findings are intended to provide an empirically grounded thesis that humanizes the subjects and illuminates their personal experiences, helping to inform public policy around the needs of extremely poor populations.

A Q-Methodology approach to investigating the relationship between level of reflection and typologies among prospective teachers in the physics learning assistant program at Florida International University

The purpose of this mixed methods study was to understand physics Learning Assistants' (LAs) views on reflective teaching, expertise in teaching, and LA program teaching experience and to determine if views predicted level of reflection evident in writing. Interviews were conducted in Phase One, Q methodology was used in Phase Two, and level of reflection in participants' writing was assessed using a rubric based on Hatton and Smith's (1995) "Criteria for the Recognition of Evidence for Different Types of Reflective Writing" in Phase Three. Interview analysis revealed varying perspectives on content knowledge, pedagogical knowledge, and experience in relation to expertise in teaching. Participants revealed that they engaged in reflection on their teaching, believed reflection helps teachers improve, and found peer reflection beneficial. Participants believed teaching experience in the LA program provided preparation for teaching, but that more preparation was needed to teach. Three typologies emerged in Phase Two. Type One LAs found participation in the LA program rewarding and believed expertise in teaching does not require expertise in content or pedagogy, but it develops over time from reflection. Type Two LAs valued reflection, but not writing reflections, felt the LA program teaching experience helped them decide on non-teaching careers and helped them confront gaps in their physics knowledge. Type Three LAs valued reflection, believed expertise in content and pedagogy are necessary for expert teaching, and felt LA program teaching experience increased their likelihood of becoming teachers, but did not prepare them for teaching. Writing assignments submitted in Phase Three were categorized as 19% descriptive writing, 60% descriptive reflections, and 21% dialogic reflections. No assignments were categorized as critical reflection. Using ordinal logistic regression, typologies that emerged in Phase Two were not found to be predictors for the level of reflection evident in the writing assignments. In conclusion, viewpoints of physics LAs were revealed, typologies among them were discovered, and their writing gave evidence of their ability to reflect on teaching. These findings may benefit faculty and staff in the LA program by helping them better understand the views of physics LAs and how to assess their various forms of reflection.

Investigating the Effects of Cognitive Apprenticeship-Based Instructional Coaching on Science Teaching Efficacy Beliefs

The overall purpose of this collected papers dissertation was to examine the utility of a cognitive apprenticeship-based instructional coaching (CAIC) model for improving the science teaching efficacy beliefs (STEB) of preservice and inservice elementary teachers. Many of these teachers perceive science as a difficult subject and feel inadequately prepared to teach it. However, teacher efficacy beliefs have been noted as the strongest indicator of teacher quality, the variable most highly correlated with student achievement outcomes. The literature is scarce on strong, evidence-based theoretical models for improving STEB. This dissertation is comprised of two studies. STUDY #1 was a sequential explanatory mixed-methods study investigating the impact of a reformed CAIC elementary science methods course on the STEB of 26 preservice teachers. Data were collected using the Science Teaching Efficacy Belief Instrument (STEBI-B) and from six post-course interviews. A statistically significant increase in STEB was observed in the quantitative strand. The qualitative data suggested that the preservice teachers perceived all of the CAIC methods as influential, but the significance of each method depended on their unique needs and abilities. STUDY #2 was a participatory action research case study exploring the utility of a CAIC professional development program for improving the STEB of five Bahamian inservice teachers and their competency in implementing an inquiry-based curriculum. Data were collected from pre- and post-interviews and two focus group interviews. Overall, the inservice teachers perceived the intervention as highly effective. The scaffolding and coaching were the CAIC methods portrayed as most influential in developing their STEB, highlighting the importance of interpersonal relationship aspects in successful instructional coaching programs. The teachers also described the CAIC approach as integral in supporting their learning to implement the new inquiry-based curriculum. The overall findings hold important implications for science education reform, including its potential to influence how preservice teacher training and inservice teacher professional development in science are perceived and implemented. Additionally, given the noteworthy results obtained over the relatively short durations, CAIC interventions may also provide an effective means of achieving improvements in preservice and inservice teachers’ STEB more expeditiously than traditional approaches.

Investigating the effects of cognitive apprenticeship-based instructional coaching on science teaching efficacy beliefs

The overall purpose of this collected papers dissertation was to examine the utility of a cognitive apprenticeship-based instructional coaching (CAIC) model for improving the science teaching efficacy beliefs (STEB) of preservice and inservice elementary teachers. Many of these teachers perceive science as a difficult subject and feel inadequately prepared to teach it. However, teacher efficacy beliefs have been noted as the strongest indicator of teacher quality, the variable most highly correlated with student achievement outcomes. The literature is scarce on strong, evidence-based theoretical models for improving STEB.^ This dissertation is comprised of two studies. STUDY #1 was a sequential explanatory mixed-methods study investigating the impact of a reformed CAIC elementary science methods course on the STEB of 26 preservice teachers. Data were collected using the Science Teaching Efficacy Belief Instrument (STEBI-B) and from six post-course interviews. A statistically significant increase in STEB was observed in the quantitative strand. The qualitative data suggested that the preservice teachers perceived all of the CAIC methods as influential, but the significance of each method depended on their unique needs and abilities. ^ STUDY #2 was a participatory action research case study exploring the utility of a CAIC professional development program for improving the STEB of five Bahamian inservice teachers and their competency in implementing an inquiry-based curriculum. Data were collected from pre- and post-interviews and two focus group interviews. Overall, the inservice teachers perceived the intervention as highly effective. The scaffolding and coaching were the CAIC methods portrayed as most influential in developing their STEB, highlighting the importance of interpersonal relationship aspects in successful instructional coaching programs. The teachers also described the CAIC approach as integral in supporting their learning to implement the new inquiry-based curriculum. ^ The overall findings hold important implications for science education reform, including its potential to influence how preservice teacher training and inservice teacher professional development in science are perceived and implemented. Additionally, given the noteworthy results obtained over the relatively short durations, CAIC interventions may also provide an effective means of achieving improvements in preservice and inservice teachers’ STEB more expeditiously than traditional approaches.^

Teachers' knowledge, awareness, and pedagogy of global education in secondary schools

In 1979, the Florida State Board of Education approved the teaching of global education in the state of Florida. The purpose of this study was to examine the factors that contributed to teachers' global knowledge, global mindedness, and pedagogy in global education. The Hanvey model of teaching from a global perspective was the theoretical framework for the study. ^ A total of 90 secondary teachers from Miami-Dade County Public Schools were randomly selected and placed in three groups: Globally Oriented Social Studies Program (GOSSE), Non-Globally Oriented Social Studies Program (non-GOSSE), and Teachers Who Teach Other Subjects (TWTOS). Seven teachers, two of whom team-taught a class, were selected for classroom observations and interviews. A mixed methods design that combined quantitative and qualitative data was used. ANOVA and Chi square techniques were used to determine whether the factors that contributed to teachers' global knowledge and global mindedness differ among groups. Classroom observations and interviews were conducted to determine whether the instructional strategies differ among the seven selected teachers. ^ The findings of the study show that teachers who were trained in teaching from a global perspective differed in their global knowledge and used more appropriate instructional strategies than teachers who were not trained in teaching global perspectives. There was no significant difference in the combined global knowledge of the non-GOSSE and TWTOS groups when compared with the GOSSE group. There was no significant difference in the combined global knowledge of the GOSSE and non-GOSSE groups when compared with the TWTOS group. There was no significant difference among the teachers in their global mindedness. Observation and interview data indicate that current events, role-playing, simulations, open-ended discussion, debates, and projects were the predominant instructional strategies used by globally trained teachers. Cable networks, Internet, magazines, and newspapers were found to be the dominant tools for teaching global education. ^ This study concluded that teachers who were trained in globally oriented programs had more global knowledge than teachers who were not. It is recommended that teacher education programs should incorporate a global perspective in the preparation of social studies teachers, with particular attention to developing their global attitudes. ^