Fidelity of Implementation of Research-Based Instructional Strategies (RBIS) in Engineering Science Courses

Background Increasing attention is being paid to improvement in undergraduate science, technology, engineering, and mathematics (STEM) education through increased adoption of research-based instructional strategies (RBIS), but high-quality measures of faculty instructional practice do not exist to monitor progress. Purpose/Hypothesis The measure of how well an implemented intervention follows the original is called fidelity of implementation. This theory was used to address the research questions: What is the fidelity of implementation of selected RBIS in engineering science courses? That is, how closely does engineering science classroom practice reflect the intentions of the original developers? Do the critical components that characterize an RBIS discriminate between engineering science faculty members who claimed use of the RBIS and those who did not? Design/Method A survey of 387 U.S. faculty teaching engineering science courses (e.g., statics, circuits, thermodynamics) included questions about class time spent on 16 critical components and use of 11 corresponding RBIS. Fidelity was quantified as the percentage of RBIS users who also spent time on corresponding critical components. Discrimination between users and nonusers was tested using chi square. Results Overall fidelity of the 11 RBIS ranged from 11% to 80% of users spending time on all required components. Fidelity was highest for RBIS with one required component: case-based teaching, just-in-time teaching, and inquiry learning. Thirteen of 16 critical components discriminated between users and nonusers for all RBIS to which they were mapped. Conclusions Results were consistent with initial mapping of critical components to RBIS. Fidelity of implementation is a potentially useful framework for future work in STEM undergraduate education.

Estimates of Use of Research-Based Instructional Strategies in Core Electrical or Computer Engineering Courses

Many research-based instruction strategies (RBISs) have been developed; their superior efficacy with respect to student learning has been demonstrated in many studies. Collecting and interpreting evidence about: 1) the extent to which electrical and computer engineering (ECE) faculty members are using RBISs in core, required engineering science courses, and 2) concerns that they express about using them, are important aspects of understanding how engineering education is evolving. The authors surveyed ECE faculty members, asking about their awareness and use of selected RBISs. The survey also asked what concerns ECE faculty members had about using RBISs. Respondent data showed that awareness of RBISs was very high, but estimates of use of RBISs, based on survey data, varied from 10% to 70%, depending on characteristics of the strategy. The most significant concern was the amount of class time that using an RBIS might take; efforts to increase use of RBISs must address this.

Influence of Engineering Instructors' Teaching and Learning Beliefs on Pedagogies in Engineering Science Courses

This study explored how academics' beliefs about teaching and learning influenced their teaching in engineering science courses typically taught in the second or third year of 4-year engineering undergraduate degrees. Data were collected via a national survey of 166 U. S. statics instructors and interviews at two different institutions with 17 instructors of engineering science courses such as thermodynamics, circuits and statics. The study identified a number of common beliefs about how to best support student learning of these topics; each is discussed in relation to the literature about student development and learning. Specific recommendations are given for educational developers to encourage use of research-based instructional strategies in these courses.

Special education teachers' perspectives on teaching middle school students with severe emotional disturbance

The voices of special education teachers who educate middle school students with severe emotional disturbance (SED) have been largely unheard in the educational forum and in the discussion about raising the academic achievement of middle school students with SED. These students continue to have high attrition rates and low levels of academic achievement. This study described and analyzed the perspectives of five special education teachers regarding appropriate instructional strategies for educating middle school students with SED. It also explored these teachers' opinions concerning difficulties they experienced in raising the academic achievement of students with SED and some of the solutions for overcoming these challenges. The professional literature emphasizes the importance of teacher knowledge (Altrichter, Posch, & Somekh, 1996; Clandinin & Connelly, 1996) and also offers suggestions for appropriate instructional strategies for educating students with SED (Bauer, Keefe, & Shea, 2002; Heward, 2000; Kauffman, 2001; Polloway, Patton, & Serna 2001). ^ A qualitative case study was employed to describe and analyze the five participants' perspectives on teaching middle school students with SED. The sources of data collection were interviews, observations and analysis of documents. Data presentation was from the perspective of the participants in dialogue with the interpretations of the researcher and against the backdrop of the professional literature and the researcher's critical theory philosophy. One of the major themes that emerged from the analysis was the teachers' insistence on the students' need for discipline tempered with teacher nurturing and playfulness. One concern was the need for teacher training in current appropriate, research-based instructional strategies for educating students with SED. ^ As a result of this study, one of the recommendations made was for more rigorous standards of re-certification and professional development of certified teachers who educate students with SED. ^

Moving toward change: Institutionalizing reform through implementation of the Learning Assistant model and Open Source Tutorials

Florida International University has undergone a reform in the introductory physics classes by focusing on the laboratory component of these classes. We present results from the secondary implementation of two research-based instructional strategies: the implementation of the Learning Assistant model as developed by the University of Colorado at Boulder and the Open Source Tutorial curriculum developed at the University of Maryland, College Park. We examine the results of the Force Concept Inventory (FCI) for introductory students over five years (n=872) and find that the mean raw gain of students in transformed lab sections was 0.243, while the mean raw gain of the traditional labs was 0.159, with a Cohen’s d effect size of 0.59. Average raw gains on the FCI were 0.243 for Hispanic students and 0.213 for women in the transformed labs, indicating that these reforms are not widening the gaps between underrepresented student groups and majority groups. Our results illustrate how research-based instructional strategies can be successfully implemented in a physics department with minimal department engagement and in a sustainable manner.

Effectiveness of instructional strategies based on schema theory on attention deficit disorder children

A review of the literature reveals that there are a number of children in the educational system who are characterized by Attention Deficit Disorder. Further review of the literature reveals that there are information processing programs which have had some success in increasing the learning of these children. Currently, an information processing program which is based on schema theory is being implemented in Lincoln County. Since schema theory based programs build structural, conditional, factual, and procedural schemata which assist the learner in attending to salient factors, learning should be increased. Thirty-four children were selected from a random sampling of Grade Seven classes in Lincoln County. Seventeen of these children were identified by the researcher and classroom teacher as being characterized by Attention Deficit Disorder. From the remaining population, 17 children who were not characterized by Attention Deficit Disorder were randomly selected. The data collected were compared using independent t-tests, paired t-tests, and correlation analysis. Significant differences were found in all cases. The Non-Attention Deficit Disorder children scored significantly higher on all the tests but the Attention Defici t Disorder children had a significantly higher ratio of gain between the pretests and posttests.

Student Writing Performance: Identifying the Effects when Combining Planning and Revising Instructional Strategies

The purpose of the current study is to identify the impact of teaching students to revise their stories on writing production (Total Words Written; TWW), writing accuracy (Percent Correct Writing Sequences; %CWS), number of critical story elements included in stories, and quality of writing. Three third-grade and one fourth-grade student who were experiencing difficulties in the area of writing were involved in the study. The students were first taught to plan their stories using the evidence-based program, Self-Regulated Strategy Development (SRSD), which has frequently been implemented to teach students to plan their stories. Students were then taught to revise their stories using SRSD procedures modified for instruction in revision strategies. Student progress was evaluated through a multiple-probe design across tasks and a multiple-probe design across participants, which allowed for experimental control over time and across story probes. In addition to the previously mentioned variables, student’s acceptability of the intervention and their attitudes toward writing were also assessed. Results indicated that instruction in revising increased student writing accuracy beyond the effects of instruction in planning. Additionally, although instruction in planning was shown to increase writing production, number of critical story elements, and quality of writing, instruction in revising produced additional improvement in these variables as well. Finally, results indicated that students liked the intervention and their attitudes toward writing generally increased. Implications for practice and future research directions will be discussed. Advisor: Merilee McCurdy

Assessing the Influence of Brain-based Instructional Methods and Its Impact on Systemic Change for Learning Communities

Background: As scholars who prepare future school leaders to be innovative instructional leaders for their learning communities, we are on the verge of a curriculum design revolution. The application of brain research findings promotes educational reform efforts to systemically change the way in which children experience school. However, most educators, school leaders, board members, and policy makers are ill prepared to reconsider the implications for assessment, pedagogy, school climate, daily schedules, and use of technology. This qualitative study asked future school leaders to reconsider how school leadership preparedness programs prepared them to become instructional leaders for the 21st century. The findings from this study will enhance the field of school leadership, challenging the current emphasis placed on standardized testing, traditional school calendars, assessments, monocultural instructional methods, and meeting the needs of diverse learning communities. [See PDF for complete abstract]

Research on rework strategies for reconfigurable manufacturing system considering mission reliability

Rework strategies that involve different checking points as well as rework times can be applied into reconfigurable manufacturing system (RMS) with certain constraints, and effective rework strategy can significantly improve the mission reliability of manufacturing process. The mission reliability of process is a measurement of production ability of RMS, which serves as an integrated performance indicator of the production process under specified technical constraints, including time, cost and quality. To quantitatively characterize the mission reliability and basic reliability of RMS under different rework strategies, rework model of RMS was established based on the method of Logistic regression. Firstly, the functional relationship between capability and work load of manufacturing process was studied through statistically analyzing a large number of historical data obtained in actual machining processes. Secondly, the output, mission reliability and unit cost in different rework paths were calculated and taken as the decision variables based on different input quantities and the rework model mentioned above. Thirdly, optimal rework strategies for different input quantities were determined by calculating the weighted decision values and analyzing advantages and disadvantages of each rework strategy. At last, case application were demonstrated to prove the efficiency of the proposed method.

The effects of a General Instructional Strategies course on the utilization of effective instructional strategies by teachers

The focus of this study was to explain the extent to which theoretically effective teaching strategies taught in a course on generic instructional strategies are being implemented by teachers in their actual teaching practice. ^ A multivariate causal-comparative (ex-post-facto) design was used to answer the research question. A teacher observation protocol, the General Instructional Strategies Analysis (GISA) was constructed and used to assess the utilization of instructional strategies in the classroom. The data of this study also included open-ended field notes taken during observations. ^ Multivariate Analyses of Variance (MANOVA) was used to compare the teaching strategies (set, effective explanation, hands-on activity, cooperative learning activity, higher order questioning, closure) of the group who had taken a general instructional strategies course (N=36) and the group who had not (N=36). Results showed a statistically significant difference between the two groups. The group who had taken the course implemented these strategies more effectively in almost all categories of effective teaching. Follow-up univariate tests of the dependent variables showed significant differences between the two groups in five of the six areas (hands-on activity being an exception). A second MANOVA compared the two groups on the effective use of attending behaviors (teacher movement/eye contact/body language/physical space, brief verbal acknowledgements/voice inflection/modulation/pitch, use of visuals, prompting/probing, praise/feedback/rewards, wait-time I and II). Results also showed a multivariate difference between the two groups. Follow-up univariate tests on the related dependent variables showed that five of the six were significantly different between the two groups. The group who had taken the course implemented the strategies more effectively. An analysis of the field notes provided further evidence regarding the pervasiveness of these differences between the teaching practices of the two groups. ^ It was concluded that taking a course in general instructional strategies increases the utilization of effective strategies in the classroom by teachers. ^

Investigating the Effects of Cognitive Apprenticeship-Based Instructional Coaching on Science Teaching Efficacy Beliefs

The overall purpose of this collected papers dissertation was to examine the utility of a cognitive apprenticeship-based instructional coaching (CAIC) model for improving the science teaching efficacy beliefs (STEB) of preservice and inservice elementary teachers. Many of these teachers perceive science as a difficult subject and feel inadequately prepared to teach it. However, teacher efficacy beliefs have been noted as the strongest indicator of teacher quality, the variable most highly correlated with student achievement outcomes. The literature is scarce on strong, evidence-based theoretical models for improving STEB. This dissertation is comprised of two studies. STUDY #1 was a sequential explanatory mixed-methods study investigating the impact of a reformed CAIC elementary science methods course on the STEB of 26 preservice teachers. Data were collected using the Science Teaching Efficacy Belief Instrument (STEBI-B) and from six post-course interviews. A statistically significant increase in STEB was observed in the quantitative strand. The qualitative data suggested that the preservice teachers perceived all of the CAIC methods as influential, but the significance of each method depended on their unique needs and abilities. STUDY #2 was a participatory action research case study exploring the utility of a CAIC professional development program for improving the STEB of five Bahamian inservice teachers and their competency in implementing an inquiry-based curriculum. Data were collected from pre- and post-interviews and two focus group interviews. Overall, the inservice teachers perceived the intervention as highly effective. The scaffolding and coaching were the CAIC methods portrayed as most influential in developing their STEB, highlighting the importance of interpersonal relationship aspects in successful instructional coaching programs. The teachers also described the CAIC approach as integral in supporting their learning to implement the new inquiry-based curriculum. The overall findings hold important implications for science education reform, including its potential to influence how preservice teacher training and inservice teacher professional development in science are perceived and implemented. Additionally, given the noteworthy results obtained over the relatively short durations, CAIC interventions may also provide an effective means of achieving improvements in preservice and inservice teachers’ STEB more expeditiously than traditional approaches.

Teacher perceived difficulty in implementing differentiated instructional strategies in primary school

This study analyses teacher perceived difficulty in implementing differentiated instructional strategies in regular classes. The participants were 273 Portuguese primary school teachers with teaching experience ranging from 1 to 33 years. A 39-item questionnaire was used to evaluate teacher perceived difficulty in relation to different instructional strategies. Teacher responses were factor analysed and five different domains were identified: (1) activities and materials; (2) assessment; (3) management; (4) planning and preparation; and (5) classroom environment. Results showed that with the exception of the classroom environment domain, all the instruction practices in the remaining domains were considered to be difficult. In particular, the most difficult practices were under the domain of activities and materials and were associated with the adaptation of curricular elements (content, process, and product) based on student characteristics (readiness, interest, and learning profiles). The results also revealed a strong association between the activities and materials domain and the assessment domain. Some implications of these findings for initial teacher training and teacher professional development programmes are discussed.