Development of the Heat and Energy Concept Inventory: Preliminary Results on the Prevalence and Persistence of Engineering Students' Misconceptions

BACKGROUND Students frequently hold a number of misconceptions related to temperature, heat and energy. There is not currently a concept inventory with sufficiently high internal reliability to assess these concept areas for research purposes. Consequently, there is little data on the prevalence of these misconceptions amongst undergraduate engineering students. PURPOSE (HYPOTHESIS) This work presents the Heat and Energy Concept Inventory (HECI) to assess prevalent misconceptions related to: (1) Temperature vs. Energy, (2) Temperature vs. Perceptions of Hot and Cold, (3) Factors that affect the Rate vs. Amount of Heat Transfer and (4) Thermal Radiation. The HECI is also used to document the prevalence of misconceptions amongst undergraduate engineering students. DESIGN/METHOD Item analysis, guided by classical test theory, was used to refine individual questions on the HECI. The HECI was used in a one group, pre-test-post-test design to assess the prevalence and persistence of targeted misconceptions amongst a population of undergraduate engineering students at diverse institutions. RESULTS Internal consistency reliability was assessed using Kuder-Richardson Formula 20; values were 0.85 for the entire instrument and ranged from 0.59 to 0.76 for the four subcategories of the HECI. Student performance on the HECI went from 49.2% to 54.5% after instruction. Gains on each of the individual subscales of the HECI, while generally statistically significant, were similarly modest. CONCLUSIONS The HECI provides sufficiently high estimates of internal consistency reliability to be used as a research tool to assess students' understanding of the targeted concepts. Use of the instrument demonstrates that student misconceptions are both prevalent and resistant to change through standard instruction.

Fidelity of Implementation of Research-Based Instructional Strategies (RBIS) in Engineering Science Courses

Background Increasing attention is being paid to improvement in undergraduate science, technology, engineering, and mathematics (STEM) education through increased adoption of research-based instructional strategies (RBIS), but high-quality measures of faculty instructional practice do not exist to monitor progress. Purpose/Hypothesis The measure of how well an implemented intervention follows the original is called fidelity of implementation. This theory was used to address the research questions: What is the fidelity of implementation of selected RBIS in engineering science courses? That is, how closely does engineering science classroom practice reflect the intentions of the original developers? Do the critical components that characterize an RBIS discriminate between engineering science faculty members who claimed use of the RBIS and those who did not? Design/Method A survey of 387 U.S. faculty teaching engineering science courses (e.g., statics, circuits, thermodynamics) included questions about class time spent on 16 critical components and use of 11 corresponding RBIS. Fidelity was quantified as the percentage of RBIS users who also spent time on corresponding critical components. Discrimination between users and nonusers was tested using chi square. Results Overall fidelity of the 11 RBIS ranged from 11% to 80% of users spending time on all required components. Fidelity was highest for RBIS with one required component: case-based teaching, just-in-time teaching, and inquiry learning. Thirteen of 16 critical components discriminated between users and nonusers for all RBIS to which they were mapped. Conclusions Results were consistent with initial mapping of critical components to RBIS. Fidelity of implementation is a potentially useful framework for future work in STEM undergraduate education.

Estimates of Use of Research-Based Instructional Strategies in Core Electrical or Computer Engineering Courses

Many research-based instruction strategies (RBISs) have been developed; their superior efficacy with respect to student learning has been demonstrated in many studies. Collecting and interpreting evidence about: 1) the extent to which electrical and computer engineering (ECE) faculty members are using RBISs in core, required engineering science courses, and 2) concerns that they express about using them, are important aspects of understanding how engineering education is evolving. The authors surveyed ECE faculty members, asking about their awareness and use of selected RBISs. The survey also asked what concerns ECE faculty members had about using RBISs. Respondent data showed that awareness of RBISs was very high, but estimates of use of RBISs, based on survey data, varied from 10% to 70%, depending on characteristics of the strategy. The most significant concern was the amount of class time that using an RBIS might take; efforts to increase use of RBISs must address this.

Effect of Participant Gender, Professor Gender, and Activity Interventions on the Understanding of Concepts in Thermodynamics

Misconceptions about heat and temperature have been seen across all educational levels, even in undergraduate engineering courses. One way these misconceptions can be remediated is through instructional methods, such as inquiry-based activities. Performance on assessments in sciences and engineering has been found to vary when gender is taken into consideration. The purpose of the current study was to investigate the effects of participant gender, professor gender, and level of inquiry-based activities on the conceptual understanding of 247 undergraduate engineering students in thermodynamics. A pre-test post-test design was used. Conceptual understanding of thermodynamics was measured by students’ scores on the Concept Inventory for Engineering Thermodynamics (CIET; Vigeant, Prince & Nottis, 2011). Inquiry-based activities were developed by the researchers and given to professors who determined if they would do all, some, or none of them as they taught. Significant differences were found among participants of different gender, different gender of the professor instructing the course, and level of inquiry-based activity. The participants who were exposed to all of the activities provided didsignificantly better on the post-test than those who were only exposed to some or none of the activities. The results from this current study indicated that differences in gender, professorgender, and level of inquiry-based activity has an effect on undergraduate engineering students’ conceptual understanding of thermodynamics. Future research should investigate more factorsthat contribute to lower representation of women in the engineering field.

The Effect of Grade Point Average on Undergraduates' Understanding of Heat Transfer

Engineering students continue to develop and show misconceptions due to prior knowledge and experiences (Miller, Streveler, Olds, Chi, Nelson, & Geist, 2007). Misconceptions have been documented in students’ understanding of heat transfer(Krause, Decker, Niska, Alford, & Griffin, 2003) by concept inventories (e.g., Jacobi,Martin, Mitchell, & Newell, 2003; Nottis, Prince, Vigeant, Nelson, & Hartsock, 2009). Students’ conceptual understanding has also been shown to vary by grade point average (Nottis et al., 2009). Inquiry-based activities (Nottis, Prince, & Vigeant, 2010) haveshown some success over traditional instructional methods (Tasoglu & Bakac, 2010) in altering misconceptions. The purpose of the current study was to determine whether undergraduate engineering students’ understanding of heat transfer concepts significantly changed after instruction with eight inquiry-based activities (Prince & Felder, 2007) supplementing instruction and whether students’ self reported GPA and prior knowledge, as measured by completion of specific engineering courses, affected these changes. The Heat and Energy Concept Inventory (Prince, Vigeant, & Nottis, 2010) was used to assess conceptual understanding. It was found that conceptual understanding significantly increased from pre- to post-test. It was also found that GPA had an effect on conceptual understanding of heat transfer; significant differences were found in post-test scores onthe concept inventory between GPA groups. However, there were mixed results when courses previously taken were analyzed. Future research should strive to analyze how prior knowledge effects conceptual understanding and aim to reduce the limitations of the current study such as, sampling method and methods of measuring GPA and priorknowledge.

Effect of Classroom Gender Composition on Students' Development of Self-Regulated Learning Competencies

Success in any field depends on a complex interplay among environmental and personal factors. A key set of personal factors for success in academic settings are those associated with self-regulated learners (SRL). Self-regulated learners choose their own goals, select and organize their learning strategies, and self-monitor their effectiveness. Behaviors and attitudes consistent with self-regulated learning also contribute to self-confidence, which may be important for members of underrepresented groups such as women in engineering. This exploratory study, drawing on the concept of "critical mass", examines the relationship between the personal factors that identify a self-regulated learner and the environmental factors related to gender composition of engineering classrooms. Results indicate that a relatively student gender-balanced classroom and gender match between students and their instructors provide for the development of many adaptive SRL behaviors and attitudes.

Influence of Engineering Instructors' Teaching and Learning Beliefs on Pedagogies in Engineering Science Courses

This study explored how academics' beliefs about teaching and learning influenced their teaching in engineering science courses typically taught in the second or third year of 4-year engineering undergraduate degrees. Data were collected via a national survey of 166 U. S. statics instructors and interviews at two different institutions with 17 instructors of engineering science courses such as thermodynamics, circuits and statics. The study identified a number of common beliefs about how to best support student learning of these topics; each is discussed in relation to the literature about student development and learning. Specific recommendations are given for educational developers to encourage use of research-based instructional strategies in these courses.