An Experience-Driven Pedagogy for the Instruction of Software Testing in Computer Science

In the realm of computer programming, the experience of writing a program is used to reinforce concepts and evaluate ability. This research uses three case studies to evaluate the introduction of testing through Kolb's Experiential Learning Model (ELM). We then analyze the impact of those testing experiences to determine methods for improving future courses. The first testing experience that students encounter are unit test reports in their early courses. This course demonstrates that automating and improving feedback can provide more ELM iterations. The JUnit Generation (JUG) tool also provided a positive experience for the instructor by reducing the overall workload. Later, undergraduate and graduate students have the opportunity to work together in a multi-role Human-Computer Interaction (HCI) course. The interactions use usability analysis techniques with graduate students as usability experts and undergraduate students as design engineers. Students get experience testing the user experience of their product prototypes using methods varying from heuristic analysis to user testing. From this course, we learned the importance of the instructors role in the ELM. As more roles were added to the HCI course, a desire arose to provide more complete, quality assured software. This inspired the addition of unit testing experiences to the course. However, we learned that significant preparations must be made to apply the ELM when students are resistant. The research presented through these courses was driven by the recognition of a need for testing in a Computer Science curriculum. Our understanding of the ELM suggests the need for student experience when being introduced to testing concepts. We learned that experiential learning, when appropriately implemented, can provide benefits to the Computer Science classroom. When examined together, these course-based research projects provided insight into building strong testing practices into a curriculum.

Looking at the effectiveness of an earth science unit designed using the Understanding by Design process

This report shares my efforts in developing a solid unit of instruction that has a clear focus on student outcomes. I have been a teacher for 20 years and have been writing and revising curricula for much of that time. However, most has been developed without the benefit of current research on how students learn and did not focus on what and how students are learning. My journey as a teacher has involved a lot of trial and error. My traditional method of teaching is to look at the benchmarks (now content expectations) to see what needs to be covered. My unit consists of having students read the appropriate sections in the textbook, complete work sheets, watch a video, and take some notes. I try to include at least one hands-on activity, one or more quizzes, and the traditional end-of-unit test consisting mostly of multiple choice questions I find in the textbook. I try to be engaging, make the lessons fun, and hope that at the end of the unit my students get whatever concepts I‘ve presented so that we can move on to the next topic. I want to increase students‘ understanding of science concepts and their ability to connect understanding to the real-world. However, sometimes I feel that my lessons are missing something. For a long time I have wanted to develop a unit of instruction that I know is an effective tool for the teaching and learning of science. In this report, I describe my efforts to reform my curricula using the “Understanding by Design” process. I want to see if this style of curriculum design will help me be a more effective teacher and if it will lead to an increase in student learning. My hypothesis is that this new (for me) approach to teaching will lead to increased understanding of science concepts among students because it is based on purposefully thinking about learning targets based on “big ideas” in science. For my reformed curricula I incorporate lessons from several outstanding programs I‘ve been involved with including EpiCenter (Purdue University), Incorporated Research Institutions for Seismology (IRIS), the Master of Science Program in Applied Science Education at Michigan Technological University, and the Michigan Association for Computer Users in Learning (MACUL). In this report, I present the methodology on how I developed a new unit of instruction based on the Understanding by Design process. I present several lessons and learning plans I‘ve developed for the unit that follow the 5E Learning Cycle as appendices at the end of this report. I also include the results of pilot testing of one of lessons. Although the lesson I pilot-tested was not as successful in increasing student learning outcomes as I had anticipated, the development process I followed was helpful in that it required me to focus on important concepts. Conducting the pilot test was also helpful to me because it led me to identify ways in which I could improve upon the lesson in the future.

Teaching and aligning upper level mathematics classes to Michigan high school content expectations in an alternative education setting : approaches and issues

After teaching regular education secondary mathematics for seven years, I accepted a position in an alternative education high school. Over the next four years, the State of Michigan adopted new graduation requirements phasing in a mandate for all students to complete Geometry and Algebra 2 courses. Since many of my students were already struggling in Algebra 1, getting them through Geometry and Algebra 2 seemed like a daunting task. To better instruct my students, I wanted to know how other teachers in similar situations were addressing the new High School Content Expectations (HSCEs) in upper level mathematics. This study examines how thoroughly alternative education teachers in Michigan are addressing the HSCEs in their courses, what approaches they have found most effective, and what issues are preventing teachers and schools from successfully implementing the HSCEs. Twenty-six alternative high school educators completed an online survey that included a variety of questions regarding school characteristics, curriculum alignment, implementation approaches and issues. Follow-up phone interviews were conducted with four of these participants. The survey responses were used to categorize schools as successful, unsuccessful, and neutral schools in terms of meeting the HSCEs. Responses from schools in each category were compared to identify common approaches and issues among them and to identify significant differences between school groups. Data analysis showed that successful schools taught more of the HSCEs through a variety of instructional approaches, with an emphasis on varying the ways students learned the material. Individualized instruction was frequently mentioned by successful schools and was strikingly absent from unsuccessful school responses. The main obstacle to successful implementation of the HSCEs identified in the study was gaps in student knowledge. This caused pace of instruction to also be a significant issue. School representatives were fairly united against the belief that the Algebra 2 graduation requirement was appropriate for all alternative education students. Possible implications of these findings are discussed.

Comparison of the effects of inquiry-based cooperative learning and demonstrations in science education

The reported research project involved studying how teaching science using demonstrations, inquiry-based cooperative learning groups, or a combination of the two methods affected sixth grade students’ understanding of air pressure and density. Three different groups of students were each taught the two units using different teaching methods. Group one learned about the topics through both demonstrations and inquirybased cooperative learning, whereas group two only viewed demonstrations, and group three only participated in inquiry-based learning in cooperative learning groups. The study was designed to answer the following two questions: 1. Which teaching strategy works best for supporting student understanding of air pressure and density: demonstrations, inquirybased labs in cooperative learning groups, or a combination of the two? 2. And what effect does the time spent engaging in a particular learning experience (demonstrations or labs) have on student learning? Overall, the data did not provide sufficient evidence that one method of learning was more effective than the others. The results also suggested that spending more time on a unit does not necessarily equate to a better understanding of the concepts by the students. Implications for science instruction are discussed.

Improving learning by connecting chemistry curriculum to students' experiences

The purpose of the study was to design, implement, and assess the effects of a teaching unit about fuel sources and chemical energy on students’ learning. The unit was designed to incorporate students’ experiences in a way that was aligned with the Michigan High School Content Expectations. The study was completed with all of the students taking General Chemistry in a rural Michigan high school in the 2010-11 school year. There were 138 participants total. The participants were mostly Caucasian and the majority were in the 11th grade. Of these, 77 constituted the experimental group and were taught the unit. The additional 61 participants in the control group were given the posttest only. Data was derived from the results of pre/post tests, final assessment projects, and the researcher’s observations. A pretest that contained questions about the fuel sources was administered at the beginning of the unit. An identical posttest was administered at the completion of the unit. A final assessment project required students to choose the best fuel source for the area, and support their opinion with facts and data from their research or the learning activities and labs performed in class. The results of the study revealed that the teaching unit did produce significant learning gains in the experimental group. The results also indicated that the teaching unit added value to the current General Chemistry curriculum by expanding what students were learning. The instructional goals of the unit were aligned with the Michigan High School Content Expectations. The results also revealed that the students were able to learn to support their thinking and decisions with explanations based on the data and labs. These are essential science literacy skills. The study supported the view that connecting the required curriculum with students’ experiences and interests was effective, and that students can learn important science literacy skills, such as providing support for arguments and communicating scientific explanations, when given adequate teacher support.

INCORPORATING REAL SCIENCE INTO THE SECONDARY CLASSROOM: AEROSOLS AND CLIMATE CHANGE

Climate science and climate change are included in the Next Generation Science Standards, curriculum standards that were released in 2013. How to incorporate these topics, especially climate change, has been a difficult task for teachers. A team of scientists are studying aerosols in the free troposphere; what their properties are, how they change while in the atmosphere and where they came from. Lessons were created based on this real, ongoing scientific research being conducted in the Azores. During these activities, students are exposed to what scientists actually do in the form of videos and participate in similar tasks such as conducting experiments, collecting data, and analyzing data. At the conclusion of the lessons, students will form conclusions based on the evidence they have at the time.

INCORPORATING STIMULATING QUICK-WRITE PROMPTS WITHIN A SECONDARY SCIENCE CLASSROOM: A CASE STUDY IN LESOTHO

The use of intriguing open-ended quick-write prompts within the Basotho science classroom could potentially provide a way for secondary teachers in Lesotho to have a time-efficient alternative to stimulate student thinking and increase critical thinking or application of scientific principles. Writing can be used as a powerful means to improve the achievement of students across many subject areas, including the sciences (Moore, 1993; Rivard, 1994; Rillero, Zambo, Cleland, and Ryan, 1996; Greenstein, 2013). This study focuses on the use of a non-traditional nor extensively studied writing method that could potentially support learning in science. A quasi-experimental research design, with a control and experimental group, was applied. The study was conducted at two schools, with one experimental classroom in one school and a second control group classroom in the second school for a period of 4 weeks. 51 Form B (US Grade 9 equivalent) students participated as the experimental group and 43 Form B students as the control group. In an effort to assess learning achievement, a 1 hour (35 mark) pre-test evaluation was made by and given to students by Basotho teachers at the beginning of this study to have an idea of student’s previous knowledge. Topics covered were Static Electricity, Current Electricity, Electromagnetic Waves, and Chemistry of Water. After the experimental trial period, an almost completely identical post-test evaluation was given to students in the same fashion to observe and compare gains in achievement. Test data was analyzed using an inferential statistics procedure that compared means and gains in knowledge made by the experimental and control groups. Difference between the gains of mean pre-test and post-test scores were statistically significant within each group, but were not statistically significant when the control and experimental groups were compared. Therefore, there was no clear practical effect. Qualitative data from teachers’ journals and students’ written feedback provides insight on the assessments, incorporation of the teaching method, and the development of participating students. Both mid and post-study student feedback shows that students had an overall positive and beneficial experience participating in this activity. Assessments and teacher journals showed areas of strength and weaknesses in student learning and on differences in teaching styles. They also helped support some feedback claims made by students. Areas of further research and improvement of the incorporation of this teaching method in the Basotho secondary science classroom are explored.

Is virtuality close enough to reality? A comparison of the effectiveness of simulations with traditional laboratory activities in a high school biology class

Some schools do not have ideal access to laboratory space and supplies. Computer simulations of laboratory activities can be a cost-effective way of presenting experiences to students, but are those simulations as effective at supplementing content concepts? This study compared the use of traditional lab activities illustrating the principles of cell respiration and photosynthesis in an introductory high school biology class with virtual simulations of the same activities. Additionally student results were analyzed to assess if student conceptual understanding was affected by the complexity of the simulation. Although all student groups posted average gain increases between the pre and post-tests coupled with positive effect sizes, students who completed the wet lab version of the activity consistently outperformed the students who completed the virtual simulation of the same activity. There was no significant difference between the use of more or less complex simulations. Students also tended to rate the wet lab experience higher on a motivation and interest inventory.

Attempting to improve standardized test results using Study Islands' web-based mastery program

State standardized testing has always been a tool to measure a school’s performance and to help evaluate school curriculum. However, with the school of choice legislation in 1992, the MEAP test became a measuring stick to grade schools by and a major tool in attracting school of choice students. Now, declining enrollment and a state budget struggling to stay out of the red have made school of choice students more important than ever before. MEAP scores have become the deciding factor in some cases. For the past five years, the Hancock Middle School staff has been working hard to improve their students’ MEAP scores in accordance with President Bush's “No Child Left Behind” legislation. In 2005, the school was awarded a grant that enabled staff to work for two years on writing and working towards school goals that were based on the improvement of MEAP scores in writing and math. As part of this effort, the school purchased an internet-based program geared at giving students practice on state content standards. This study examined the results of efforts by Hancock Middle School to help improve student scores in mathematics on the MEAP test through the use of an online program called “Study Island.” In the past, the program was used to remediate students, and as a review with an incentive at the end of the year for students completing a certain number of objectives. It had also been used as a review before upcoming MEAP testing in the fall. All of these methods may have helped a few students perform at an increased level on their standardized test, but the question remained of whether a sustained use of the program in a classroom setting would increase an understanding of concepts and performance on the MEAP for the masses. This study addressed this question. Student MEAP scores and Study Island data from experimental and comparison groups of students were compared to understand how a sustained use of Study Island in the classroom would impact student test scores on the MEAP. In addition, these data were analyzed to determine whether Study Island results provide a good indicator of students’ MEAP performance. The results of the study suggest that there were limited benefits related to sustained use of Study Island and gave some indications about the effectiveness of the mathematics curriculum at Hancock Middle School. These results and implications for instruction are discussed.

Effects of instructional changes on student learning of electrochemistry in an IB chemistry course

This study investigated the effectiveness of incorporating several new instructional strategies into an International Baccalaureate (IB) chemistry course in terms of how they supported high school seniors’ understanding of electrochemistry. The three new methods used were (a) providing opportunities for visualization of particle movement by student manipulation of physical models and interactive computer simulations, (b) explicitly addressing common misconceptions identified in the literature, and (c) teaching an algorithmic, step-wise approach for determining the products of an aqueous solution electrolysis. Changes in student understanding were assessed through test scores on both internally and externally administered exams over a two-year period. It was found that visualization practice and explicit misconception instruction improved student understanding, but the effect was more apparent in the short-term. The data suggested that instruction time spent on algorithm practice was insufficient to cause significant test score improvement. There was, however, a substantial increase in the percentage of the experimental group students who chose to answer an optional electrochemistry-related external exam question, indicating an increase in student confidence. Implications for future instruction are discussed.

Investigation of the effect of using data collection technology on students' attitudes to science instruction

The purpose of this project was to investigate the effect of using of data collection technology on student attitudes towards science instruction. The study was conducted over the course of two years at Madison High School in Adrian, Michigan, primarily in college preparatory physics classes, but also in one college preparatory chemistry class and one environmental science class. A preliminary study was conducted at a Lenawee County Intermediate Schools student summer environmental science day camp. The data collection technology used was a combination of Texas Instruments TI-84 Silver Plus graphing calculators and Vernier LabPro data collection sleds with various probeware attachments, including motion sensors, pH probes and accelerometers. Students were given written procedures for most laboratory activities and were provided with data tables and analysis questions to answer about the activities. The first year of the study included a pretest and posttest measuring student attitudes towards the class they were enrolled in. Pre-test and post-test data were analyzed to determine effect size, which was found to be very small (Coe, 2002). The second year of the study focused only on a physics class and used Keller’s ARCS model for measuring student motivation based on the four aspects of motivation: Attention, Relevance, Confidence and Satisfaction (Keller, 2010). According to this model, it was found that there were two distinct groups in the class, one of which was motivated to learn and the other that was not. The data suggest that the use of data collection technology in science classes should be started early in a student’s career, possibly in early middle school or late elementary. This would build familiarity with the equipment and allow for greater exploration by the student as they progress through high school and into upper level science courses.

Effect of implementing project-based education in high school physics : file folder bridge engineering

Project-based education and portfolio assessments are at the forefront of educational research. This research follows the implementation of a project-based unit in a high school physics class. Students played the role of an engineering firm who designed, built and tested file folder bridges. The purpose was to determine if projectbased learning could improve student attitude toward science and related careers like engineering. Teams of students presented their work in a portfolio for a final assessment of the process of designing, building and testing their bridges.

Improving sixth grade student knowledge of ecology using fish rearing and release as a real-world context

This research project measured the effects of real-world content in a science classroom by determining change (deep knowledge of life science content, including ecosystems from MDE – Grade Level Content Expectations) in a subset of students (6th Grade Science) that may result from the addition of curriculum (real-world content of rearing trout in the classroom). Data showed large gains from the pre-test to post-test in students from both the experimental and control groups. The ecology unit with the implementation of real-world content [trout] was even more successful, and improved students’ deep knowledge of ecosystem content from Michigan’s Department of Education Grade Level Content Expectations. The gains by the experimental group on the constructed response section of the test, which included higher cognitive level items, were significant. Clinical interviews after the post-test confirmed increases in deep knowledge of ecosystem concepts in the experimental group, by revealing that a sample of experimental group students had a better grasp of important ecology concepts as compared to a sample of control group students.