The Effect of using online homework exercises on student achievement in a Quantitative methods course

Abstract: Quantitative Methods (QM) is a compulsory course in the Social Science program in CEGEP. Many QM instructors assign a number of homework exercises to give students the opportunity to practice the statistical methods, which enhances their learning. However, traditional written exercises have two significant disadvantages. The first is that the feedback process is often very slow. The second disadvantage is that written exercises can generate a large amount of correcting for the instructor. WeBWorK is an open-source system that allows instructors to write exercises which students answer online. Although originally designed to write exercises for math and science students, WeBWorK programming allows for the creation of a variety of questions which can be used in the Quantitative Methods course. Because many statistical exercises generate objective and quantitative answers, the system is able to instantly assess students’ responses and tell them whether they are right or wrong. This immediate feedback has been shown to be theoretically conducive to positive learning outcomes. In addition, the system can be set up to allow students to re-try the problem if they got it wrong. This has benefits both in terms of student motivation and reinforcing learning. Through the use of a quasi-experiment, this research project measured and analysed the effects of using WeBWorK exercises in the Quantitative Methods course at Vanier College. Three specific research questions were addressed. First, we looked at whether students who did the WeBWorK exercises got better grades than students who did written exercises. Second, we looked at whether students who completed more of the WeBWorK exercises got better grades than students who completed fewer of the WeBWorK exercises. Finally, we used a self-report survey to find out what students’ perceptions and opinions were of the WeBWorK and the written exercises. For the first research question, a crossover design was used in order to compare whether the group that did WeBWorK problems during one unit would score significantly higher on that unit test than the other group that did the written problems. We found no significant difference in grades between students who did the WeBWorK exercises and students who did the written exercises. The second research question looked at whether students who completed more of the WeBWorK exercises would get significantly higher grades than students who completed fewer of the WeBWorK exercises. The straight-line relationship between number of WeBWorK exercises completed and grades was positive in both groups. However, the correlation coefficients for these two variables showed no real pattern. Our third research question was investigated by using a survey to elicit students’ perceptions and opinions regarding the WeBWorK and written exercises. Students reported no difference in the amount of effort put into completing each type of exercise. Students were also asked to rate each type of exercise along six dimensions and a composite score was calculated. Overall, students gave a significantly higher score to the written exercises, and reported that they found the written exercises were better for understanding the basic statistical concepts and for learning the basic statistical methods. However, when presented with the choice of having only written or only WeBWorK exercises, slightly more students preferred or strongly preferred having only WeBWorK exercises. The results of this research suggest that the advantages of using WeBWorK to teach Quantitative Methods are variable. The WeBWorK system offers immediate feedback, which often seems to motivate students to try again if they do not have the correct answer. However, this does not necessarily translate into better performance on the written tests and on the final exam. What has been learned is that the WeBWorK system can be used by interested instructors to enhance student learning in the Quantitative Methods course. Further research may examine more specifically how this system can be used more effectively.

Compétences en littératie visuelle chez les étudiantEs en biologie au niveau collégial: bilan des apprentissages selon des activités digitales ou des activités de dessins à la main

This study examines the role of visual literacy in learning biology. Biology teachers promote the use of digital images as a learning tool for two reasons: because biology is the most visual of the sciences, and the use of imagery is becoming increasingly important with the advent of bioinformatics; and because studies indicate that this current generation of teenagers have a cognitive structure that is formed through exposure to digital media. On the other hand, there is concern that students are not being exposed enough to the traditional methods of processing biological information - thought to encourage left-brain sequential thinking patterns. Theories of Embodied Cognition point to the importance of hand-drawing for proper assimilation of knowledge, and theories of Multiple Intelligences suggest that some students may learn more easily using traditional pedagogical tools. To test the claim that digital learning tools enhance the acquisition of visual literacy in this generation of biology students, a learning intervention was carried out with 33 students enrolled in an introductory college biology course. The study compared learning outcomes following two types of learning tools. One learning tool was a traditional drawing activity, and the other was an interactive digital activity carried out on a computer. The sample was divided into two random groups, and a crossover design was implemented with two separate interventions. In the first intervention students learned how to draw and label a cell. Group 1 learned the material by computer and Group 2 learned the material by hand-drawing. In the second intervention, students learned how to draw the phases of mitosis, and the two groups were inverted. After each learning activity, students were given a quiz on the material they had learned. Students were also asked to self-evaluate their performance on each quiz, in an attempt to measure their level of metacognition. At the end of the study, they were asked to fill out a questionnaire that was used to measure the level of task engagement the students felt towards the two types of learning activities. In this study, following the first testing phase, the students who learned the material by drawing had a significantly higher average grade on the associated quiz compared to that of those who learned the material by computer. The difference was lost with the second “cross-over” trial. There was no correlation for either group between the grade the students thought they had earned through self-evaluation, and the grade that they received. In terms of different measures of task engagement, there were no significant differences between the two groups. One finding from the study showed a positive correlation between grade and self-reported time spent playing video games, and a negative correlation between grade and self-reported interest in drawing. This study provides little evidence to support claims that the use of digital tools enhances learning, but does provide evidence to support claims that drawing by hand is beneficial for learning biological images. However, the small sample size, limited number and type of learning tasks, and the indirect means of measuring levels of metacognition and task engagement restrict generalisation of these conclusions. Nevertheless, this study indicates that teachers should not use digital learning tools to the exclusion of traditional drawing activities: further studies on the effectiveness of these tools are warranted. Students in this study commented that the computer tool seemed more accurate and detailed - even though the two learning tools carried identical information. Thus there was a mismatch between the perception of the usefulness of computers as a learning tool and the reality, which again points to the need for an objective assessment of their usefulness. Students should be given the opportunity to try out a variety of traditional and digital learning tools in order to address their different learning preferences.

Les Perceptions des Étudiants en Soins Infirmiers Pédiatriques en Milieu Communautaire

Over the last decade health care delivery has shifted from hospitals to the community resulting in a significant reduction of hospital-based clinical placements for nursing students to practice and learn. Studies have emerged describing this problem and outlining the ways in which Colleges and Universities have attempted to deal with the acute shortage of clinical areas in nursing and other health care programs. Several studies describe the development of community-based clinical experiences, and some of these examined students’ perceptions. One finding appears to be constant: student perceptions of community experiences have an effect on their learning outcomes. There is an increasing need to teach nursing students in community settings both to contend with the shortage of hospital-based placements and to prepare students for future practice. Pediatric hospitals are no longer able to provide as many clinical placements as they once did. This has created a problem for college nursing departments. Over the past five years, John Abbott College’s pediatric nursing teachers have attempted to deal with this problem in numerous ways; however, students and faculty were dissatisfied with the solutions as there was a lack of development of the pediatric community clinical component. The purpose of this study is to explore nursing students’ perceptions of pediatric community experiences both prior to the start of the clinical rotation and following the experience. Student perceptions of nursing in community settings are an important element in the level of student satisfaction and ultimately their learning in pediatric clinical settings. In order to explore the John Abbott College’s nursing students’ perceptions, data was collected from a small segment of the population. Students’ perceptions were explored quantitatively through the use of questionnaires using a Likert scale administered both prior to the clinical experience and following the experience; and qualitatively, using content analysis of reflective journals and focus group discussions. The results of the study demonstrated that prior to the community rotations; students did not know what the experience would involve. They felt apprehensive due to being inadequately prepared for the experience and questioned the actual learning they would acquire from a community setting. Following the pediatric community experience, students perceived benefits to their learning particularly in the development of their abilities to communicate with children, and to recognize and apply principles of growth and development to children of different age groups and with different health needs. In addition, students perceived an increase in their self- confidence when teaching children. They also developed an appreciation of the role of the nurse in health promotion for individuals’ in community settings. Furthermore, students described an increase in their awareness of resources that are available in the community. Overall, students were satisfied with their pediatric community clinical experience. The results of this study indicate that adequate student preparation is required prior to the community clinical experience. This preparation would include a clear description of the clinical objectives and associated learning activities, as well as an explicit explanation of the evaluation process. Finally, it is recommended that the pediatric nursing teachers continue to search for community clinical areas that can enhance student learning in pediatrics. This study contributes to the literature on community experiences for nursing students since it explored students’ perceptions before and after the community clinical rotation.

Vidéos contre lectures: Une évaluation de l'utilisation de vidéos pour accomplir la construction initiale de connaissances

Abstract : The goal of this study was to determine whether providing videos for students to watch before class would be more effective than assigning readings. The study took place within a flipped classroom: a methodology designed to engage students in the initial construction of knowledge before class, freeing up classroom time for active learning pedagogies. Preparing for class by watching videos should require less of the students’ time than doing readings, and they should respond better to videos than to readings because these more closely mimic this generation’s interactions with information and media. Consequently, flipped classroom students provided with videos should perceive a lower workload, which could translate into more positive learning outcomes. From an instructor’s perspective, however, developing and organizing videos is extremely time consuming. Thus, a teacher giving consideration to flipping their class would likely want to know whether videos would lead to positive outcomes for their students before actually committing to developing these. However, no research to date was identified which has examined the question of whether flipped class videos would be more effective than readings. The hypotheses for the study were that videos would result in measurable learning gains for the students, and would lead to lower time demands and perceived workloads, as well as more positive attitudes. These were tested using a quasi-experimental design involving a convenience sample of two small college General Biology 1 courses taught by the same teacher. One group had videos to watch before class for the first 1/3 of the course (treatment; Class A), during which the other was assigned readings (control; Class B). Following this, both groups were provided with videos. Student scores were compared on pre-instruction and in-class quizzes, activities, four unit tests, and a final exam. Further, students completed a 44 item survey as well as a demographic questionnaire. Results suggest greater learning gains for students provided with videos. Certainly, students from Class B improved significantly when provided with videos, especially as compared to Class A, whose improvement over the same time span was marginal. However, conclusions based on these results are somewhat tentative, as Class A performed rather poorly on all summative assessments, and this could have driven the patterns observed, at least partially. From the surveys, Class B students reported that they spent more time preparing for class, were less likely to do the necessary preparations, and generally perceived their effort and workload levels to be higher. These factors were significant enough that they contributed to four students from Class B (10% of the class) dropping the course over the semester. In addition, students from both groups also reported more positive attitudes towards videos than readings, although they did not necessarily feel that videos were (or would be) a more effective study and learning tool. The results of this study suggest that any effort on the part of an instructor to prepare or organize videos as pre-class instructional tools would likely be well spent. However, even outside of the context of a flipped classroom, this study provides an indication that assigned readings can place heavy workload requirements on students, which should give cause for any instructor employing mandatory readings to reassess their approach. Finally, since both groups were statistically equivalent across all measured demographic variables, it appears that some of the observed disparities in assessment scores may have been driven by differences in group dynamics. Consequently, the suggestion is made that an instrument to measure classroom climate should be incorporated into any research design comparing two or more interacting groups of students, as group dynamics have the potential to play a key role in any outcomes.||Résumé : L'objectif de cette étude était de déterminer si fournir des vidéos aux étudiants avant une classe serait plus efficace comme méthode d’apprentissage individuel que de leur donner une liste de lectures à compléter. L'étude a eu lieu dans une classe renversée – une stratégie plus reconnu sous le nom de «classroom flipping» – ce qui ce trouve à être une méthodologie qui vise à obliger les élèves d’accomplir le transfert de connaissances initial avant la classe, en vue de libérer du temps de classe pour des activités pédagogiques plus approfondie. En théorie, pour les élèves, se préparer pour une classe renversé en regardant des vidéos devrait exiger moins de temps que d’être obligé à apprendre le matériel en lisant. En plus, présenter le matériel d’un cours avec des vidéos imite de plus près les genres d’interactions qu’on les étudiants de cette génération avec de l'information et les médias, ce qui devrait faciliter leur tâche. Par conséquent, les élèves d’une classe renversée fournies avec des vidéos devraient percevoir une charge de travail moins élevée, et ceci pourrait se traduire en bilans d'apprentissage plus positifs. Cependant, du point de vue du professeur, avoir à développer et organiser des vidéos se présente comme un gros défi, surtout en vue du temps et de l’effort qui sont requis. Ainsi, un enseignant qui songe à renversée sa classe voudrait probablement savoir si le fait d’offrir des vidéos mène à des résultats positifs avant de réellement s'engager dans le développement de ces derniers. Par contre, lors de l’écriture de ce texte, aucune étude n’a été identifié qui répond à cette question, et aucune publication compare la performance des étudiants lorsqu’ils ont des vidéos à regarder avec lorsqu’ils sont obligés de faire de la lecture pour se préparer. Alors, les hypothèses de l'étude étaient que des étudiants ayant accès à des vidéos démontreraient des gains d’apprentissages évidents, qu’ils apercevraient des requêtes de temps moins encombrantes et une charge de travail plus faible, et, en vue de ces derniers, que les étudiants auraient des attitudes plus positives envers le cours et le matériel. Les hypothèses ont été testés à l'aide d'un modèle quasi-expérimental, avec comme échantillon deux classes collégiales de Biologie générale 1, tout les deux enseignés par le même professeur. Un de ces groupes avaient accès à des vidéos pour se préparer pour chaque classe lors du premier tiers du cours, alors que l’autre groupe étaient obligé de faire de la lecture. Après le premier tiers du cours, ce qui fut 10 des 30 classes du semestre, les deux groupes ont été fournis avec des vidéos pour le restant du cours. Des notes ont été ramassées et comparées sur des mini-examens préparatoires avant et durant les classes, sur des activités complétées en classe, sur quatre examens en classe, et un examen final. En outre, les étudiants ont rempli un questionnaire composé de 44 items, ainsi qu’un autre questionnaire démographique. Les résultats de l’étude suggèrent qu’une décision d’offrir des vidéos aux élèves peut mener à des gains d'apprentissage plus élevés comparativement à l’option lecture. En particulier, les élèves du groupe initial de lecture se sont considérablement améliorées lorsqu'ils ont été fournis avec des vidéos, surtout par rapport au groupe initial de vidéos, dont l’amélioration durant la même période était marginale. Cependant, ces conclusions sont un peu incertaines, parce que la performance du groupe initial de vidéos était globalement médiocre, ce qui aurait pu mener aux résultats observés. Par contre, les résultats obtenus des questionnaires étaient moins incertains, et indiquent que les élèves qui se sont vues attribués des lectures passaient plus de temps pour préparer leurs classes, étaient plus aptes à ne pas faire les préparatifs nécessaires, et ont aperçus leurs niveaux d'efforts et leurs charges de travails comme étant plus élevés. Ces facteurs étaient suffisamment importants qu'ils ont contribué au fait que quatre étudiants du groupe de lecture, soit 10% de la classe, ont abandonnés le cours durant le premier tiers du semestre. Finalement, les élèves ont démontrés des attitudes plus positives envers les vidéos, bien qu'ils ne trouvaient pas nécessairement que ceux-ci étaient plus efficaces que les lectures lorsqu’ils voulaient étudier pour les examens. Basé sur ces résultats, il est possible de conclure que tout effort de la part d'un instructeur pour préparer ou organiser des vidéos pédagogiques serait probablement un bon investissement. En plus, et même en dehors du contexte d'une classe renversée, cette étude offre une indication qu’une stratégie pédagogique qui oblige les étudiants à faire beaucoup de lecture peut imposer des exigences et une charge de travail très élevée pour les étudiants, ce qui devrait donner cause à tout instructeur qui attribue des lectures à réévaluer leur approche. Enfin, puisque les deux groupes étaient équivalents d’un point de vue statistique sur toutes les mesures démographiques, il semble que certaines disparités entre les deux groupes dans les notes d'évaluation et d’examens peuvent possiblement avoir été entraînées par des différentes dynamiques dans chaque group. Par conséquent, il est suggéré que des mesures de relations entre étudiants et de dynamiques de groupes devraient être incorporé dans n’importe qu’elle recherche comparant deux ou plusieurs groupes d’étudiants, et surtout quand ces étudiants sont en interaction, parce-que en toute apparence les dynamiques de groupes ont le potentiel de jouer un rôle clé dans les résultats obtenus.