Assessing evaluative measures for Internet-based courseware

Although there is a consensus in th~ literature on the many uses of the Internet in education, as well as the unique features of the Internet for presenting facts and information, there is no consensus on a standardized method for evaluating Internetbased courseware. Educators rarely have the opportunity to participate in the development of Internet-based courseware, yet they are encouraged to use the technology in their learning environments. This creates a need for summative evaluation methods for Internet-based health courseware. The purpose ofthis study was to assess evaluative measures for Internet-based courseware. Specifically, two entities were evaluated within the study: a) the outcome of the Internet-based courseware, and b) the Internet-based courseware itself. To this end, the Web site www.bodymatters.com was evaluated using two different approaches by two different cohorts. The first approach was a performance appraisal by a group of endusers. A positive, statistically significant change in the students performance was observed due to the intervention ofthe Web site. The second approach was a productoriented evaluation ofthe Web site with the use of a criterion-based checklist and an open-ended comments section. The findings indicate that a summative, criterion-based evaluation is best completed by a multidisciplinary team. The findi~gs also indicated that the two different cohorts reported different product-oriented appraisals of the Web site. The current research confirmed previous research that found that experts returning a poor evaluation of a Web site did not have a relationship to whether or not the end-users performance improved due to the intervention of the Web site.

How Learning Styles, Chemistry Attitudes and Experiences, Confidence, and Demographics Correlate with Academic Success in First and Second Year Chemistry Courses

At Brock University, the Faculty of Mathematics and Science currently has one of the highest percentages of students on academic probation, with many students reporting the most difficulty with Introductory Chemistry in first year and Organic Chemistry in second year. To identify strategies to improve students' performance and reduce the number of students on academic probation, a multi-year research project was undertaken involving several chemistry courses. Students were asked to complete three questionnaires, and provide consent to obtain their final Chemistry grade from the Registrar's Office. Research began at the end of the 2007-08 academic year with CHEM IPOO, and in the 2008-09 academic year, students in the larger CHEM IF92 Introductory Chemistry course were invited to participate in this research near the beginning of the academic year. Students who went on to take second year Organic and Analytical Chemistry were asked to complete these questionnaires in each second year course. The three questionnaires included the Kolb Learning Styles Inventory (Kolb, 1984) modified to include specific reference to Chemistry in each question, Dalgety, ColI, and Jones' (2002) Chemistry Attitudes and Experiences Questionnaire (CAEQ), and lastly, a demographic survey. Correlations were found between learning style and academic success; concrete learners were not as successful as abstract learners. Differences were noted between females and males with respect to learning styles, academic success, and confidence. Several differences were also noted between those who are the First in the Family to attend university and those who are not First in the Family to attend university.

Evolution of Various Library Instruction Strategies: Using Student Feedback to Create and Enhance Online Active Learning Assignments

This case study traces the evolution of library assignments for biological science students from paper-based workbooks in a blended (hands-on) workshop to blended learning workshops using online assignments to online active learning modules which are stand-alone without any face-to-face instruction. As the assignments evolved to adapt to online learning supporting materials in the form of PDFs (portable document format), screen captures and screencasting were embedded into the questions as teaching moments to replace face-to-face instruction. Many aspects of the evolution of the assignment were based on student feedback from evaluations, input from senior lab demonstrators and teaching assistants, and statistical analysis of the students’ performance on the assignment. Advantages and disadvantages of paper-based and online assignments are discussed. An important factor for successful online learning may be the ability to get assistance.

Improving grade eight students' spelling performance with a triad strategy approach

Thesis (M.Ed.)-- Brock University, 1996.

Spelling performance of third grade students : a comparison of whole-language-plus-strategy instruction, strategy instruction only, and the whole language approach

This study investigated three methods for teaching children how to spell. Third grade students were divided into three conditions for a one-week training period consisting of 15- to 20-minute lessons. One of the two experimental conditions used a whole language approach along with explicit strategy instruction. The second condition used strategy instruction within a traditional setting. The control used strictly a whole language approach to le~ing hO\\l to spell. The spelling perfonnance of all three conditions improved after the one-week training period. However, students in the strategy instruction groups did significantly better on the study "'7ords than the whole language only group. The students in whole-Ianguage-plusstrateg)! instruction outperformed both other groups. Significantly better spelling perfonnance was observed even at the nine-week posttest. This study frrst supported the hypothesis that children can make significantly greater improven1ents in their spelling when explicitly taught how to use spelling strategies. Secondl)', this study indicated that whole language provided a relevant context for the study words, clearly giving the students in the whole-Ianguage-plus-strategy condition an additional advantage.

Factors affecting performance proficiency : a case study involving intermediate piano students

The goal of this study was to determine the effect of a number of factors on the performance proficiency of three intermediate piano students having different learning styles, all of whom shared the same teacher. Four sets of data were collected in this investigation: the methodology of the teacher; the practice behaviour of the participants; the effect of intrinsic factors, such as participant attitude, motivation, and ownership of learning; and the effect of extrinsic factors that included parental influence, and participants' school- and employment-related responsibilities. Performance proficiency and assessment of practice behaviour were measured by three external, professionallyqualified music examiners. Performance proficiency varied to some extent between participants, but they shared similar practice behaviours. Learning style does not, therefore, affect practice behaviour. Although they planned their practice time, participants did not show much evidence of monitoring the quality of their practice. On the other hand, participants showed positive attitude; they were motivated to learn; and they were observed to plan their practice time, all indicators of, among other things, positive influence of the teacher and parents. Participants showed evidence that these constructive habits were a denominator common to both their schoolwork and piano practice. It was apparent that, except for learning style, all factors examined had an effect on performance proficiency. Performance proficiency is, therefore, influenced by a large web of factors, a finding that is instructive for classroom teachers. Teachers need to avoid the temptation to teach toward performance expectations. Emphasis should be placed instead on teaching and assessing formative learning strategies.

Educator Evaluation of Academic and Social Competence in Students with Acquired Brain Injury (ABI) Relative to Assessed Performance and Sense of Belonging

Acquired brain injury (ABI) is the leading cause of death and disability amongst children and adolescents andpresents itself with challenges associated in cognitive, social, emotional, and behavioural domains. These changes may interfere with academic performance and social inclusion, influencing self-esteem and personal success. The current study examined a subset of data to capture the sense of academic and social belonging for students with ABI as a function of the classroom teachers’ subjective perception of ability, their ABI knowledge, and student identification. Overall, a discrepancy was found between educators’ subjective ratings of student performance and students’ neurocognitive capacity. Educator knowledge and identification of ABI influenced student success in academic and social domains independent of teaching approach. This research has implications for the identification of ABI in the classroom and related challenges students experience. Educators are underprepared for the reintegration of students returning to school and lack appropriate knowledge and strategies to accommodate individual needs.

The use of explicit algorithms and episodic context to teach subtraction to students with learning problems in mathematics /

This research attempted to address the question of the role of explicit algorithms and episodic contexts in the acquisition of computational procedures for regrouping in subtraction. Three groups of students having difficulty learning to subtract with regrouping were taught procedures for doing so through either an explicit algorithm, an episodic content or an examples approach. It was hypothesized that the use of an explicit algorithm represented in a flow chart format would facilitate the acquisition and retention of specific procedural steps relative to the other two conditions. On the other hand, the use of paragraph stories to create episodic content was expected to facilitate the retrieval of algorithms, particularly in a mixed presentation format. The subjects were tested on similar, near, and far transfer questions over a four-day period. Near and far transfer algorithms were also introduced on Day Two. The results suggested that both explicit and episodic context facilitate performance on questions requiring subtraction with regrouping. However, the differential effects of these two approaches on near and far transfer questions were not as easy to identify. Explicit algorithms may facilitate the acquisition of specific procedural steps while at the same time inhibiting the application of such steps to transfer questions. Similarly, the value of episodic context in cuing the retrieval of an algorithm may be limited by the ability of a subject to identify and classify a new question as an exemplar of a particular episodically deflned problem type or category. The implications of these findings in relation to the procedures employed in the teaching of Mathematics to students with learning problems are discussed in detail.

Predicting performance on fluid intelligence from speed of processing, working memory, and controlled attention

Fluid inteliigence has been defined as an innate ability to reason which is measured commonly by the Raven's Progressive Matrices (RPM). Individual differences in fluid intelligence are currently explained by the Cascade model (Fry & Hale, 1996) and the Controlled Attention hypothesis (Engle, Kane, & Tuholski, 1999; Kane & Engle, 2002). The first theory is based on a complex relation among age, speed, and working memory which is described as a Cascade. The alternative to this theory, the Controlled Attention hypothesis, is based on the proposition that it is the executive attention component of working memory that explains performance on fluid intelligence tests. The first goal of this study was to examine whether the Cascade model is consistent within the visuo-spatial and verbal-numerical modalities. The second goal was to examine whether the executive attention component ofworking memory accounts for the relation between working memory and fluid intelligence. Two hundred and six undergraduate students between the ages of 18 and 28 completed a battery of cognitive tests selected to measure processing speed, working memory, and controlled attention which were selected from two cognitive modalities, verbalnumerical and visuo-spatial. These were used to predict performance on two standard measures of fluid intelligence: the Raven's Progressive Matrices (RPM) and the Shipley Institute of Living Scales (SILS) subtests. Multiple regression and Structural Equation Modeling (SEM) were used to test the Cascade model and to determine the independent and joint effects of controlled attention and working memory on general fluid intelligence. Among the processing speed measures only spatial scan was related to the RPM. No other significant relations were observed between processing speed and fluid intelligence. As 1 a construct, working memory was related to the fluid intelligence tests. Consistent with the predictions for the RPM there was support for the Cascade model within the visuo-spatial modality but not within the verbal-numerical modality. There was no support for the Cascade model with respect to the SILS tests. SEM revealed that there was a direct path between controlled attention and RPM and between working memory and RPM. However, a significant path between set switching and RPM explained the relation between controlled attention and RPM. The prediction that controlled attention mediated the relation between working memory and RPM was therefore not supported. The findings support the view that the Cascade model may not adequately explain individual differences in fluid intelligence and this may be due to the differential relations observed between working memory and fluid intelligence across different modalities. The findings also show that working memory is not a domain-general construct and as a result its relation with fluid intelligence may be dependent on the nature of the working memory modality.

Exploring the use of effective learning strategies to increase students' reading comprehension and test taking skills /

This study examined the effects of providing students with explicit instruction in how to use a repertoire of reading comprehension strategies and test taking skills when reading and responding to three types of questions (direct, inferential, critical). Specifically, the study examined whether providing students with a "model" of how to read and respond to the text and to the comprehension questions improved their reading comprehension relative to providing them with implicit instruction on reading comprehension strategies and test taking skills. Students' reading comprehension and test taking performance scores were compared as a function of instructional condition. Students from 2 grade 8 classes participated in this study. The reading component of the Canadian Achievement Tests, Third Edition (CAT/3) was used to identify students' level of reading comprehension prior to the formal instructional sessions. Students received either explicit instruction, which involved modelling, or implicit instruction, which consisted of review and discussion of the strategies to be used. Comprehension was measured through the administration of formative tests after each instructional session. The formative tests consisted of reading comprehension questions pertaining to a specific form of text (narrative, informational, graphic). In addition, students completed 3 summative tests and a delayed comprehension test which consisted of the alternative version of the CAT/3 standardized reading assessment. These data served as a posttest measure to determine whether students had shown an improvement in their reading comprehension skills as a result of the program delivery. There were significant differences in students' Canadian Achievement Test performance scores prior to the onset of the study. Students in the implicit group attained significantly higher comprehension scores than did students in the explicit group. The results from the program sessions indicated no significant differences in reading comprehension between the implicit and explicit conditions, with the exception of the 6th session involving the reading and interpreting of graphic text. Students in the explicit group performed significantly better when reading and interpreting graphic text than those in the implicit group. No significant differences were evident between the two study conditions across the three summative tests. Upon completion of the study, the results from the Canadian Achievement Test indicated no significant differences in performance between the two study conditions. The findings from this study reveal the effectiveness of providing students with explicit strategy instruction when reading and responding to various forms of text. Modelling the appropriate reading comprehension strategies and test taking skills enabled students to apply the same thought processes to their own independent work. This form of instruction enabled students in the explicit group to improve in their abilities to comprehend and respond to text and therefore should be incorporated as an effective form of classroom teaching.

Gender bias in the Trends in Mathematics and Science Study 2003 (TIMMS) for Canadian students /

This study is a secondary data analysis of the Trends in Mathematics and Science Study 2003 (TIMSS) to determine if there is a gender bias, unbalanced number of items suited to the cognitive skill of one gender, and to compare performance by location. Results of the Grade 8, math portion of the test were examined. Items were coded as verbal, spatial, verbal /spatial or neither and as conventional or unconventional. A Kruskal- Wallis was completed for each category, comparing performance of students from Ontario, Quebec, and Singapore. A Factor Analysis was completed to determine if there were item categories with similar characteristics. Gender differences favouring males were found in the verbal conventional category for Canadian students and in the spatial conventional category for students in Quebec. The greatest differences were by location, as students in Singapore outperformed students from Canada in all areas except for the spatial unconventional category. Finally, whether an item is conventional or unconventional is more important than whether the item is verbal or spatial. Results show the importance of fair assessment for the genders in both the classroom and on standardized tests.

Adolescent girls and mathematics: classroom performance, attitudes toward mathematics and perceptions of parental attitudes /

The purpose of this study was to determine the extent to which gender differences exist in student attitudes toward mathematics and in their performance in mathematics at the Grade Seven and Eight level. The study also questioned how parents influence the attitudes of this grade level of male and female students toward mathematics. Historically, the literature has demonstrated gender differences in the attitudes of students toward mathematics, and in parental support for classroom performance in mathematics. This study was an attempt to examine these differences at one senior public school in the Peel Board of Education. One hundred three Grade Seven and Eight students at a middle school in the Peel Board of Education volunteered to take part in a survey that examined their attitudes toward mathematics, their perceptions of their parents' attitudes toward mathematics and support for good performance in the mathematics classroom, parental expectations for education and future career choices. Gender differences related to performance levels in the mathematics classroom were examined using Pearson contingency analyses. Items from the survey that showed significant differences involved confidence in mathematics and confidence in writing mathematics tests, as well as a belief in the ability to work on mathematics problems. Male students in both the high and low performance groups demonstrated higher levels of confidence than the females in those groups. Female students, however, indicated interest in careers that would require training and knowledge of higher mathematics. Some of the reasons given to explain the gender differences in confidence levels included socialization pressures on females, peer acceptance, and attribution of success. Perceived parental support showed no significant differences across gender groups or performance levels. Possible explanations dealt with the family structure of the participants in the study. Studies that, in the past, have demonstrated gender differences in confidence levels were supported by this study, and discussed in detail. Studies that reported on differences in parental support for student performance, based on the gender of the parent, were not confirmed by this study, and reasons for this were also discussed. The implications for the classroom include: 1) build on the female students' strengths that will allow them to enjoy their experiences in mathematics; 2) stop using the boys as a comparison group; and 3) make students more aware of the need to continue studying mathematics to ensure a wider choice of future careers.

A school-based cognitive behavior modification intervention strategy for learned helpless mentally retarded students

This study assessed the usefulness of a cognitive behavior modification (CBM) intervention package with mentally retarded students in overcoming learned helplessness and improving learning strategies. It also examined the feasibility of instructing teachers in the use of such a training program for a classroom setting. A modified single subject design across individuals was employed using two groups of three subjects. Three students from each of two segregated schools for the mentally retarded were selected using a teacher questionnaire and pupil checklist of the most learned helpless students enrolled there. Three additional learned helplessness assessments were conducted on each subject before and after the intervention in order to evaluate the usefulness of the program in alleviating learned helplessness. A classroom environment was created with the three students from each school engaged in three twenty minute work sessions a week with the experimenter and a tutor experimenter (TE) as instructors. Baseline measurements were established on seven targeted behaviors for each subject: task-relevant speech, task-irrelevant speech, speech denoting a positive evaluation of performance, speech denoting a negative evaluation of performance, proportion of time on task, non-verbal positive evaluation of performance and non-verbal negative evaluation of performance. The intervention package combined a variety of CBM techniques such as Meichenbaum's (1977) Stop, Look and Listen approach, role rehearsal and feedback. During the intervention each subject met with his TE twice a week for an individual half-hour session and one joint twenty minute session with all three students, the experimentor and one TE. Five weeks after the end of this experiment one follow up probe was conducted. All baseline, post-intervention and probe sessions were videotaped. The seven targeted behaviors were coded and comparisons of baseline, post intervention, and probe testing were presented in graph form. Results showed a reduction in learned helplessness in all subjects. Improvement was noted in each of the seven targeted behaviors for each of the six subjects. This study indicated that mentally retarded children can be taught to reduce learned helplessness with the aid of a CBM intervention package. It also showed that CBM is a viable approach in helping mentally retarded students acquire more effective learning strategies. Because the TEs (Tutor experimenters) had no trouble learning and implementing this program, it was considered feasible for teachers to use similar methods in the classroom.

Completing the picture: the effects of video game practice on verbal and performance I.Q. scores in high functioning children

The strength and nature of the video game practice effect on tests of visual and perceptual skills were examined using high functioning Grades Four and Five students who had been tested with the WISC-R .for the purpose of gifted identification and placement. The control group, who did not own and .play video games on a sustained basis, and the experimental group, who did own a video game system and had some mastery of video games, including the -Nintendo game, "Tetris", were each composed of 18 juniorg:r;-ade students and were chosen from pre-existing conditions. The experimental group corresponded to the control group in terms of age, sex, and community. Data on the Verbal and Performance I.Q. Scores were· collected for both groups and the author was interested in the difference between the Verbal and Performance Scores within each group, anticipating a P > V outcome for the experimental group. The results showed a significant P > V difference in the experimental, video game playing group, as expected, but no significant difference between the Performance $cores of the control and experimental groups. The results, thus, indicated lower Verbal I.Q. Scores in the experimental group relat'ive to 'the control group.' The study conclu~ed that information about a sUbject's video game experience and "learhing style pref~rence is important for a clear interpretation of the Verbal and Performance I.Q. Scores of the WISC-R. Although the time spent on video game play may, 'indeed, increase P~rformance Scores relative to Verbal Scores for an individual, the possibilities exist that the time borrowed and spent away from language based activities may retard verbal growth and/or that the cognitive style associated with some Performance I.Q.subtests may have a negative effect on the approach to the tasks on the Verbal I.Q. Scale. The study also discussed the possibility that exposure to ,the video game experience, in pre-puberty, can provide spatial instruction which will result in improved spatial skills. strong spatial skills have been linked to improved performance and preference in mathematics, science, and engineering and it was suggested that appropriate video game play might be a way to involve girls more in the fields of mathematics and science.

The effect of motor-encoding activities on memory and performance in a grade one reading program

This study examined the effectiveness of motor-encoding activities on memory and performance of students in a Grade One reading program. There were two experiments in the study. Experiment 1 replicated a study by Eli Saltz and David Dixon (1982). The effect of motoric enactment (Le., pretend play) of sentences on memory for the sentences was investigated. Forty Grade One students performed a "memory-for-sentences" technique, devised by Saltz and Dixon. Only the experimental group used motoric enactment of the sentences. Although quantitative findings revealed no significant difference between the mean scores of the experimental group versus the control group, aspects of the experimental design could have affected the results. It was suggested that Saltz and Dixon's study could be replicated again, with more attention given to variables such as population size, nature of the test sentences, subjects' previous educational experience and conditions related to the testing environment. The second experiment was an application of Saltz and Dixon's theory that motoric imagery should facilitate memory for sentences. The intent was to apply this theory to Grade One students' ability to remember words from their reading program. An experimental gym program was developed using kinesthetic activities to reinforce the skills of the classroom reading program. The same subject group was used in Experiment 2. It was hypothesized that the subjects who experienced the experimental gym program would show greater signs of progress in reading ability, as evidenced by their scores on Form G of the Woodcock Reading Mastery Test--Revised. The data from the WRM--R were analyzed with a 3-way split-plot analysis of variance in which group (experimental vs. control) and sex were the between subjects variables and test-time (pre-test vs. post-test) was the within-subjects variable. Findings revealed the following: (a) both groups made substantial gains over time on the visual-auditory learning sub-test and the triple action of group x sex x time also was significant; (b) children in the experimental and control groups performed similarly on both the pre- and post-test of the letter identification test; (c) time was the only significant effect on subjects' performance on the word identification task; (d) work attack scores showed marked improvement in performance over time for both the experimenta+ and control groups; (e) passage comprehension scores indicated an improvement in performance for both groups over time. Similar to Experiment 1, it is suggested that several modifications in the experimental design could produce significant results. These factors are addressed with suggestions for further research in the area of active learning; more specifically, the effect of motor-encoding activities on memory and academic performance of children.