The development, assessment, and implementation of an evaluation of the EMPOWER Program at shelters for abused women /

The development, assessment, and implementation of a program evaluation instrument was carried out to evaluate the impact and efficacy of the EMPOWER Program. This intervention was created to educate residents at a shelter for abused women with an anticipated outcome of prevention. Participants included the staff and residents at 2 shelters in Southern Ontario. Client pre, post and follow-up measures were obtained and analyzed statistically and using keyword content analysis. A single staff measure was obtained and summarized using keyword content analysis. Qualitative results were suggestive of important change in participants. All women in the post and follow-up measures believed their participation in the EMPOWER Program provided them with the knowledge, skills, and confidence to avoid abusive relationships in the fliture. This transformational impact was repeatedly expressed in both resident and staff feedback. Limitations of this research, as well as suggestions for future study were discussed.

SAVOURING ABILITIES SCALE (SAS): THE DEVELOPMENT OF A STRENGTHS - BASED ASSESSMENT FOR THERAPEUTIC RECREATION PROFESSIONALS

The purpose of this study was to develop and evaluate an assessment that measured savouring leisure. The assessment items developed were reviewed for content validity by eight international therapeutic recreation (TR) educators and administrators as well as eleven TR practitioners. An exploratory factor analysis was conducted to determine the most suitable items for the assessment. The results suggest that the original three subscale design needed to be modified to five. The reliability of the total assessment is α=.84. Statistical analysis for construct validity reveal 58.52% of the variance explained, and a moderate correlation was found between this study and other savouring assessments. The implications of the shift in conceptualization are reviewed through discussing factor analysis issues, the lived experience of savouring leisure, and the impact of the content validity process. This study contributes to the ongoing dialog of savouring leisure. Recommendations for future research are discussed.

Design, development and assessment of the Java Intelligent Tutoring System

The "Java Intelligent Tutoring System" (JITS) research project focused on designing, constructing, and determining the effectiveness of an Intelligent Tutoring System for beginner Java programming students at the postsecondary level. The participants in this research were students in the School of Applied Computing and Engineering Sciences at Sheridan College. This research involved consistently gathering input from students and instructors using JITS as it developed. The cyclic process involving designing, developing, testing, and refinement was used for the construction of JITS to ensure that it adequately meets the needs of students and instructors. The second objective in this dissertation determined the effectiveness of learning within this environment. The main findings indicate that JITS is a richly interactive ITS that engages students on Java programming problems. JITS is equipped with a sophisticated personalized feedback mechanism that models and supports each student in his/her learning style. The assessment component involved 2 main quantitative experiments to determine the effectiveness of JITS in terms of student performance. In both experiments it was determined that a statistically significant difference was achieved between the control group and the experimental group (i.e., JITS group). The main effect for Test (i.e., pre- and postiest), F( l , 35) == 119.43,p < .001, was qualified by a Test by Group interaction, F( l , 35) == 4.98,p < .05, and a Test by Time interaction, F( l , 35) == 43.82, p < .001. Similar findings were found for the second experiment; Test by Group interaction revealed F( 1 , 92) == 5.36, p < .025. In both experiments the JITS groups outperformed the corresponding control groups at posttest.

Development of a New Assessment System to Evaluate Students' English Communicative Capacities in China

The purpose of this study was to develop a new English assessment system to evaluate Chinese students' English communicative capacities. Since there is more interaction with people from English-speaking countries, Chinese people attach more importance to English oral skills, and a lot of Western English teaching methods were introduced into China to improve students' English communicative capacities. However, traditional paper-written examinations, like the English test of higher education entry examination, cannot evaluate it effectively. This study explored the perceptions of two Chinese English-language teachers and two Chinese students about English assessment system. A qualitative research method using telephone interviews was conducted in this study. The findings showed that the most possible ways to assess Chinese students' English communicative capacities were paper-written examination and person-machine conversations, although measures should be taken to improve these two models. On the other hand, the model of person-person conversation was the ideal assessment tool but was hard to achieve at the current stage.

Towards the development of a questionnaire of post transgression motives and behaviours /

The primary purpose of this study was to develop a questionnaire that assesses both forgiveness-seeking motives and behaviours. This questionnaire was based on the premise that, following the commitment of an offense in the context of a relationship, a perpetrator will be motivated to reduce the damage that has taken place. The . ' questionnaire examined several motives that a perpetrator might have for seeking forgiveness. These motives were divided into five proposed domains of posttransgression concerns: God, Self, Victim, Others/Society, and Relationship. Within these domains, the following more specific types of concern were explored: Avoidance of punishment, concern about public image, emotional well-being, self-image, sense of fairness/justice, loss of relationship, loss or gain of power, and loss of ability to trust. The questionnaire also assessed which behaviours (approach and avoidance) a perpetrator might use in order to address these concerns. In addition, this study explored whether or not the severity of the situation and the personality of the perpetrator influenced post transgression motives and behaviours. Participants were 221 individuals from the community and Brock University. They filled out a questionnaire package that assessed personality traits, social desirability, and forgiveness-seeking motives and behaviours. In order to answer items assessing motives and behaviours, participants were asked to imagine themselves as perpetrators in three hypothetical transgression scenarios. These scenarios ranged in severity fi^om low to high. Participants were asked to rate their motives and behaviours both in an immediate time frame (immediately following the transgression) and in the long-term (in order to move on from the situation). Results indicated that the motivation items could be classified into the following subscales:Concern about God, Damaged Self-worth Concerns, Justice Concerns, Impression Management Concerns, Victim and Others Concerns, and Relationship Concerns. The behaviour items formed the following subscales: Approach, Avoidance, Denial and Hiding, and Groveling. Results also indicated differences in motivations and behaviours based on the severity of the situation as well as the personality (assessed using the HEXACO inventory) of the perpetrator.

Exploring the experiences of parents with children who have communication delays, as a population at risk for the development of behavioural concerns

Existing research identifies preschoolers with communication delays as a population at risk for the development of behavioural concerns. This risk increases when additional environmental factors such as parental stress and family conflict are also present. Research has also shown that behavioural concerns can be stable over time when they develop early. However, early intervention has been shown to be effective in addressing these concerns. The effectiveness of early intervention in addressing both child and family outcomes increases when interventions are delivered in a family-centred approach. This research project made use of data related to child behaviour and parenting, gathered through the Family Resource Project which explored the parenting experiences and resource access and allocation decisions of families who have preschool children with and without communication delays. Cluster analysis was used to explore whether there were identifiable clusters of children and families within each sample. Interview data fi"om each identified family cluster was then explored further, to identify how parents described their child's behaviour and their experience of parenting. Results show that, within this sample, parents of preschoolers with communication delays described their child's behaviour and their experience of parenting differently than did parents of children without communication delays. Results also showed that within this sample parents experiencing parental stress and/or family conflict described their child's behaviour and their experience of parenting differently than did parents from other clusters. Results suggest support for early intervention and the use of family-centred intervention, particularly for families of children with communication delays.

A social-cognitive model of monitoring and its relationship to behaviour in a naturalistic observation : development and individual differences

years 8 months) and 24 older (M == 7 years 4 months) children. A Monitoring Process Model (MPM) was developed and tested in order to ascertain at which component process ofthe MPM age differences would emerge. The MPM had four components: (1) assessment; (2) evaluation; (3) planning; and (4) behavioural control. The MPM was assessed directly using a referential communication task in which the children were asked to make a series of five Lego buildings (a baseline condition and one building for each MPM component). Children listened to instructions from one experimenter while a second experimenter in the room (a confederate) intetjected varying levels ofverbal feedback in order to assist the children and control the component ofthe MPM. This design allowed us to determine at which "stage" ofprocessing children would most likely have difficulty monitoring themselves in this social-cognitive task. Developmental differences were obselVed for the evaluation, planning and behavioural control components suggesting that older children were able to be more successful with the more explicit metacomponents. Interestingly, however, there was no age difference in terms ofLego task success in the baseline condition suggesting that without the intelVention ofthe confederate younger children monitored the task about as well as older children. This pattern ofresults indicates that the younger children were disrupted by the feedback rather than helped. On the other hand, the older children were able to incorporate the feedback offered by the confederate into a plan ofaction. Another aim ofthis study was to assess similar processing components to those investigated by the MPM Lego task in a more naturalistic observation. Together the use ofthe Lego Task ( a social cognitive task) and the naturalistic social interaction allowed for the appraisal of cross-domain continuities and discontinuities in monitoring behaviours. In this vein, analyses were undertaken in order to ascertain whether or not successful performance in the MPM Lego Task would predict cross-domain competence in the more naturalistic social interchange. Indeed, success in the two latter components ofthe MPM (planning and behavioural control) was related to overall competence in the naturalistic task. However, this cross-domain prediction was not evident for all levels ofthe naturalistic interchange suggesting that the nature ofthe feedback a child receives is an important determinant ofresponse competency. Individual difference measures reflecting the children's general cognitive capacity (Working Memory and Digit Span) and verbal ability (vocabulary) were also taken in an effort to account for more variance in the prediction oftask success. However, these individual difference measures did not serve to enhance the prediction oftask performance in either the Lego Task or the naturalistic task. Similarly, parental responses to questionnaires pertaining to their child's temperament and social experience also failed to increase prediction oftask performance. On-line measures ofthe children's engagement, positive affect and anxiety also failed to predict competence ratings.

Assessment done write : using collaboration to reculture teacher learning

This study examined the impact that collaborative learning had on the assessment and evaluation of writing practices of a group of teachers as they engaged in a community of learners. The study explored the development of teacher knowledge and perceptions as well as the implementation of effective assessment strategies in writing for students in grades 4 to 8 that could be achieved through collaboration. Teachers' perceptions of the value of collaboration were also embedded within the study. Multiple methods of data collection were used to gather rich and descriptive data. Those methods included interviews, observation, and documentation of meetings and of participants' perceptions of their assessment and evaluation practices. Five preexisting themes describing desired outcomes of change were used to analyze the data. These themes included: knowledge, attitude, skill, aspiration, and behaviour. While it was difficult to identify definitively the degree oflearning achieved by the participants, conclusions can be drawn that the participants experienced learning and some change in the areas of knowledge and skill, attitude, aspiration, and behaviour. What was notable was the continued belief on the part of the participants of the value of collaboration as a means of learning.

Investigating Multiple-Choice Assessment: Secondary School Teachers' Perceptions and Practices

Multiple-choice assessment is used within nearly all levels of education and is often heavily relied upon within both secondary and postsecondary institutions in determining a student’s present and future success. Understanding why it is effective or ineffective, how it is developed, and when it is or is not used by teachers can further inform teachers’ assessment practices, and subsequently, improve opportunities for student success. Twenty-eight teachers from 3 secondary schools in southern Ontario were interviewed about their perceptions and use of multiple-choice assessment and participated in a single-session introductory workshop on this topic. Perceptions and practices were revealed, discussed, and challenged through the use of a qualitative research method and examined alongside existing multiple-choice research. Discussion centered upon participants’ perspectives prior to and following their participation in the workshop. Implications related to future assessment practices and research in this field of assessment were presented. Findings indicated that many teachers utilized the multiple-choice form of assessment having had very little teacher education coursework or inservice professional development in the use of this format. The findings also revealed that teachers were receptive to training in this area but simply had not been exposed to or been given the opportunity to further develop their understanding. Participants generally agreed on its strengths (e.g., objectivity) and weaknesses (e.g., development difficulty). Participants were particularly interested in the potential for this assessment format to assess different levels of cognitive difficulty (i.e., levels beyond remembering of Bloom’s revised taxonomy), in addition to its potential to perhaps provide equitable means for assessing students of varying cultures, disabilities, and academic streams.

Globalization and Its Impact on Assessment: Moving Toward a New Story

Globalization has resulted in large-scale international and local assessments closely tied to notions of accountability and competitiveness in a globalized economy. Although policy makers seek to ensure citizens meet the demands of a global knowledge-based economy, such assessments may also impede the development of requisite 21st century skills. While standardization currently is viewed as the most effective measurement of student achievement, several Canadian and international jurisdictions are moving toward assessment for learning (AfL). This conceptual study sought to identify whether AfL or standardized assessment most effectively meets 21st century learning goals in the wake of rapid global change. It applies a Story Model theoretical framework to understand the current, the new emerging, and the future ideal story of education from a personal, cultural, and global lens. The study examines the main critiques and/or challenges of standardized testing, the benefits of AfL for student learning, and new teaching and assessment approaches to the development of 21st century learning goals. The study applies the Story Model’s inside-outside/past-future approach to determine the future direction of assessment. Results show that the new story of assessment will most likely entail a model that integrates both standardized testing and in-class assessments in the form of AfL and PBL.

Impact of a Youth Development Camp on Participants’ Skills, Attitudes, and Views Towards Science and Scientific Inquiry

This mixed-methods research study sought to determine the impact of an informal science camp—the Youth Science Inquiry Development Camp (YSIDC)—on participants’ science inquiry skills, through self-assessment, as well as their views and attitudes towards science and scientific inquiry. Pre and post data were collected using quantitative surveys (SPSI, CARS), a qualitative survey (VOSI-E), interviews, and researcher’s observations. Paired sample t-tests from the quantitative surveys revealed that the YSIDC positively impacted participants’ science inquiry skills and attitudes towards science. Interviews supported these findings and provided contextual reasons for these impacts. Implications from this research would suggest that informal and formal educational institutions can increase science inquiry skills and promote positive views and attitudes towards science and scientific inquiry by using non-competitive cooperative learning strategies with a mixture of guided and open inquiry. Suggested directions for further research include measuring science inquiry skills directly and conducting longitudinal studies to determine the lasting effects of informal and formal science programs.

Supporting social-cognitive development in the elementary years: The role of executive function and self-regulation

Every day we make decisions that have repercussions. Sometimes the effects are immediate and intended; other times the effects might be unintended or might not be apparent for years. As parents or educators, part of our role is to support the development of children’s decision-making skills, helping them to develop patterns of adaptive decision-making that will serve them well in their current lives and into the future. Part of successful decision-making involves self-control, a system served by the brain’s executive functions (EF). This involves the ability to put aside immediate reactions and base decisions on a variety of important considerations. Social-cognitive development, the ongoing improvement of the ability to get along with others and to understand others’ emotions, expressions, motivations, and intents, relies, to a large degree, on the same EF systems. The current paper explores the interaction of these two factors (the role of EF in social-cognitive development), explores the research to determine the most effective approaches to improving both factors, and develops a handbook providing activities for educators to use while supporting the growth of both EF and social-cognitive skills. Results of a needs assessment reveal that the majority (59%) of educators surveyed had never used a social skills improvement program in their classrooms, while a full 95% believed that social skills are important or very important for a student’s academic success.