Élaboration et expérimentation d’une approche d’évaluation des programmes axée sur l’accompagnement et l’utilisation des résultats

Cette recherche porte sur le thème de l’évaluation de programmes dans le réseau collégial et les défis qu’elle soulève en regard de son utilité. Plus précisément, nous abordons les difficultés posées par l’évaluation des programmes au Cégep de Saint-Jérôme et proposons une nouvelle approche permettant d’augmenter l’utilité de ce processus pour le personnel enseignant. Notre problématique s’articule principalement autour du fait que l’évaluation de programmes a été vécue par plusieurs membres du personnel enseignant comme une opération administrative, voire comme une opération de reddition de comptes. En lien avec l’adoption en 2008 d’une nouvelle politique institutionnelle d’évaluation des programmes (PIEP) au Cégep de Saint-Jérôme, nous montrons les limites du processus et des instruments d’évaluation de programmes associés. Nous nous concentrons ensuite sur les stratégies d’évaluation des apprentissages puisqu’elles constituent un aspect essentiel de l’évaluation des programmes et un levier important de changement en vue d’améliorer la qualité de leur mise en oeuvre. Notre question de recherche est la suivante: comment peut-on augmenter l’utilité de l’évaluation des programmes pour les enseignantes et les enseignants du Cégep de Saint-Jérôme? Notre cadre de référence dresse une présentation générale de l’évaluation de programmes, mais repose sur une approche de l’évaluation axée sur l’utilisation. Celle-ci s’avérait tout à fait pertinente compte tenu de notre question de recherche. La recension des écrits nous a permis d’élaborer un cadre d’intervention, à partir des travaux de Michael Quinn Patton, Jean A. King et Hallie Preskill. Notre cadre d’intervention circonscrit une démarche d’évaluation de programmes qui repose sur quatre critères d’utilité: le facteur personnel, l’utilisation attendue, la participation active et le renforcement des capacités en évaluation. De plus, il confère à la conseillère pédagogique, qui est aussi la chercheure, une posture d’accompagnement, définie à travers quatre rôles: consultante, animatrice, négociatrice et formatrice. Cette recherche poursuivait trois objectifs: utiliser concrètement notre cadre d’intervention dans l’évaluation d’un programme au Cégep de Saint-Jérôme, accompagner le personnel enseignant suivant un scénario découlant de notre cadre d’intervention et valider notre cadre d’intervention. Nos objectifs de recherche nécessitaient une méthodologie appropriée. Celle-ci repose sur une approche méthodologique qualitative, une posture épistémologique critique et un essai de type recherche intervention. Neuf participantes et participants ont pris part à la démarche d’évaluation de programmes que nous leur avons proposée. Les données ont été recueillies grâce à la technique de l’observation participante et la triangulation des méthodes de collecte de données a été utilisée afin d’assurer la rigueur de nos travaux. L’analyse de contenu nous a permis d’étudier les données recueillies au moyen d’une grille d’analyse élaborée à partir de catégories émergentes et d’autres issues de notre cadre de référence. La dimension éthique a également été au coeur de la collecte et de l’analyse de nos données. Nous avons d’ailleurs pris plusieurs précautions à cet effet. Les données obtenues nous ont permis de répondre à notre question de recherche en démontrant en quoi la démarche d’évaluation de programmes réalisée par nos participantes et nos participants a contribué à augmenter l’utilité de celle-ci pour le personnel enseignant, telle que définie dans notre cadre de référence. Cette démarche a permis au personnel enseignant d’augmenter sa participation et son intérêt à l’égard de l’évaluation de programmes ainsi que d’utiliser concrètement à court terme les résultats obtenus pour améliorer ses pratiques d’évaluation des apprentissages. Deux niveaux de participation ont été expérimentés. Dans le niveau le plus élevé, une partie des participantes et des participants a été regroupée au sein d’un groupe de travail, lequel a contribué à l’élaboration d’une grille d’analyse portant sur les stratégies d’évaluation des apprentissages. Cette grille a par la suite été expérimentée par l’ensemble des participantes et participants sur un échantillon de onze cours du programme pour lesquels elles et ils ont procédé à l’autoévaluation de leur propre matériel (copies d’examens, copies de grille d’évaluation, etc.). Un rapport d’évaluation a été produit à partir des grilles d’analyse complétées. Les données obtenues nous ont également permis de valider notre cadre d’intervention et de dégager plusieurs éléments facilitant la transférabilité des résultats obtenus. Nous pensons d’ailleurs que celui-ci constitue une avenue pertinente et utile pour le réseau collégial puisqu’il favorise l’utilisation des résultats à court terme par le personnel enseignant, développe la pensée évaluative du personnel enseignant et parce qu’il augmente la qualité et l’efficacité du processus. De plus, le modèle d’accompagnement du personnel enseignant que nous avons élaboré et expérimenté contribue à dépasser une approche basée sur la reddition de comptes ou la gestion administrative des programmes. À tout le moins, il s’agit d’une piste intéressante pour les conseillères et les conseillers pédagogiques qui ont à intervenir comme nous dans ce dossier.

Les facteurs affectant les taux de réussite des cours d’anglais et de sciences humaines des étudiants dans les programmes de formation technique

A large percentage of Vanier College's technology students do not attain their College degrees within the scheduled three years of their program. A closer investigation of the problem revealed that in many of these cases these students had completed all of their program professional courses but they had not completed all of the required English and/or Humanities courses. Fortunately, most of these students do extend their stay at the college for the one or more semesters required for graduation, although some choose to go on into the workforce without returning to complete the missing English and/or Humanities and without their College Degrees. The purpose of this research was to discover if there was any significant measure of association between a student's family linguistic background, family cultural background, high school average, and/or College English Placement Test results and his or her likelihood of succeeding in his or her English and/or Humanities courses within the scheduled three years of the program. Because of both demographic differences between 'hard' and 'soft' technologies, including student population, more specifically gender ratios and student average ages in specific programs; and program differences, including program writing requirements and types of practical skill activities required; in order to have a more uniform sample, the research was limited to the hard technologies where students work hands-on with hardware and/or computers and tend to have overall low research and writing requirements. Based on a review of current literature and observations made in one of the hard technology programs at Vanier College, eight research questions were developed. These questions were designed to examine different aspects of success in the English and Humanities courses such as failure and completion rates and the number of courses remaining after the end of the fifth semester and as well examine how the students assessed their ability to communicate in English. The eight research questions were broken down into a total of 54 hypotheses. The high number of hypotheses was required to address a total of seven independent variables: primary home language, high school language of instruction, student's place of birth (Canada, Not-Canada), student's parents' place of birth (Both-born-in-Canada, Not-both-born-in-Canada), high school averages and English placement level (as a result of the College English Entry Test); and eleven dependent variables: number of English completed, number of English failed, whether all English were completed by the end of the 5th semester (yes, no), number of Humanities courses completed, number of Humanities courses failed, whether all the Humanities courses were completed by the end of the 5th semester (yes, no), the total number of English and Humanities courses left, and the students' assessments of their ability to speak, read and write in English. The data required to address the hypotheses were collected from two sources, from the students themselves and from the College. Fifth and sixth semester students from Building Engineering Systems, Computer and Digital Systems, Computer Science and Industrial Electronics Technology Programs were surveyed to collect personal information including family cultural and linguistic history and current language usages, high school language of instruction, perceived fluency in speaking, reading and writing in English and perceived difficulty in completing English and Humanities courses. The College was able to provide current academic information on each of the students, including copies of college program planners and transcripts, and high school transcripts for students who attended a high school in Quebec. Quantitative analyses were done on the data using the SPSS statistical analysis program. Of the fifty-four hypotheses analysed, in fourteen cases the results supported the research hypotheses, in the forty other cases the null hypotheses had to be accepted. One of the findings was that there was a strong significant association between a student's primary home language and place of birth and his or her perception of his or her ability to communicate in English (speak, read, and write) signifying that both students whose primary home language was not English and students who were not born in Canada, considered themselves, on average, to be weaker in these skills than did students whose primary home language was English. Although this finding was noteworthy, the two most significant findings were the association found between a student's English entry placement level and the number of English courses failed and the association between the parents' place of birth and the student's likelihood of succeeding in both his or her English and Humanities courses. According to the research results, the mean number of English courses failed, on average, by students placed in the lowest entry level of College English was significantly different from the number of English courses failed by students placed in any of the other entry level English courses. In this sample students who were placed in the lowest entry level of College English failed, on average, at least three times as many English courses as those placed in any of the other English entry level courses. These results are significant enough that they will be brought to the attention of the appropriate College administration. The results of this research also appeared to indicate that the most significant determining factor in a student's likelihood of completing his or her English and Humanities courses is his or her parents' place of birth (both-born-in-Canada or not-both-born-in-Canada). Students who had at least one parent who was not born in Canada, would, on average, fail a significantly higher number of English courses, be significantly more likely to still have at least one English course left to complete by the end of the 5th semester, fail a significantly higher number of Humanities courses, be significantly more likely to still have at least one Humanities course to complete by the end of the 5th semester and have significantly more combined English and Humanities courses to complete at the end of their 5th semester than students with both parents born in Canada. This strong association between students' parents' place of birth and their likelihood of succeeding in their English and Humanities courses within the three years of their program appears to indicate that acculturation may be a more significant factor than either language or high school averages, for which no significant association was found for any of the English and Humanities related dependent variables. Although the sample size for this research was only 60 students and more research needs to be conducted in this area, to see if these results are supported with other groups within the College, these results are still significant. If the College can identify, at admission, the students who will be more likely to have difficulty in completing their English and Humanities courses, the College will now have the opportunity to intercede during or before the first semester, and offer these students the support they require in order to increase their chances of success in their education, whether it be classes or courses designed to meet their specific needs, special mentoring, tutoring or other forms of support. With the necessary support, the identified students will have a greater opportunity of successfully completing their programs within the scheduled three years, while at the same time the College will have improved its capacity to meeting the needs of its students.

Educational Intervention Project "R.E.D. Bull(ying)"

Introduction: Adolescence is a stage of life cycle marked by various physical, psychological and social changes. During this stage, young people are faced with the feeling of threat of identity, which may trigger aggressive behaviours. Bullying is a form of school violence with high prevalence, that shouldn't be a "normal" occurrence or a event that young people should experience during the transition between childhood and adolescent. In order to reduce the prevalence of bullying in the school community, we elaborated the Educational Intervention Project "R.E.D. BULL(ying)", with the specific objectives: Evaluate the knowledge level about bullyng, before and after the Project, and increase the level of literacy about the subject in the school community (students and teachers). Methodology: Our target population consisted in a total of 203 students from 5th to 9th grade and 13 teachers of school. It's a cross-sectional study of research - action, with the application of a diagnostic questionnaire, before and after, we conducted the educational sessions. Results: After the educational sessions, 93,1% of students identified what to do in a bullying situation, and 62,6% of students responded that in an assault situation, called an adult; 95,1% said they knew what was bullying, 56,8% associated the concept to physical aggression and 92,6 % mentioned to know the types of bullying, and physical bullying (71,9%) and verbal bullying (69,5%) were the most mentioned types. Meanwhile, the teachers: 76,9% considered that the school environment was pleasant, 84,6% characterized the relationship between the students as "adequate" and 77% said they didn't experience any bullying situation. Conclusions: We found an overall improvement to the level of bullying related knowledge after the educational intervention. So, we verified that the integrated intervention in the school health teams, allows greater attention to the detection, signalling and routing situations of violence.

EDUCATIONAL INTERVENTION PROJECT "R.E.D. BULL(YING)"

Introduction: Adolescence is a stage of life cycle marked by various physical, psychological and social changes. During this stage, young people are faced with the feeling of threat of identity, which may trigger aggressive behaviours. Bullying is a form of school violence with high prevalence, that shouldn't be a "normal" occurrence or a event that young people should experience during the transition between childhood and adolescent. In order to reduce the prevalence of bullying in the school community, we elaborated the Educational Intervention Project "R.E.D. BULL(ying)", with the specific objectives: Evaluate the knowledge level about bullyng, before and after the Project, and increase the level of literacy about the subject in the school community (students and teachers). Methodology: Our target population consisted in a total of 203 students from 5th to 9th grade and 13 teachers of school. It's a cross-sectional study of research - action, with the application of a diagnostic questionnaire, before and after, we conducted the educational sessions. Results: After the educational sessions, 93,1% of students identified what to do in a bullying situation, and 62,6% of students responded that in an assault situation, called an adult; 95,1% said they knew what was bullying, 56,8% associated the concept to physical aggression and 92,6 % mentioned to know the types of bullying, and physical bullying (71,9%) and verbal bullying (69,5%) were the most mentioned types. Meanwhile, the teachers: 76,9% considered that the school environment was pleasant, 84,6% characterized the relationship between the students as "adequate" and 77% said they didn't experience any bullying situation. Conclusions: We found an overall improvement to the level of bullying related knowledge after the educational intervention. So, we verified that the integrated intervention in the school health teams, allows greater attention to the detection, signalling and routing situations of violence.

Life Design Counseling Group Intervention With Portuguese Adolescents

This article examines the process and outcome of a life design counseling group intervention with students in Grades 9 and 12. First, we applied a quasi-experimental methodology to analyze the intervention’s effectiveness in promoting career certainty, career decision-making, self-efficacy, and career adaptability in a sample of 236 students. Second, focus groups comprising 33 participants were conducted, examining participants’ perceptions of the intervention process and outcome. Our findings showed that the intervention had a significant effect on both career certainty and career self-efficacy, but it had no effect on career adaptability. Our results also showed that My Career Story (MCS) had a stronger effect on Grade 12 students. Focus group participants reported on the usefulness of MCS, as well as on its benefits, which include increased information as well as a sense of direction, self-discovery, connection, and increased self-awareness. Grade 9 participants expressed more difficulties in narrating self-experience than Grade 12 participants did. Implications for future research and practice are discussed.

An intervention program for children with school failure problems.

School failure is a chronic problem in many developing countries and in some developed as Portugal due to factors like cognitive deficiencies of children, an inadequate family environment, low SES and bad teaching methods or school organization. It is important to develop effective and simple intervention strategies able to cope with the problem at an individual level independently of the cause. The general objective of the following study is to develop behavioral training techniques to help children with problems of school failure. 6 - 12 years old children attending ISCED 1, with academic difficulties because of family problems, social exclusion (living in poverty or belonging to an ethnic minority) or poor schooling were trained. Cognitive-behavioral techniques that have been widely used to train persons with intellectual, sensorial, physical or social deficiencies were applied. Results are evaluated in terms of % of attained objectives, time, and (subjective) teacher satisfaction. Some results of individual children are shown. Training programs seem to be successful independently of the (mostly unknown) cause of failure of the trained subject.

Searching for best practices to build an inclusive intervention. The international project ENABLIN+ aproach

The project ENABLIN+ is an international partnership for the period of 01/01/2014 to 31/12/2016. It's addressed to the needs of children and youth with complex and intense support needs (CISN), their caregivers and supporters. It wants to develop a system of interdisciplinary in-service training, where professionals and parents of various professional backgrounds learn together, with the aim of improving inclusion, promoting de-institutionalization and enhancing quality of life of the children with CISN, at various age levels. ENABLIN+ promotes an inclusive intervention, not only in social life, but also in education. In this context, this work aims to present and discuss the concept of “best practices” in inclusive intervention based in real world cases. To study that subject we prepare a seminar, where 12 cases of “best practices” in inclusive intervention was presented.

Cross-correlations between weather variables in Australia

The information on climate variations is essential for the research of many subjects, such as the performance of buildings and agricultural production. However, recorded meteorological data are often incomplete. There may be a limited number of locations recorded, while the number of recorded climatic variables and the time intervals can also be inadequate. Therefore, the hourly data of key weather parameters as required by many building simulation programmes are typically not readily available. To overcome this gap in measured information, several empirical methods and weather data generators have been developed. They generally employ statistical analysis techniques to model the variations of individual climatic variables, while the possible interactions between different weather parameters are largely ignored. Based on a statistical analysis of 10 years historical hourly climatic data over all capital cities in Australia, this paper reports on the finding of strong correlations between several specific weather variables. It is found that there are strong linear correlations between the hourly variations of global solar irradiation (GSI) and dry bulb temperature (DBT), and between the hourly variations of DBT and relative humidity (RH). With an increase in GSI, DBT would generally increase, while the RH tends to decrease. However, no such a clear correlation can be found between the DBT and atmospheric pressure (P), and between the DBT and wind speed. These findings will be useful for the research and practice in building performance simulation.

Reducing the global burden of depression : population level analysis of intervention cost-effectiveness in 14 world regions

International evidence on the cost and effects of interventions for reducing the global burden of depression remain scarce. Aims: To estimate the population-level cost-effectiveness of evidence-based depression interventions and their contribution towards reducing current burden. Method: Primary-care-based depression interventions were modelled at the level of whole populations in 14 epidemiological subregions of the world. Total population-level costs (in international dollars or I$) and effectiveness (disability adjusted life years (DALYs) averted) were combined to form average and incremental cost-effectiveness ratios. Results: Evaluated interventions have the potential to reduce the current burden of depression by 10–30%. Pharmacotherapy with older antidepressant drugs, with or without proactive collaborative care, are currently more cost-effective strategies than those using newer antidepressants, particularly in lower-income subregions. Conclusions: Even in resource-poor regions, each DALYaverted by efficient depression treatments in primary care costs less than 1 year of average per capita income, making such interventions a cost-effective use of health resources. However, current levels of burden can only be reduced significantlyif there is a substantialincrease substantial increase intreatment coverage.