Étude d’évaluabilité et évaluation des processus et des effets d’un programme de prévention de l’usage de substances psychoactives lors de la transition primaire-secondaire

La mise en œuvre d’activités de prévention de la consommation de substances psychoactives (SPA) (tabac, alcool et cannabis) en milieu scolaire est une stratégie couramment utilisée pour rejoindre un grand nombre de jeunes. Ces activités s’inspirent, soit de programmes existant, soit d’innovations dictées par le contexte d’implantation ou l’existence de données de recherche. Dans un cas comme dans l’autre, l’évaluation de ces programmes représente la meilleure voie pour mesurer leur efficacité et/ou connaître comment ceux-ci sont implantés. C’est cet impératif qui a motivé une commission scolaire du Québec a recommandé l’évaluation de l’Intervention en Réseau (IR), un programme développé en vue de retarder l’âge d’initiation et de réduire la consommation problématique de SPA chez les élèves. Ce programme adopte une approche novatrice avec pour principal animateur un intervenant pivot (IP) qui assure le suivi des élèves de la 5e année du primaire jusqu’en 3e secondaire. Inspiré des modèles en prévention de la santé et de l’Approche École en santé (AES), le rôle de l’IP ici se démarque de ceux-ci. Certes, il est l’interface entre les différents acteurs impliqués et les élèves mais dans le cadre du programme IR, l’IP est intégré dans les écoles primaires et secondaires qu’il dessert. C’est cet intervenant qui assure la mobilisation des autres acteurs pour la mise en œuvre des activités. Cette thèse vise à rendre compte de ce processus d’évaluation ainsi que des résultats obtenus. L’approche d’évaluation en est une de type participatif et collaboratif avec des données quantitatives et qualitatives recueillies par le biais de questionnaires, d’entrevues, de groupes de discussion, d’un journal de bord et de notes de réunions. Les données ont été analysées dans le cadre de trois articles dont le premier concerne l’étude d’évaluabilité (ÉÉ) du programme. Les participants de cette ÉÉ sont des acteurs-clés du programme (N=13) rencontrés en entrevues. Une analyse documentaire (rapports et journal de bord) a également été effectuée. Cette ÉÉ a permis de clarifier les intentions des initiateurs du programme et les objectifs poursuivis par ces derniers. Elle a également permis de rendre la théorie du programme plus explicite et de développer le modèle logique, deux éléments qui ont facilité les opérations d’évaluation qui ont suivi. Le deuxième article porte sur l’évaluation des processus en utilisant la théorie de l’acteur-réseau (TAR) à travers ses quatre moments du processus de traduction des innovations (la problématisation, l’intéressement, l’enrôlement et la mobilisation des alliés), l’analyse des controverses et du rôle des acteurs humains et non-humains. Après l’analyse des données obtenues par entrevues auprès de 19 informateurs-clés, les résultats montrent que les phases d’implantation du programme passent effectivement par les quatre moments de la TAR, que la gestion des controverses par la négociation et le soutien était nécessaire pour la mobilisation de certains acteurs humains. Cette évaluation des processus a également permis de mettre en évidence le rôle des acteurs non-humains dans le processus d’implantation du programme. Le dernier article concerne une évaluation combinée des effets (volet quantitatif) et des processus (volet qualitatif) du programme. Pour le volet quantitatif, un devis quasi-expérimental a été adopté et les données ont été colligées de façon longitudinale par questionnaires auprès de 901 élèves de 5e et 6e année du primaire et leurs enseignants de 2010 à 2014. L’analyse des données ont montré que le programme n’a pas eu d’effets sur l’accessibilité et les risques perçus, l’usage problématique d’alcool et la polyconsommation (alcool et cannabis) chez les participants. Par contre, les résultats suggèrent que le programme pourrait favoriser la réduction du niveau de consommation et retarder l’âge d’initiation à l’alcool et au cannabis. Ils suggèrent également un effet potentiellement positif du programme sur l’intoxication à l’alcool chez les élèves. Quant au volet qualitatif, il a été réalisé à l’aide d’entrevues avec les intervenants (N=17), de groupes de discussion avec des élèves du secondaire (N=10) et d’une analyse documentaire. Les résultats montrent que le programme bénéficie d’un préjugé favorable de la part des différents acteurs ayant participé à l’évaluation et est bien acceptée par ces derniers. Cependant, le roulement fréquent de personnel et le grand nombre d’écoles à suivre peuvent constituer des obstacles à la bonne marche du programme. En revanche, le leadership et le soutien des directions d’écoles, la collaboration des enseignants, les qualités de l’IP et la flexibilité de la mise en œuvre sont identifiés comme des éléments ayant contribué au succès du programme. Les résultats et leur implication pour les programmes et l’évaluation sont discutés. Enfin, un plan de transfert des connaissances issues de la recherche évaluative est proposé.

"Family Education and Support" program for families at psychosocial risk: the role of implementation process

This paper analyses the implementation characteristics of the Family Education and Support program, a theory-driven, needs-based, and evidence-based positive parenting program originally developed for the Andalusian family preservation services. The implementation process of 34 trials of the FAF program with 155 participants was analyzed. Cluster analyses were also performed to explore variability in implementation conditions from a comprehensive perspective. Results showed different implementation profiles that moderated the FAF effectiveness (namely lengthier interventions, higher program fidelity, and practitioners' positive perceptions and satisfaction with the program). The relevance of examining implementation process across several trials is discussed in order to distinguish core and non-core FAF components, as well as the need for combining faithful and adaptable implementations that guarantee the ecologic validity of evidence-based positive parenting programs.

The Spanish online program "Educar en Positivo" ("The Positive Parent"): whom does it benefit the most?

This study evaluated the Spanish online program 'Educar en Positivo' ("The Positive Parent") (http://educarenpositivo.es). Eighty-five users were surveyed to examine changes in views of online parenting support and satisfaction with the module completed, as a function of their sociodemographic profile, their level of experience with the Internet, and their general and educational use of Internet resources. Results showed that parents changed their views of online support, the benefits thereof, and their parenting skills. Participants reported high satisfaction with the program's usability, the module content, and their perception of parental self-efficacy. These findings are moderated by level of Internet experience and educational use of web-based resources, suggesting that improving parents' digital literacy and promoting Internet use may be an effective avenue for improving access to prevention resources. In sum, this program offers a space for Spanish-speaking parents to learn and exchange experiences, thereby filling a gap in ensuring the promotion of positive parenting in this large community of potential users.

Herramienta de evaluación para programas de inclusión en actividad física, recreación y deporte para personas con discapacidad en Colombia

Introducción: La evaluación de programas sociales, ha sido, desde sus inicios, de gran importancia para fortalecer los procesos de toma de decisiones de los hacedores de los programas, ya que retroalimenta lo ejecutado y ayuda a aplicar correctivos necesarios para lograr el impacto deseado en la población objetivo, que generalmente son comunidades vulnerables como las personas con discapacidad. En los últimos años, esta población ha sido foco de múltiples programas y proyectos en diferentes temáticas como la actividad física, la recreación, el deporte y la educación física. Por esto, en el año 2013, Coldeportes en aras de poder parametrizar y permitir un impacto adecuado en esta población, diseñó un grupo de lineamientos los cuales son los encargados de generar las directrices de los programas que se diseñen y ejecuten en los entes territoriales. Para poder realizar el seguimiento y resultado de su aplicación, es necesario hacerlo por intermedio de una herramienta de evaluación. De acuerdo con las últimas tendencias en la evaluación de programas sociales, debe hacerse por intermedio de indicadores, los cuales permiten realizarla de una manera más eficiente. Por tal motivo, la herramienta de evaluación para los lineamientos será a través de indicadores. Objetivo: Generar una herramienta de evaluación para los programas y actividades en actividad física, recreación y deporte para la población con discapacidad en Colombia, a partir de los lineamientos de inclusión definidos por Coldeportes. Metodología: Se realizó una revisión bibliográfica acerca de la evaluación de programas sociales, indicadores de evaluación y población con discapacidad, seguido a esto se diseñaron los indicadores de evaluación con base en las variables de los lineamientos propuestos por Coldeportes, posteriormente, los indicadores fueron sometidos a una validación en un grupo nominal, conformado por expertos en programas sociales y trabajo en población con discapacidad, por último, se sistematizaron y analizaron los resultados. iii Resultados: La herramienta de evaluación fue validada por parte de los expertos, hubo ajustes en los indicadores de evaluación de los lineamientos de accesibilidad a la comunicación e información, accesibilidad a la formación académica y accesibilidad al entorno físico. Conclusiones: La herramienta de evaluación diseñada, es un primer paso para mejorar los métodos actuales de evaluación, encaminada a fortalecer los datos existentes de la población con discapacidad y tener una visión del impacto de los planes, programas y proyectos en actividad física, recreación y deporte ejecutados en la actualidad, por lo cual queda continuar con la investigación en nuevas alternativas de evaluación que permitan mejorar los procesos de toma de decisiones y así garantizar planes, programas y proyectos sociales adecuados para la población, sin distinguir características particulares.

Critically evaluating rural women’s participation and empowerment : An interdisciplinary feminist framework for research and analysis

Community development is increasingly using participatory processes that aim to be inclusive and empowering. However, researchers have found that such processes can have contradictory effects. Australian research has highlighted the significant leadership of rural women in sustainable community and economic development and in the adoption of new communication technologies such as the Internet. A focus on gender in participatory development may therefore lead to more effective programs and policies. This chapter outlines an interdisciplinary feminist framework for critically evaluating the participation and empowerment of rural women. This framework was found effective in evaluating an Australian project that aimed to enhance rural women’s access to communication technologies and to empower its participants. Its multiple theoretical and methodological approaches are outlined. The framework advocates an analysis of diversity and difference and the macro and micro contexts. Some principles and strategies for rural women’s inclusion, participation, empowerment, and for participatory feminist evaluation are outlined.

Increasing the rigour and trustworthiness of participatory evaluations : learnings from the field

Participatory evaluation and participatory action research (PAR) are increasingly used in community-based programs and initiatives and there is a growing acknowledgement of their value. These methodologies focus more on knowledge generated and constructed through lived experience than through social science (Vanderplaat 1995). The scientific ideal of objectivity is usually rejected in favour of a holistic approach that acknowledges and takes into account the diverse perspectives, values and interpretations of participants and evaluation professionals. However, evaluation rigour need not be lost in this approach. Increasing the rigour and trustworthiness of participatory evaluations and PAR increases the likelihood that results are seen as credible and are used to continually improve programs and policies.----- Drawing on learnings and critical reflections about the use of feminist and participatory forms of evaluation and PAR over a 10-year period, significant sources of rigour identified include:----- • participation and communication methods that develop relations of mutual trust and open communication----- • using multiple theories and methodologies, multiple sources of data, and multiple methods of data collection----- • ongoing meta-evaluation and critical reflection----- • critically assessing the intended and unintended impacts of evaluations, using relevant theoretical models----- • using rigorous data analysis and reporting processes----- • participant reviews of evaluation case studies, impact assessments and reports.

Reconnect action research kit

This kit, designed for youth and family services and practitioners, provides an outline of action research, suggested strategies and tools for undertaking action research, as well as discussion of various challenges.

Troubling Empowerment : A feminist critique of a rural women and communication technology project

Participatory research methodologies and interactive communication technologies (ICTs) are increasingly seen as offering ways of enhancing women’s empowerment and rural community development. However, some researchers suggest the need for caution about such claims. This book details findings from an evaluation of a feminist action research project that explored the impacts of ICTs for rural women in Queensland, Australia, in terms of personal, business and community development. Using praxis and poststructuralist feminist theories and methodologies, this innovative study presents a rigorous analysis and critique of women's empowerment and participation. This study demonstrates the value of adopting a critical yet pragmatic approach that takes diversity and difference, power-knowledge relations, and the contradictory effects of participation into account. This is argued to enable the development of more effective strategies for women’s empowerment, participation and inclusion. This book should be of particular interest to researchers, postgraduate students, and others working in the fields of communication, gender, and rural development, and feminist evaluation and ethnography.

Using GIS to visualise and evaluate student travel behaviour

Using GIS to evaluate travel behaviour is an important technique to increase our understanding of the relationship between accessibility and transport demand. In this paper, the activity space concept was used to identify the nature of participation in activities (or lack of it) amongst a group of students using a 2 day travel-activity diary. Three different indicators such as the number of unique locations visited, average daily distance travelled, and average daily activity duration were used to measure the size of activity spaces. These indicators reflect levels of accessibility, personal mobility, and the extent of participation respectively. Multiple regression analyses were used to assess the impacts of students socio-economic status and the spatial characteristics of home location. Although no differences were found in the levels of accessibility and the extent of participation measures, home location with respect to a demand responsive transport (DRT) service was found to be the most important determinant of their mobility patterns. Despite being able to travel longer distances, students who live outside of the DRT service area were found to be temporally excluded from some opportunities. Student activity spaces were also visualised within a GIS environment and a spatial analysis was conducted to underpin the evaluation of the performance of the DRT. This approach was also used to identify the activity spaces of individuals that are geographically excluded from the service. Evaluation of these results indicated that although the service currently covers areas of high demand, 90% of the activity spaces remained un-served by the DRT service. Using this data six new routes were designed to meet the coverage goal of public transport based on a measure of network impedance based on inverse activity density. Following assessment of public transport service coverage, the study was extended using a Spatial Multi Criteria Evaluation (SMCE) technique to assess the effect of service provision on patronage.

The parents at playgroup research report : engaging families in supported playgroups

The past decade has seen increasing numbers of government programs funded to support vulnerable families with young children. Supported playgroups are one important strategy in Australia’s current family policies that are provided in all states and territories (ARTD, 2008). National policies have increasingly invested in family support programs, such as supported playgroups. Despite known challenges in engaging vulnerable families in support programs, little is known about the capacity of supported playgroups to effectively engage families to achieve desired outcomes. This project explores family patterns of attendance in supported playgroups and examines the extent to which parental characteristics and experiences of the playgroup explain variations in engagement. The findings can inform the delivery of other family support programs...

Ageing of people with an intellectual disability: Effective training for frontline workers

While the attainment of late life represents a significant achievement for people with an intellectual disability, increased life expectancy has resulted in growing concerns about the extent to which disability service providers are ready to meet the changing needs of increasing numbers of older people and facilitate their ongoing social inclusion. Training of frontline disability staff is widely accepted as an effective strategy for increasing organisational capacity to contribute to improved quality of life for people with an intellectual disability. The study identifies training needs analyses and 'ready-to-deliver' training programs for frontline disability services staff working with adults with an intellectual disability who are ageing, assesses whether the training programs contribute to improved quality of life outcomes for service users, and makes recommendations for future research and development of training for disability services staff who work with older people with intellectual disability.

The relationship between entertainment producers and higher education providers

Cameron, Verhoeven and Court have noted that many screen producers do not see their tertiary education as being beneficial to their careers. We hypothesise that Universities have traditionally not trained students in producing skills because of the division of labour between Faculties of Art and Faculties of Business; and because their focus on art rather than entertainment has downplayed the importance of producing. This article presents a SOTL (Scholarship of Teaching and Learning) whole-of-program evaluation of a new cross-Faculty Bachelor of Entertainment Industries at QUT, devoted to providing students with graduate attributes for producing including creative skills (understanding story, the aesthetics of entertainment, etc), business skills (business models, finance, marketing, etc) and legal skills (contracts, copyright, etc). Stakeholder evaluations suggest that entertainment producers are highly supportive of this new course.