NAVET's Boxes - an Evaluation of the Post-Visit Loan Service at a Science Centre in Borås

Many pedagogues believe science centres to be a good complement to the more formal school teaching. For a visit to a science centre to be as educational as possible, there is a need for pre-visit information of some sort, a guided visit, and post-visit work. Many science centres offer loan services of different kinds. At Navet, a science centre in Borås, teachers can borrow boxes with experiments connected to the different themes they provide. The experiments are supposed to be a continuation of the visit and help settle the knowledge gained during the visit. This thesis is an evaluation of how the boxes function in the schools, and what the teachers think of them. The study was conducted through questionnaires and interviews with both teachers and the staff at Navet. The results of the study are very positive. Many teachers have been involved with Navet from the very beginning and they see a visit to Navet as an integrated part of their teaching. Some boxes work better than others and some might need clearer information, but overall the teachers see the boxes as timesavers, as a way to vary their teaching more easily, and as a help for teachers not specialized in mathematics and science.

Tapping into Floor Staff: Using the knowledge of floor staff to conduct formative evaluations of exhibits in a Canadian science centre

Most science centres in Canada employ science-educated floor staff to motivate visitorsto have fun while enhancing the educational reach of the exhibits. Although bright andsensitive to visitors’ needs, floor staff are rarely consulted in the planning,implementation, and modification phases of an exhibit. Instead, many developmentteams rely on costly third-party evaluations or skip the front-end and formativeevaluations all together, leading to costly errors that could have been avoided. This studywill seek to reveal a correlation between floor staff’s perception of visitors’ interactionswith an exhibit and visitors’ actual experiences. If a correlation exists, a recommendationcould be made to encourage planning teams to include floor staff in the formative andsummative evaluations of an exhibit. This is especially relevant to science centres withlimited budgets and for whom a divide exists between floor staff and management.In this study, a formative evaluation of one exhibit was conducted, measuring both floorstaff’s perceptions of the visitor experience and visitors’ own perceptions of the exhibit.Floor staff were then trained on visitor evaluation methods. A week later, floor staff andvisitors were surveyed a second time on a different exhibit to determine whether anincrease in accuracy existed.The training session increased the specificity of the motivation and comprehensionresponses and the enthusiasm of the staff, but not their ability to predict observedbehaviours with respect to ergonomics, learning indicators, holding power, and successrates. The results revealed that although floor staff underestimated visitors’ success ratesat the exhibits, staff accurately predicted visitors’ behaviours with respect to holdingpower, ergonomics, learning indicators, motivation and comprehension, both before andafter the staff training.

Process evaluation of a knowledge translation intervention using facilitation of local stakeholder groups to improve neonatal survival in the Quang Ninh province, Vietnam

BACKGROUND: Annually, 2.8 million neonatal deaths occur worldwide, despite the fact that three-quarters of them could be prevented if available evidence-based interventions were used. Facilitation of community groups has been recognized as a promising method to translate knowledge into practice. In northern Vietnam, the Neonatal Health - Knowledge Into Practice trial evaluated facilitation of community groups (2008-2011) and succeeded in reducing the neonatal mortality rate (adjusted odds ratio, 0.51; 95 % confidence interval 0.30-0.89). The aim of this paper is to report on the process (implementation and mechanism of impact) of this intervention. METHODS: Process data were excerpted from diary information from meetings with facilitators and intervention groups, and from supervisor records of monthly meetings with facilitators. Data were analyzed using descriptive statistics. An evaluation including attributes and skills of facilitators (e.g., group management, communication, and commitment) was performed at the end of the intervention using a six-item instrument. Odds ratios were analyzed, adjusted for cluster randomization using general linear mixed models. RESULTS: To ensure eight active facilitators over 3 years, 11 Women's Union representatives were recruited and trained. Of the 44 intervention groups, composed of health staff and commune stakeholders, 43 completed their activities until the end of the study. In total, 95 % (n = 1508) of the intended monthly meetings with an intervention group and a facilitator were conducted. The overall attendance of intervention group members was 86 %. The groups identified 32 unique problems and implemented 39 unique actions. The identified problems targeted health issues concerning both women and neonates. Actions implemented were mainly communication activities. Communes supported by a group with a facilitator who was rated high on attributes and skills (n = 27) had lower odds of neonatal mortality (odds ratio, 0.37; 95 % confidence interval, 0.19-0.73) than control communes (n = 46). CONCLUSIONS: This evaluation identified several factors that might have influenced the outcomes of the trial: continuity of intervention groups' work, adequate attributes and skills of facilitators, and targeting problems along a continuum of care. Such factors are important to consider in scaling-up efforts.

Developing leadership in managers to facilitate the implementation of national guideline recommendations : a process evaluation of feasibility and usefulness

Background: Previous research supports the claim that managers are vital players in the implementation of clinical practice guidelines (CPGs), yet little is known about interventions aiming to develop managers’ leadership in facilitating implementation. In this pilot study, process evaluation was employed to study the feasibility and usefulness of a leadership intervention by exploring the intervention’s potential to support managers in the implementation of national guideline recommendations for stroke care in outpatient rehabilitation. Methods: Eleven senior and frontline managers from five outpatient stroke rehabilitation centers participated in a four-month leadership intervention that included workshops, seminars, and teleconferences. The focus was on developing knowledge and skills to enhance the implementation of CPG recommendations, with a particular focus on leadership behaviors. Each dyad of managers was assigned to develop a leadership plan with specific goals and leadership behaviors for implementing three rehabilitation recommendations. Feasibility and usefulness were explored through observations and interviews with the managers and staff members prior to the intervention, and then one month and one year after the intervention. Results: Managers considered the intervention beneficial, particularly the participation of both senior and frontline managers and the focus on leadership knowledge and skills for implementing CPG recommendations. All the managers developed a leadership plan, but only two units identified goals specific to implementing the three stroke rehabilitation recommendations. Of these, only one identified leadership behaviors that support implementation. Conclusion: Managers found that the intervention was delivered in a feasible way and appreciated the focus on leadership to facilitate implementation. However, the intervention appeared to have limited impact on managers’ behaviors or clinical practice at the units. Future interventions directed towards managers should have a stronger focus on developing leadership skills and behaviors to tailor implementation plans and support implementation of CPG recommendations.