PANA V : Evaluation of a Literacy Project

PANA V Evaluation of a Literacy ProjectSUMMARY AND CONCLUSIONSThis evaluation set out to explore the impact of the literacy work carried out through PANA V. It focussed on clarifying effects such as empowerment and poverty reduction in relation to the civil society. Two specific objectives were to evaluate the methodological approach and the didactic materials and to evaluate the sustainability of the project.Although the focus of the evaluation has been PANA V, the project has been evaluated in its context, as one in a series of five projects located in Rwanda ten years after the war and genocide. The conclusion will consider future plans in this field.The evaluator has striven to create a holistic picture of the effects of the project, although the given time for the evaluation was short. Only three weeks were spent in the field study and only ten days in the actual field. Although there were some organisational and logistic problems, as is common when carrying out a study like this in a poor country, many literacy sites were visited and quite many participators were interviewed. The overall impression from the study is overwhelmingly positive. So many people commit themselves in this task of teaching Rwandans reading, writing and numeracy. Despite harsh conditions learners strive to learn and group leaders devote themselves to the task. Many leaders on different levels try their very best to manage their difficult and demanding task. The main objective was to explore the impact of the project on poverty reduction, particularly on empowerment and strategies for everyday life. Women were to be regarded particularly. From the results it is clear that the project has a strong, positive impact both on poverty reduction and empowerment of marginalised groups. Among those who have benefited from the alphabetisation are mainly women. Unfortunately, when it comes to leaders in PANA, who may also be said to have benefited from the project, only a small minority is women. This is something that is recommended that it be reconsidered inside the organisation. As a majority of the targeted learners are women, and as the economic and social situation of women in Rwanda is generally weak, this is a question that I recommend the Pentesostal church and ADEPR to look particularly into. With many women being single breadwinners of their households, it is important that also women get access to positions that may bring benefits of different kind.It is also clear that the project has positive effects for the civil society. In the present situation in Rwanda, during the process of reconciliation and rapid progress, basic education for the poor majority is a democratic issue. In a country with a plethora of internet-cafés in the capital and a small minority that use cars and mobile-telephones to communicate nation-wide, it is of outmost importance that the majority acquires basic education, of which literacy is a central part. To strengthen the civil society in Rwanda literacy is important. One central issue is then that Rwanda develops toward becoming a country where literacy is used for the benefit of the citizens and it is a democratic issue that all citizens get an opportunity to participate. Crucial for this is that strong efforts are put into primary schools nation-wide. Literacy projects for adults, like PANA, may only complement these efforts, but they constitute important and necessary complements. Other relevant ways to promote literacy are campaigns in Radio and TV and through cultural events such as festivals, music and theatre. News papers, magazines and books are natural parts of such campaigns as well as adult education. As stated under the results not much can be said about the didactics in this evaluation. On the whole the methodology and the materials fill their function well and receive a high reputation. As people learn to read and write under very simple conditions, obviously the approach is appropriate. A few suggestions may be given from the study:•Focus groups leaders’ attention on clearness, that they show very clearly what is to be read. Good structuring is probably of great importance for many learners.•Make clear what is tested in the tests and consider the possibility to use a holistic test that would be more congruent with the methodology. The possibility to use only one grade, pass, would enable a more practical test, such as reading a short, relevant text, writing something relevant and solving practical mathematic problems. Avoid tests that demand school knowledge.•Avoid using methaphors such as “fight against illiteracy” and connections between illiteracy/literacy and darkness/light. It is not true that illiteracy causes bad things and that literacy only brings good. •Be prepared that it may be more difficult in the future to achieve the goals as it may be the case that the early learners where the ones who achieved easily. The goal of “literacy in six month” in PANA will probably hold only for some learners but also those who do not manage in six months need literacy skills.A third objective was to secure sustainability. As for sustainability of the project in itself, and of the literacy process, the main conclusion is that there is a good potential. The commitment and devotedness among many involved in PANA proves good. One weakness is individual leaders in ADEPR who do not see this as an important task for the Pentecostal church in Rwanda. Other weaknesses are the unwillingness to mention explicitly the wish, for example among group leaders, to get some kind of incentive and the fear of loosing believers by cooperation with other organisations. A higher degree of transparency in this issue would probably solve some irritations and tensions.As for the sustainability of the literacy skills much may be done to improve. The acquired skills seem to be comparably relevant. The level achieved, and the level tested, may be defined as basic literacy skills, consisting of basic reading, writing and numeracy skills. However, these skills are very restricted and there is a high risk that the skills will decline, which means that there is a high risk that people will forget how to read and write because of lack of exercising. From these conclusions a few suggestions for future development will be given.

Process evaluation of a knowledge translation intervention using facilitation of local stakeholder groups to improve neonatal survival in the Quang Ninh province, Vietnam

BACKGROUND: Annually, 2.8 million neonatal deaths occur worldwide, despite the fact that three-quarters of them could be prevented if available evidence-based interventions were used. Facilitation of community groups has been recognized as a promising method to translate knowledge into practice. In northern Vietnam, the Neonatal Health - Knowledge Into Practice trial evaluated facilitation of community groups (2008-2011) and succeeded in reducing the neonatal mortality rate (adjusted odds ratio, 0.51; 95 % confidence interval 0.30-0.89). The aim of this paper is to report on the process (implementation and mechanism of impact) of this intervention. METHODS: Process data were excerpted from diary information from meetings with facilitators and intervention groups, and from supervisor records of monthly meetings with facilitators. Data were analyzed using descriptive statistics. An evaluation including attributes and skills of facilitators (e.g., group management, communication, and commitment) was performed at the end of the intervention using a six-item instrument. Odds ratios were analyzed, adjusted for cluster randomization using general linear mixed models. RESULTS: To ensure eight active facilitators over 3 years, 11 Women's Union representatives were recruited and trained. Of the 44 intervention groups, composed of health staff and commune stakeholders, 43 completed their activities until the end of the study. In total, 95 % (n = 1508) of the intended monthly meetings with an intervention group and a facilitator were conducted. The overall attendance of intervention group members was 86 %. The groups identified 32 unique problems and implemented 39 unique actions. The identified problems targeted health issues concerning both women and neonates. Actions implemented were mainly communication activities. Communes supported by a group with a facilitator who was rated high on attributes and skills (n = 27) had lower odds of neonatal mortality (odds ratio, 0.37; 95 % confidence interval, 0.19-0.73) than control communes (n = 46). CONCLUSIONS: This evaluation identified several factors that might have influenced the outcomes of the trial: continuity of intervention groups' work, adequate attributes and skills of facilitators, and targeting problems along a continuum of care. Such factors are important to consider in scaling-up efforts.

Developing leadership in managers to facilitate the implementation of national guideline recommendations : a process evaluation of feasibility and usefulness

Background: Previous research supports the claim that managers are vital players in the implementation of clinical practice guidelines (CPGs), yet little is known about interventions aiming to develop managers’ leadership in facilitating implementation. In this pilot study, process evaluation was employed to study the feasibility and usefulness of a leadership intervention by exploring the intervention’s potential to support managers in the implementation of national guideline recommendations for stroke care in outpatient rehabilitation. Methods: Eleven senior and frontline managers from five outpatient stroke rehabilitation centers participated in a four-month leadership intervention that included workshops, seminars, and teleconferences. The focus was on developing knowledge and skills to enhance the implementation of CPG recommendations, with a particular focus on leadership behaviors. Each dyad of managers was assigned to develop a leadership plan with specific goals and leadership behaviors for implementing three rehabilitation recommendations. Feasibility and usefulness were explored through observations and interviews with the managers and staff members prior to the intervention, and then one month and one year after the intervention. Results: Managers considered the intervention beneficial, particularly the participation of both senior and frontline managers and the focus on leadership knowledge and skills for implementing CPG recommendations. All the managers developed a leadership plan, but only two units identified goals specific to implementing the three stroke rehabilitation recommendations. Of these, only one identified leadership behaviors that support implementation. Conclusion: Managers found that the intervention was delivered in a feasible way and appreciated the focus on leadership to facilitate implementation. However, the intervention appeared to have limited impact on managers’ behaviors or clinical practice at the units. Future interventions directed towards managers should have a stronger focus on developing leadership skills and behaviors to tailor implementation plans and support implementation of CPG recommendations.