'Motor magic' : evaluation of a community capacity-building approach to supporting the development of preschool children (part 2)

Background and Aims: This paper is the second in a series of two that presents and discusses an exploratory evaluation study of the 'Motor Magic' program conducted in Adelaide, South Australia.

Methods: A realist evaluation approach was used, and two focus groups (one with parents and one with kindergarten staff) were held to identify program outcomes and to develop and refine key hypotheses about how these outcomes occurred.

Results and Conclusions: Results for kindergarten staff involved in the program are presented and discussed in this paper, including improved early identification and early intervention for children with, or at risk of, fine motor developmental difficulties; increased confidence in the effectiveness of their practice with these children; improved practice of kindergarten staff with both targeted and all children; improved empathy with, and support for, parents; and increased interagency links and ongoing advocacy for further resources. These results suggest that the program provides an effective model for building the capacity of kindergarten staff to support children with, or at risk of, developmental difficulties.

Development, implementation and evaluation of a clinical research engagement and leadership capacity building program in a large Australian health care service

BACKGROUND: Health professionals need to be integrated more effectively in clinical research to ensure that research addresses clinical needs and provides practical solutions at the coal face of care. In light of limited evidence on how best to achieve this, evaluation of strategies to introduce, adapt and sustain evidence-based practices across different populations and settings is required. This project aims to address this gap through the co-design, development, implementation, evaluation, refinement and ultimately scale-up of a clinical research engagement and leadership capacity building program in a clinical setting with little to no co-ordinated approach to clinical research engagement and education.

METHODS/DESIGN: The protocol is based on principles of research capacity building and on a six-step framework, which have previously led to successful implementation and long-term sustainability. A mixed methods study design will be used. Methods will include: (1) a review of the literature about strategies that engage health professionals in research through capacity building and/or education in research methods; (2) a review of existing local research education and support elements; (3) a needs assessment in the local clinical setting, including an online cross-sectional survey and semi-structured interviews; (4) co-design and development of an educational and support program; (5) implementation of the program in the clinical environment; and (6) pre- and post-implementation evaluation and ultimately program scale-up. The evaluation focuses on research activity and knowledge, attitudes and preferences about clinical research, evidence-based practice and leadership and post implementation, about their satisfaction with the program. The investigators will evaluate the feasibility and effect of the program according to capacity building measures and will revise where appropriate prior to scale-up.

DISCUSSION: It is anticipated that this clinical research engagement and leadership capacity building program will enable and enhance clinically relevant research to be led and conducted by health professionals in the health setting. This approach will also encourage identification of areas of clinical uncertainty and need that can be addressed through clinical research within the health setting.

Evaluation report national training workshop on capacity-building for the collection of data

.--A. Introduction.--B. Summary of evaluation.

Evaluation report of the national training workshop on capacity-building for the production of reliable disaggregated data

.--A. Introduction.--B. Summary of evaluation.

Meta-evaluation to improve learning, evaluation capacity development and sustainability : Findings from a participatory evaluation project in Nepal

Recent studies suggest that meta-evaluation can be valuable in developing new approaches to evaluation, building evaluation capacities, and enhancing organizational learning. These new extensions of the concept of meta-evaluation are significant, given the growing emphasis on improving the quality and effectiveness of evaluation practices in the South Asian region. Following a review of the literature, this paper presents a case study of the use of concurrent meta-evaluation in the four-year project Assessing Communication for Social Change which developed and trialled a participatory impact assessment methodology in collaboration with a development communication Non-government organization (NGO) in Nepal. Key objectives of the meta-evaluation included to: continuously develop, adapt and improve the impact assessment methodology, Monitoring and Evaluation (M&E) systems and process and other project activities; identify impacts of the project; and build capacities in critical reflection and review. Our analysis indicates that this meta-evaluation was essential to understanding various constraints related to the organizational context that affected the success of the project and the development of improved M&E systems and capacities within the NGO. We identified several limitations of our meta-evaluation methods, which were balanced by the strengths of other methods. Our case study suggests that as well as assessing the quality, credibility and value of evaluation practices, meta-evaluations need to focus on important contextual issues that can have significant impacts on the outcomes of participatory evaluation projects. They include hierarchical organizational cultures, communication barriers, power/knowledge relations, and the time and resources available. Meta-evaluations also need to consider wider issues such as the sustainability of evaluation systems and approaches.

From 'what' to 'how' : capacity building in health promotion for HIV/AIDS prevention in the Solomon Islands

This paper describes a capacity building process undertaken within the HIV/AIDS prevention project of the Adventist Development and Relief Agency (ADRA) in the Solomon Islands. ADRA HIV/AIDS has recently reoriented its project structure, moving beyond its awareness raising approach to incorporate health promotion frameworks, theories, strategies and assumptions. These have been used to inform project practice in project planning, delivery and evaluation. This paper shares what has worked and not worked in the capacity building process, including a project evaluation of the initial HIV/AIDS awareness raising project and the application of a number of capacity building strategies, including utilising a volunteer Australian Youth Ambassador for Development (AYAD) funded by the Australian Agency for International Development (AusAID). Existing and new projects are outlined. The underlying theme is that any capacity building exercise must include structural support (e.g. management, national frameworks) to ensure the incorporation of new initiatives and approaches. With time this enables ownership by counterparts and external partnerships to develop. The presence of an AYAD volunteer has been an effective strategy to achieve this. Reflections from the evaluators, the AYAD volunteer and the HIV/AIDS team are included.

Road safety knowledge exchange and capacity building between China and Australia

Road traffic injuries are one of the major public health burdens worldwide. The United Nations Decade of Action for Road Safety (2011-2020) implores all nations to work to reduce this burden. This decade represents a unique and historic period of time in the field of road safety. Information exchange and co-operation between nations is an important step in achieving the goal. The burden of road crashes, fatalities and injuries is not equally distributed. We know that low and middle-income countries experience the majority of the road trauma burden. Therefore it is imperative that these countries learn from the successes of others that have developed and implemented road safety laws, public education campaigns and countermeasures over many years and have achieved significant road trauma reductions as a result. China is one of the countries experiencing a large road trauma burden. Vulnerable road users such as pedestrians and cyclists make up a large proportion of fatalities and injuries in China. Speeding, impaired/drug driving, distracted driving, vehicle overloading, inadequate road infrastructure, limited use of safety restraints and helmets, and limited road safety training have all been identified as contributing to the problem. Some important steps have been taken to strengthen China’s approach, including increased penalties for drunk driving in May 2011 and increased attention to school bus safety in 2011/12. However, there is still a large amount of work needed to improve the current road safety position in China. This paper provides details of a program to assist with road safety knowledge exchange between China and Australia that was funded by the Australian Government which was undertaken in the latter part of 2012. The four month program provided the opportunity for the first author to work closely with key agencies in Australia that are responsible for policy development and implementation of a broad range of road safety initiatives. In doing so, an in-depth understanding was gained about key road safety strategies in Australia and processes for developing and implementing them. Insights were also gained into the mechanisms used for road safety policy development, implementation and evaluation in several Australian jurisdictions. Road traffic law and enforcement issues were explored with the relevant jurisdictional transport and police agencies to provide a greater understanding of how Chinese laws and practices could be enhanced. Working with agencies responsible for public education and awareness campaigns about road safety in Australia also provided relevant information about how to promote road safety at the broader community level in China. Finally, the program provided opportunities to work closely with several world-renowned Australian research centres and key expert researchers to enhance opportunities for ongoing road safety research in China. The overall program provided the opportunity for the first author to develop knowledge in key areas of road safety strategy development, implementation and management which are directly relevant to the current situation in China. This paper describes some main observations and findings from participation in the program.

A framework for developing evaluation capacity in health care settings.

The purpose of this paper is to provide a framework for developing an effective evaluation practice within health care settings. Three features are reviewed; capacity building, the application of evaluation to program activities and the utilization of evaluation recommendations. First, the organizational elements required to establish effective evaluation practice are reviewed emphasizing that an organization's capacity for evaluation develops over time and in stages. Second, a comprehensive evaluation framework is presented which demonstrates how evaluation practice can be applied to all aspects of a program's life cycle, thus promoting the scope of evidence-based decision making within an organization. Finally, factors which influence the adoption of evaluation recommendations by decision makers are reviewed accompanied by strategies to promote the utilization of evaluation recommendations in organization decision making.

Comfort Care Rounds: A Staff Capacity-Building Initiative in Long-Term Care Homes

This article reports a pilot evaluation of Comfort Care Rounds (CCRs)-a strategy for addressing long-term care home staff's palliative and end-of-life care educational and support needs. Using a qualitative descriptive design, semistructured individual and focus group interviews were conducted to understand staff members' perspectives and feedback on the implementation and application of CCRs. Study participants identified that effective advertising, interest, and assigning staff to attend CCRs facilitated their participation. The key barriers to their attendance included difficulty in balancing heavy workloads and scheduling logistics. Interprofessional team member representation was sought but was not consistent. Study participants recognized the benefits of attending; however, they provided feedback on how the scheduling, content, and focus could be improved. Overall, study participants found CCRs to be beneficial to their palliative and end-of-life care knowledge, practice, and confidence. However, they identified barriers and recommendations, which warrant ongoing evaluation.

Capacity building for integrated health care at the local level

Aims & Rationale/Objectives
Taking a capacity building approach to research and evaluation within the context of a federally funded national program challenges the traditional paradigms of both research and evaluation. The objective of this approach was to foster attitudes and behaviours of reflection, critical inquiry and collaborative action amongst participants responsible for health care integration activities.

Methods
A series of workshops focusing on different elements of health care integration was conducted. Each workshop offered skill development in research and evaluation methods relevant to the participants' clinical practise. The workshops were multidisciplinary and cross-sectoral in order to promote discussion about shared patient care issues.

Principal Findings
Participatory action research facilitated by external agents can build the capacity of participants to identify and make changes that improve health care integration at local levels. A capacity building approach to research and evaluation can mediate tensions between top-down initiatives and on-the-ground practitioners.

Discussion
A capacity building approach was crucial to the success of this project particularly as the project proposal was developed at the corporate level. The workshops played an important role in engaging the participants and fostering the development of solutions for locally identified clinical issues. The opportunities for discussion with other health care service providers were both readily embraced and appreciated by the participants. The networks formed during the workshops are likely to be vital in sustaining integration efforts.

Implications
Education sessions such as the workshops held within this project ensure that health care integration remains on the agenda of the relevant organisations. These workshops fostered a continuous quality improvement approach whilst focusing on the skills required and the systemic barriers to achieving health care integration. The success of these workshops is evidence that the need and desire for shared education opportunities exists and the interdisciplinary focus is a powerful tool for developing an appreciation of the cultures within disciplines as well as linkages.

Using project evaluation to build capacity for integrated health care at local levels

Capacity-building evaluation featuring multidisciplinary cross-agency workshops fostered continuous quality improvement, while focusing on skills required and systemic barriers to health care integration between GPs and a regional hospital.