Evaluation of extended training for general practice in Northern Ireland: qualitative study.

Objective To evaluate participants' perceptions of the impact on them of an additional six months' training beyond the standard 12 month general practice vocational training scheme. Design Qualitative study using focus groups. Setting General practice vocational training in Northern Ireland. Participants 13 general practitioner registrars, six of whom participated in the additional six months' training, and four trainers involved in the additional six months' training. Main outcome measures: Participants' views about their experiences in 18 month and 12 month courses. Results Participants reported that the 12 month course was generally positive but was too pressurised and focused on examinations, and also that it had a negative impact on self care. The nature of the learning and assessment was reported to have left participants feeling averse to further continuing education and lacking in confidence. In contrast, the extended six month component was reported to have restimulated learning by focusing more on patient care and promoting self directed learning. It developed confidence, promoted teamwork, and gave experience of two practice contexts, and was reported as valuable by both ex-registrars and trainers. However, both the 12 and 18 month courses left participants feeling underprepared for practice management and self care. Conclusions 12 months' training in general practice does not provide doctors with the necessary competencies and confidence to enter independent practice. The extended period was reported to promote greater professional development, critical evaluation skills, and orientation to lifelong learning but does not fill all the gaps.

A realistic evaluation of track and trigger systems and acute care training for early recognition and treatment of deteriorating ward-based patients: research protocol.

Aim The aim of the study is to evaluate factors that enable or constrain the implementation and service delivery of early warnings systems or acute care training in practice. Background To date there is limited evidence to support the effectiveness of acute care initiatives (early warning systems, acute care training, outreach) in reducing the number of adverse events (cardiac arrest, death, unanticipated Intensive Care admission) through increased recognition and management of deteriorating ward based patients in hospital [1-3]. The reasons posited are that previous research primarily focused on measuring patient outcomes following the implementation of an intervention or programme without considering the social factors (the organisation, the people, external influences) which may have affected the process of implementation and hence measured end-points. Further research which considers the social processes is required in order to understand why a programme works, or does not work, in particular circumstances [4]. Method The design is a multiple case study approach of four general wards in two acute hospitals where Early Warning Systems (EWS) and Acute Life-threatening Events Recognition and Treatment (ALERT) course have been implemented. Various methods are being used to collect data about individual capacities, interpersonal relationships and institutional balance and infrastructures in order to understand the intended and unintended process outcomes of implementing EWS and ALERT in practice. This information will be gathered from individual and focus group interviews with key participants (ALERT facilitators, nursing and medical ALERT instructors, ward managers, doctors, ward nurses and health care assistants from each hospital); non-participant observation of ward organisation and structure; audit of patients' EWS charts and audit of the medical notes of patients who deteriorated during the study period to ascertain whether ALERT principles were followed. Discussion & progress to date This study commenced in January 2007. Ethical approval has been granted and data collection is ongoing with interviews being conducted with key stakeholders. The findings from this study will provide evidence for policy-makers to make informed decisions regarding the direction for strategic and service planning of acute care services to improve the level of care provided to acutely ill patients in hospital. References 1. Esmonde L, McDonnell A, Ball C, Waskett C, Morgan R, Rashidain A et al. Investigating the effectiveness of Critical Care Outreach Services: A systematic review. Intensive Care Medicine 2006; 32: 1713-1721 2. McGaughey J, Alderdice F, Fowler R, Kapila A, Mayhew A, Moutray M. Outreach and Early Warning Systems for the prevention of Intensive Care admission and death of critically ill patients on general hospital wards. Cochrane Database of Systematic Reviews 2007, Issue 3. www.thecochranelibrary.com 3. Winters BD, Pham JC, Hunt EA, Guallar E, Berenholtz S, Pronovost PJ (2007) Rapid Response Systems: A systematic review. Critical Care Medicine 2007; 35 (5): 1238-43 4. Pawson R and Tilley N. Realistic Evaluation. London; Sage: 1997

A realistic evaluation of Early Warning Systems and acute care training in Northern Ireland: findings and recommendations

Statement of purpose The purpose of this concurrent session is to present the main findings and recommendations from a five year study evaluating the implementation of Early Warning Systems (EWS) and the Acute Life-threatening Events: Recognition and Treatment (ALERT) course in Northern Ireland. The presentation will provide delegates with an understanding of those factors that enable and constrain successful implementation of EWS and ALERT in practice in order to provide an impetus for change. Methods The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory [1]. The stages included identifying the programme theories underpinning EWS and ALERT, generating hypotheses, gathering empirical evidence and refining the programme theories. This approach used a variety of mixed methods including individual and focus group interviews, observation and documentary analysis of EWS compliance data and ALERT training records. A within and across case comparison facilitated the development of mid-range theories from the research evidence. Results The official RRS theories developed from the realist synthesis were critically evaluated and compared with the study findings to develop a mid-range theory to explain what works, for whom in what circumstances. The findings of what works suggests that clinical experience, established working relationships, flexible implementation of protocols, ongoing experiential learning, empowerment and pre-emptive management are key to the success of EWS and ALERT implementation. Each concept is presented as ‘context, mechanism and outcome configurations’ to provide an understanding of how the context impacts on individual reasoning or behaviour to produce certain outcomes. Conclusion These findings highlight the combination of factors that can improve the implementation and sustainability of EWS and ALERT and in light of this evidence several recommendations are made to provide policymakers with guidance and direction for future policy development. References: 1. Pawson R and Tilley N. (1997) Realistic Evaluation. Sage Publications; London Type of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast

A healthy settings framework: an evaluation and comparison of midwives' responses to addressing domestic violence

Objectives: to compare and contrast how midwives working in either hospital- or community-based settings address domestic violence by evaluating their views on: prevalence of domestic violence; their role in addressing domestic violence; the acceptability of routine enquiry; and barriers encountered in asking clients questions about violence and abuse in pregnancy. Design: a postal survey questionnaire. Setting: Northern Ireland. Study population: 983 hospital and community midwives. Findings: overall, 488 midwives returned a completed questionnaire; a 57% response rate. Comparisons were made using descriptive, inferential statistics and cross-tabulation. Although there were significant differences between hospital- and community-based midwives in relation to domestic violence, both groups of midwives tended to underestimate its prevalence. Key conclusions: the findings suggest that midwives per se identify and respond to a fraction of the cases of domestic abuse in pregnancy, due to lack of confidence, education and training. This reinforces the need for both hospital and community midwives to gain further confidence and an understanding of the many psychosocial factors that surround domestic violence. Implications for practice: healthy settings theory can be used effectively to identify good practice with women who experience domestic violence. Effective investment for health care requires the gaps between hospital- and community-based practice to be bridged, and for work to be integrated.

Overcoming health inequalities: A participative evaluation framework fit for the task

Aims: Healthcare providers are confronted with the claim that the distribution of health and healthcare provision is inherently unfair. There is also a growing awareness that the tools and methodologies applied in tackling health inequalities require further development. Evaluations as well as interventions usually focus on population-based indicators, but do not always provide guidance for frontline service evaluation and delivery. That is why the evaluation framework presented here focuses on facilitating local service development, service provider and user involvement, and the adequate representation of different population groups. Methods: A participative evaluation framework was constructed by drawing on six common success characteristics extrapolated from the published literature and policies on health inequalities. This framework was then applied to an intervention addressing women’s psychosocial health needs in order to demonstrate its utility in practice. Results: The framework provides healthcare professionals with an evidence-based tool for evaluating projects or programmes targeting health inequalities in ways that are responsive to local contexts and stakeholders. Conclusion: This participative evaluation framework supports the identification of meaningful psychosocial and contextual indicators for assessing the diverse health and social needs of service users. It uses multi-dimensional indicators to assess health and social care needs, to inform local service development, and to facilitate the exchange of knowledge between researchers, service providers, and service users. The inherent responsiveness enables rigorous yet flexible action on local health inequalities.

Championing the interface between mental health and child protection: evaluation of a service initiative to improve joint working in Northern Ireland

The importance of establishing effective interagency working between adult mental health services and child care services in order to safeguard children has been repeatedly identified by research, policy, inquiries and inspection reports. This article reports on the evaluation of an initiative in one Health and Social Care Trust in Northern Ireland that aimed to facilitate joint working and so improve service provision and protection for children and families. The Champions Initiative involved identifying a champion in each multi-disciplinary community mental health team and in each family and child care team who would have responsibility for providing information, promoting joint working and identifying any obstacles to better co-operation. The evaluation of this initiative assessed levels of experience, training, confidence, understanding and awareness in the Champions and their team members at baseline. The Champions and their Team Leaders were then followed-up after six months to obtain their qualitative views of the impact of the initiative. The results include comparisons between mental health and child care staff, and crucially, views about whether the initiative has had any impact on working together. This study also generated recommendations for further service development in this complex and important area of practice.