The effects of a volunteer mentoring programme on reading outcomes among eight- to nine-year-old children: A follow up randomized controlled trial

This article presents the findings of a randomized controlled trial evaluation of the effects of a revised version of the volunteer mentoring programme, Time to Read. Participating children received two 30-minute mentoring sessions per week from volunteer mentors who carried out paired reading activities with the children. The current trial involved 512 children aged eight to nine years from 50 primary schools. The programme was found to be effective in improving decoding skills (d=+.15), reading rate (d=+.22) and reading fluency (d=+.14) and there was some evidence of a positive effect in relation to the children’s aspirations for the future (d=+.11). However, no evidence was found of the programme having an effect on reading comprehension or reading confidence and enjoyment of reading. The article concludes by suggesting that mentoring programmes using non-specialist volunteers can be effective in improving foundational reading skills but would appear to be less effective in terms of improving higher-order skills such as comprehension. The article also suggests that such programmes are likely to be most effective if concentrating on core reading activities rather than attempting to address reading outcomes indirectly through improving children’s confidence or wider enjoyment of reading.

The challenges of joint working: lessons from the Supporting People Health Pilot evaluation

Purpose: This paper reports the findings of the evaluation of the Supporting People Health Pilots programme, which was established to demonstrate the policy links between housing support services and health and social care services by encouraging the development of integrated services. The paper highlights the challenges Method: The evaluation of the six health pilots rested on two main sources of data collection: Quarterly Project Evaluation Reports collected process data as well as reporting progress against aims and objectives. Semi-structured interviews—conducted across all key professional stakeholder groups and agencies and with people who used services—explored their experiences of these new services. Results: The ability of pilots to work across organisational boundaries to achieve their aims and objectives was associated not only with agencies sharing an understanding of the purpose of the joint venture, a history of joint working and clear and efficient governance arrangements but on two other characteristics: the extent and nature of statutory sector participation and, whether or not the service is defined by a history of voluntary sector involvement. In particular the pilots demonstrated how voluntary sector agencies appeared to be less constrained by organisational priorities and professional agenda and more able to respond flexibly to meet the complex needs of individuals. Conclusion and discussion: The pilots demonstrate that integrating services to support people with complex needs works best

Surveillance for ocular hypertension: An evidence synthesis and economic evaluation

OBJECTIVES: To determine effective and efficient monitoring criteria for ocular hypertension [raised intraocular pressure (IOP)] through (i) identification and validation of glaucoma risk prediction models; and (ii) development of models to determine optimal surveillance pathways.

DESIGN: A discrete event simulation economic modelling evaluation. Data from systematic reviews of risk prediction models and agreement between tonometers, secondary analyses of existing datasets (to validate identified risk models and determine optimal monitoring criteria) and public preferences were used to structure and populate the economic model.

SETTING: Primary and secondary care.

PARTICIPANTS: Adults with ocular hypertension (IOP > 21 mmHg) and the public (surveillance preferences).

INTERVENTIONS: We compared five pathways: two based on National Institute for Health and Clinical Excellence (NICE) guidelines with monitoring interval and treatment depending on initial risk stratification, 'NICE intensive' (4-monthly to annual monitoring) and 'NICE conservative' (6-monthly to biennial monitoring); two pathways, differing in location (hospital and community), with monitoring biennially and treatment initiated for a ≥ 6% 5-year glaucoma risk; and a 'treat all' pathway involving treatment with a prostaglandin analogue if IOP > 21 mmHg and IOP measured annually in the community.

MAIN OUTCOME MEASURES: Glaucoma cases detected; tonometer agreement; public preferences; costs; willingness to pay and quality-adjusted life-years (QALYs).

RESULTS: The best available glaucoma risk prediction model estimated the 5-year risk based on age and ocular predictors (IOP, central corneal thickness, optic nerve damage and index of visual field status). Taking the average of two IOP readings, by tonometry, true change was detected at two years. Sizeable measurement variability was noted between tonometers. There was a general public preference for monitoring; good communication and understanding of the process predicted service value. 'Treat all' was the least costly and 'NICE intensive' the most costly pathway. Biennial monitoring reduced the number of cases of glaucoma conversion compared with a 'treat all' pathway and provided more QALYs, but the incremental cost-effectiveness ratio (ICER) was considerably more than £30,000. The 'NICE intensive' pathway also avoided glaucoma conversion, but NICE-based pathways were either dominated (more costly and less effective) by biennial hospital monitoring or had a ICERs > £30,000. Results were not sensitive to the risk threshold for initiating surveillance but were sensitive to the risk threshold for initiating treatment, NHS costs and treatment adherence.

LIMITATIONS: Optimal monitoring intervals were based on IOP data. There were insufficient data to determine the optimal frequency of measurement of the visual field or optic nerve head for identification of glaucoma. The economic modelling took a 20-year time horizon which may be insufficient to capture long-term benefits. Sensitivity analyses may not fully capture the uncertainty surrounding parameter estimates.

CONCLUSIONS: For confirmed ocular hypertension, findings suggest that there is no clear benefit from intensive monitoring. Consideration of the patient experience is important. A cohort study is recommended to provide data to refine the glaucoma risk prediction model, determine the optimum type and frequency of serial glaucoma tests and estimate costs and patient preferences for monitoring and treatment.

FUNDING: The National Institute for Health Research Health Technology Assessment Programme.

The clinical effectiveness and cost-effectiveness of screening for open angle glaucoma:A systematic review and economic evaluation

Objectives: To assess whether open angle glaucoma (OAG) screening meets the UK National Screening Committee criteria, to compare screening strategies with case finding, to estimate test parameters, to model estimates of cost and cost-effectiveness, and to identify areas for future research. Data sources: Major electronic databases were searched up to December 2005. Review methods: Screening strategies were developed by wide consultation. Markov submodels were developed to represent screening strategies. Parameter estimates were determined by systematic reviews of epidemiology, economic evaluations of screening, and effectiveness (test accuracy, screening and treatment). Tailored highly sensitive electronic searches were undertaken. Results: Most potential screening tests reviewed had an estimated specificity of 85% or higher. No test was clearly most accurate, with only a few, heterogeneous studies for each test. No randomised controlled trials (RCTs) of screening were identified. Based on two treatment RCTs, early treatment reduces the risk of progression. Extrapolating from this, and assuming accelerated progression with advancing disease severity, without treatment the mean time to blindness in at least one eye was approximately 23 years, compared to 35 years with treatment. Prevalence would have to be about 3-4% in 40 year olds with a screening interval of 10 years to approach cost-effectiveness. It is predicted that screening might be cost-effective in a 50-year-old cohort at a prevalence of 4% with a 10-year screening interval. General population screening at any age, thus, appears not to be cost-effective. Selective screening of groups with higher prevalence (family history, black ethnicity) might be worthwhile, although this would only cover 6% of the population. Extension to include other at-risk cohorts (e.g. myopia and diabetes) would include 37% of the general population, but the prevalence is then too low for screening to be considered cost-effective. Screening using a test with initial automated classification followed by assessment by a specialised optometrist, for test positives, was more cost-effective than initial specialised optometric assessment. The cost-effectiveness of the screening programme was highly sensitive to the perspective on costs (NHS or societal). In the base-case model, the NHS costs of visual impairment were estimated as £669. If annual societal costs were £8800, then screening might be considered cost-effective for a 40-year-old cohort with 1% OAG prevalence assuming a willingness to pay of £30,000 per quality-adjusted life-year. Of lesser importance were changes to estimates of attendance for sight tests, incidence of OAG, rate of progression and utility values for each stage of OAG severity. Cost-effectiveness was not particularly sensitive to the accuracy of screening tests within the ranges observed. However, a highly specific test is required to reduce large numbers of false-positive referrals. The findings that population screening is unlikely to be cost-effective are based on an economic model whose parameter estimates have considerable uncertainty, in particular, if rate of progression and/or costs of visual impairment are higher than estimated then screening could be cost-effective. Conclusions: While population screening is not cost-effective, the targeted screening of high-risk groups may be. Procedures for identifying those at risk, for quality assuring the programme, as well as adequate service provision for those screened positive would all be needed. Glaucoma detection can be improved by increasing attendance for eye examination, and improving the performance of current testing by either refining practice or adding in a technology-based first assessment, the latter being the more cost-effective option. This has implications for any future organisational changes in community eye-care services. Further research should aim to develop and provide quality data to populate the economic model, by conducting a feasibility study of interventions to improve detection, by obtaining further data on costs of blindness, risk of progression and health outcomes, and by conducting an RCT of interventions to improve the uptake of glaucoma testing. © Queen's Printer and Controller of HMSO 2007. All rights reserved.

Evaluation of a Final Year Work-shadowing Attachment

The transition from medical student to junior doctor is well recognised to be a difficult and stressful period. To ease this transition, most UK universities have a work-shadowing period (WSP), during which students can learn practical skills needed for forthcoming employment. The aim of this study was to evaluate the WSP at Queen's University Belfast, and gain the views of both students and Foundation Programme Supervisors and Directors (FPSDs). The study utilised both qualitative (focus groups) and quantitative (questionnaires) approaches. The FPSDs completed a specific questionnaire designed for this study, while the students completed the university's internal quality assurance questionnaire. Twenty-eight of the 37 (76%) FPSDs and 106 / 196 (54%) students completed the questionnaires. Focus groups were conducted with up to 10 students in each group in both a regional centre and a district general hospital at the start and the end of the WSP as well as 8 weeks into working life. The transcripts of the focus groups were analysed and themes identified. A number of deficiencies with the current WSP were identified, including concerns about the use of log books, the timing of the attachment and relatively low levels of supervision provided by senior hospital staff members. As a result, students felt unprepared for commencing work, with particular mention given to medical emergencies, prescribing, and the emotional aspects of the job. A number of recommendations are made, including the need for more senior input to ensure better student attendance, participation and clinical interaction. Furthermore, students should be offered additional supervised responsibility for delivery of patient care and more experiential learning with respect to drug prescribing and administration. The study also suggests that more needs to be done to help ease the emotional and psychological stresses of the early FY1 period. These issues have been resolved to a large extent with the introduction of the new final year Student Assistantship module in the academic year 2010-2011. © The Ulster Medical Society, 2012.

A cluster randomised controlled trial of “Bookstart+”: a book gifting programme

Purpose – The purpose of this paper is to evaluate the effectiveness of a free book gifting programme, called “Bookstart+”, in improving family reading outcomes.

Design/methodology/approach – Bookstart+ consists of a pack of books and reading materials provided to families at their two-year-old child's statutory health visit. The pack is accompanied by a short priming demonstration, delivered by the health visitor, on shared reading. The evaluation took the form of a randomised controlled trial (RCT) with 460 families from the client lists of 115 health visitors.

Findings – The study found evidence of: a positive significant effect on parents’ attitudes to reading and books (Cohen's d=+0.192, p=0.034); no significant effect on parental attitudes to their child reading (d=+0.085, p=0.279); and a negative effect, approaching significance, on public library usage (d=-0.160, p=0.055).

Research limitations/implications – The attrition rate was high, with only 43.9 per cent of the target families completing all of the research. However, this level of attrition did not lead to any significant differences between the control and intervention groups on their pre-test measures.

Practical implications – The study provides recommendations for free book gifting service provision in relation to pack contents and delivery.

Originality/value – This paper contributes to the limited international RCT evidence on free book gifting programmes.

Optical coherence tomography for the diagnosis, monitoring and guiding of treatment for neovascular age-related macular degeneration:a systematic review and economic evaluation

BACKGROUND: Age-related macular degeneration is the most common cause of sight impairment in the UK. In neovascular age-related macular degeneration (nAMD), vision worsens rapidly (over weeks) due to abnormal blood vessels developing that leak fluid and blood at the macula.

OBJECTIVES: To determine the optimal role of optical coherence tomography (OCT) in diagnosing people newly presenting with suspected nAMD and monitoring those previously diagnosed with the disease.

DATA SOURCES: Databases searched: MEDLINE (1946 to March 2013), MEDLINE In-Process & Other Non-Indexed Citations (March 2013), EMBASE (1988 to March 2013), Biosciences Information Service (1995 to March 2013), Science Citation Index (1995 to March 2013), The Cochrane Library (Issue 2 2013), Database of Abstracts of Reviews of Effects (inception to March 2013), Medion (inception to March 2013), Health Technology Assessment database (inception to March 2013).

REVIEW METHODS: Types of studies: direct/indirect studies reporting diagnostic outcomes.

INDEX TEST: time domain optical coherence tomography (TD-OCT) or spectral domain optical coherence tomography (SD-OCT).

COMPARATORS: clinical evaluation, visual acuity, Amsler grid, colour fundus photographs, infrared reflectance, red-free images/blue reflectance, fundus autofluorescence imaging, indocyanine green angiography, preferential hyperacuity perimetry, microperimetry. Reference standard: fundus fluorescein angiography (FFA). Risk of bias was assessed using quality assessment of diagnostic accuracy studies, version 2. Meta-analysis models were fitted using hierarchical summary receiver operating characteristic curves. A Markov model was developed (65-year-old cohort, nAMD prevalence 70%), with nine strategies for diagnosis and/or monitoring, and cost-utility analysis conducted. NHS and Personal Social Services perspective was adopted. Costs (2011/12 prices) and quality-adjusted life-years (QALYs) were discounted (3.5%). Deterministic and probabilistic sensitivity analyses were performed.

RESULTS: In pooled estimates of diagnostic studies (all TD-OCT), sensitivity and specificity [95% confidence interval (CI)] was 88% (46% to 98%) and 78% (64% to 88%) respectively. For monitoring, the pooled sensitivity and specificity (95% CI) was 85% (72% to 93%) and 48% (30% to 67%) respectively. The FFA for diagnosis and nurse-technician-led monitoring strategy had the lowest cost (£39,769; QALYs 10.473) and dominated all others except FFA for diagnosis and ophthalmologist-led monitoring (£44,649; QALYs 10.575; incremental cost-effectiveness ratio £47,768). The least costly strategy had a 46.4% probability of being cost-effective at £30,000 willingness-to-pay threshold.

LIMITATIONS: Very few studies provided sufficient information for inclusion in meta-analyses. Only a few studies reported other tests; for some tests no studies were identified. The modelling was hampered by a lack of data on the diagnostic accuracy of strategies involving several tests.

CONCLUSIONS: Based on a small body of evidence of variable quality, OCT had high sensitivity and moderate specificity for diagnosis, and relatively high sensitivity but low specificity for monitoring. Strategies involving OCT alone for diagnosis and/or monitoring were unlikely to be cost-effective. Further research is required on (i) the performance of SD-OCT compared with FFA, especially for monitoring but also for diagnosis; (ii) the performance of strategies involving combinations/sequences of tests, for diagnosis and monitoring; (iii) the likelihood of active and inactive nAMD becoming inactive or active respectively; and (iv) assessment of treatment-associated utility weights (e.g. decrements), through a preference-based study.

STUDY REGISTRATION: This study is registered as PROSPERO CRD42012001930.

FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Evaluation of a partnership between primary and secondary care providing an accessible Level 1 sexual health service in the community

Comprehensive testing for asymptomatic sexually transmitted infections in Northern Ireland has traditionally been provided by genitourinary medicine clinics. As patient demand for services has increased while budgets have remained limited, there has been increasing difficulty in accommodating this demand. In May 2013, the newly commissioned specialist Sexual Health service in the South Eastern Trust sought to pilot a new model of care working alongside a GP partnership of 12 practices. A training programme to enable GPs and practice nurses to deliver Level 1 sexual health care to heterosexual patients aged >16 years, in accordance with the standards of BASHH, was developed. A comprehensive care pathway and dedicated community health advisor supported this new model with close liaison between primary and secondary care. Testing for Chlamydia, gonorrhoea, HIV and syphilis was offered. The aims of the pilot were achieved, namely to provide accessible, cost-effective sexual health care within a framework of robust clinical governance. Furthermore, it uncovered a high positivity rate for Chlamydia, especially in young men attending their general practice, and demonstrated a high level of patient satisfaction. Moreover the capacity of secondary care to deliver Levels 2 and 3 services was increased.

An evaluation of Lab Tutor from the Nursing Student’s Perspective

The efficiency of large group teaching (lectures) has long been called into question with much research high lighting low levels of student participation, and poor attention spans leading to a lack of engagement with learning which inhibits deep learning. Small group teaching and Enquiry Based Learning (EBL) are methods of teaching that can help promote deep learning. There is also a growing need and demand for Technology Enhanced Learning to suit changing lifestyles. The Labtutor® System, is one such piece of software that is designed to incorporate EBL and small group teaching quality into the large group setting.

This study provides a descriptive survey of adult nursing student’s perceptions of the Labtutor system following its use in two Life Science modules within an undergraduate nursing programme. A convenience sample of first year adult nursing students (n= 115) were identified to complete a 32 item questionnaire (appendix three).
Participants reported overall that they enjoyed using the system and found it beneficial to their learning specifically:
(a) Increased engagement with material in online learning as a result of using the system.
(b) Increased participation and levels of interactivity in the lecture as a result of using the system.
(c) Increased enhancement of learning as a result of using the system and
(d) Usefulness of the formative assessment facilitated by using the system.

The study concludes that Labtutor® system and other such methods of Technology Enhanced Learning packages if used correctly can enhance learning.

Northern Ireland and ‘The Troubles’, outlining an innovative approach to nursing/midwifery student teaching and module evaluation

This discussion paper outlines an approach to developing and evaluating an educative programme primarily delivered by lay `citizen trainers’ in educating student nurses, and student midwives to the impact of and experience of extended and extensive civil unrest within their communities (`the Troubles’ ). This is drawn from experience within the Northern Ireland `Troubles’ and all of the citizen trainers were directly affected physically/psychologically. The programme was intended to both educate but primarily to help facilitate student nurses and student midwives to better understanding to experience and context and to more effective care delivery to those affected by/damaged by `the Troubles’. Evaluation of the teaching and learning by the students was significantly positive.

L’action positive est-elle efficace? Une évaluation empirique du programme pour l’équité dans l’emploi en Irlande du Nord

A description, and analysis, of an empirical investigation of the effectiveness of affirmative action in the Northern Ireland employment

Managing patient deterioration: evaluation of what works.

Background: Rapid Response Systems (RRS) have been implemented nationally and internationally to improve patient safety in hospital. However, to date the majority of the RRS research evidence has focused on measuring the effectiveness of the intervention on patient outcomes. To evaluate RRS it has been recommended that a multimodal approach is required to address the broad range of process and outcome measures required to determine the effectiveness of the RRS concept. Aim: The aim of this paper is to evaluate the official RRS programme theoretical assumptions regarding how the programme is meant to work against actual practice in order to determine what works. Methods: The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory [1]. This approach used a variety of mixed methods to test the programme theories including individual and focus group interviews with a purposive sample of 75 nurses and doctors, observation of ward practices and documentary analysis. The findings from the case studies were analysed and compared within and across cases to identify what works for whom and in what circumstances. Results: The RRS programme theories were critically evaluated and compared with study findings to develop a mid-range theory to explain what works, for whom in what circumstances. The findings of what works suggests that clinical experience, established working relationships, flexible implementation of protocols, ongoing experiential learning, empowerment and pre-emptive management are key to the success of RRS implementation.  Conclusion:These findings highlight the combination of factors that can improve the implementation of RRS and in light of this evidence several recommendations are made to provide policymakers with guidance and direction for their success and sustainability.References: 1.Pawson R and Tilley N. (1997) Realistic Evaluation. Sage Publications; LondonType of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast

Realistic evaluation of EWS and ALERT: factors enabling and constraining implementation.

Realistic Evaluation of EWS and ALERT: factors enabling and constraining implementation Background The implementation of EWS and ALERT in practice is essential to the success of Rapid Response Systems but is dependent upon nurses utilising EWS protocols and applying ALERT best practice guidelines. To date there is limited evidence on the effectiveness of EWS or ALERT as research has primarily focused on measuring patient outcomes (cardiac arrests, ICU admissions) following the implementation of a Rapid Response Team. Complex interventions in healthcare aimed at changing service delivery and related behaviour of health professionals require a different research approach to evaluate the evidence. To understand how and why EWS and ALERT work, or might not work, research needs to consider the social, cultural and organisational influences that will impact on successful implementation in practice. This requires a research approach that considers both the processes and outcomes of complex interventions, such as EWS and ALERT, implemented in practice. Realistic Evaluation is such an approach and was used to explain the factors that enable and constrain the implementation of EWS and ALERT in practice [1]. Aim The aim of this study was to evaluate factors that enabled and constrained the implementation and service delivery of early warnings systems (EWS) and ALERT in practice in order to provide direction for enabling their success and sustainability. Methods The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory. This approach used a variety of mixed methods to test the programme theories including individual and focus group interviews, observation and documentary analysis in a two stage process. A purposive sample of 75 key informants participated in individual and focus group interviews. Observation and documentary analysis of EWS compliance data and ALERT training records provided further evidence to support or refute the interview findings. Data was analysed using NVIVO8 to categorise interview findings and SPSS for ALERT documentary data. These findings were further synthesised by undertaking a within and cross case comparison to explain the factors enabling and constraining EWS and ALERT. Results A cross case analysis highlighted similarities, differences and factors enabling or constraining successful implementation across the case study sites. Findings showed that personal (confidence; clinical judgement; personality), social (ward leadership; communication), organisational (workload and staffing issues; pressure from managers to complete EWS audit and targets), educational (constraints on training; no clinical educator on ward) and cultural (routine task delegated) influences impact on EWS and acute care training outcomes. There were also differences noted between medical and surgical wards across both case sites. Conclusions Realist Evaluation allows refinement and development of the RRS programme theory to explain the realities of practice. These refined RRS programme theories are capable of informing the planning of future service provision and provide direction for enabling their success and sustainability. References: 1. McGaughey J, Blackwood B, O’Halloran P, Trinder T. J. & Porter S. (2010) A realistic evaluation of Track and Trigger systems and acute care training for early recognition and management of deteriorating ward–based patients. Journal of Advanced Nursing 66 (4), 923-932. Type of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast

A realistic evaluation of track and trigger systems and acute care training for early recognition and treatment of deteriorating ward-based patients: research protocol.

Aim The aim of the study is to evaluate factors that enable or constrain the implementation and service delivery of early warnings systems or acute care training in practice. Background To date there is limited evidence to support the effectiveness of acute care initiatives (early warning systems, acute care training, outreach) in reducing the number of adverse events (cardiac arrest, death, unanticipated Intensive Care admission) through increased recognition and management of deteriorating ward based patients in hospital [1-3]. The reasons posited are that previous research primarily focused on measuring patient outcomes following the implementation of an intervention or programme without considering the social factors (the organisation, the people, external influences) which may have affected the process of implementation and hence measured end-points. Further research which considers the social processes is required in order to understand why a programme works, or does not work, in particular circumstances [4]. Method The design is a multiple case study approach of four general wards in two acute hospitals where Early Warning Systems (EWS) and Acute Life-threatening Events Recognition and Treatment (ALERT) course have been implemented. Various methods are being used to collect data about individual capacities, interpersonal relationships and institutional balance and infrastructures in order to understand the intended and unintended process outcomes of implementing EWS and ALERT in practice. This information will be gathered from individual and focus group interviews with key participants (ALERT facilitators, nursing and medical ALERT instructors, ward managers, doctors, ward nurses and health care assistants from each hospital); non-participant observation of ward organisation and structure; audit of patients' EWS charts and audit of the medical notes of patients who deteriorated during the study period to ascertain whether ALERT principles were followed. Discussion & progress to date This study commenced in January 2007. Ethical approval has been granted and data collection is ongoing with interviews being conducted with key stakeholders. The findings from this study will provide evidence for policy-makers to make informed decisions regarding the direction for strategic and service planning of acute care services to improve the level of care provided to acutely ill patients in hospital. References 1. Esmonde L, McDonnell A, Ball C, Waskett C, Morgan R, Rashidain A et al. Investigating the effectiveness of Critical Care Outreach Services: A systematic review. Intensive Care Medicine 2006; 32: 1713-1721 2. McGaughey J, Alderdice F, Fowler R, Kapila A, Mayhew A, Moutray M. Outreach and Early Warning Systems for the prevention of Intensive Care admission and death of critically ill patients on general hospital wards. Cochrane Database of Systematic Reviews 2007, Issue 3. www.thecochranelibrary.com 3. Winters BD, Pham JC, Hunt EA, Guallar E, Berenholtz S, Pronovost PJ (2007) Rapid Response Systems: A systematic review. Critical Care Medicine 2007; 35 (5): 1238-43 4. Pawson R and Tilley N. Realistic Evaluation. London; Sage: 1997

A realistic evaluation of Early Warning Systems and acute care training in Northern Ireland: findings and recommendations

Statement of purpose The purpose of this concurrent session is to present the main findings and recommendations from a five year study evaluating the implementation of Early Warning Systems (EWS) and the Acute Life-threatening Events: Recognition and Treatment (ALERT) course in Northern Ireland. The presentation will provide delegates with an understanding of those factors that enable and constrain successful implementation of EWS and ALERT in practice in order to provide an impetus for change. Methods The research design was a multiple case study approach of four wards in two hospitals in Northern Ireland. It followed the principles of realist evaluation research which allowed empirical data to be gathered to test and refine RRS programme theory [1]. The stages included identifying the programme theories underpinning EWS and ALERT, generating hypotheses, gathering empirical evidence and refining the programme theories. This approach used a variety of mixed methods including individual and focus group interviews, observation and documentary analysis of EWS compliance data and ALERT training records. A within and across case comparison facilitated the development of mid-range theories from the research evidence. Results The official RRS theories developed from the realist synthesis were critically evaluated and compared with the study findings to develop a mid-range theory to explain what works, for whom in what circumstances. The findings of what works suggests that clinical experience, established working relationships, flexible implementation of protocols, ongoing experiential learning, empowerment and pre-emptive management are key to the success of EWS and ALERT implementation. Each concept is presented as ‘context, mechanism and outcome configurations’ to provide an understanding of how the context impacts on individual reasoning or behaviour to produce certain outcomes. Conclusion These findings highlight the combination of factors that can improve the implementation and sustainability of EWS and ALERT and in light of this evidence several recommendations are made to provide policymakers with guidance and direction for future policy development. References: 1. Pawson R and Tilley N. (1997) Realistic Evaluation. Sage Publications; London Type of submission: Concurrent session Source of funding: Sandra Ryan Fellowship funded by the School of Nursing & Midwifery, Queen’s University of Belfast