A proposed systems approach to the evaluation of integrated palliative care

Background. There is increasing global interest in regional palliative care networks (PCN) to integrate care, creating systems that are more cost-effective and responsive in multi-agency settings. Networks are particularly relevant where different professional skill sets are required to serve the broad spectrum of end-of-life needs. We propose a comprehensive framework for evaluating PCNs, focusing on the nature and extent of inter-professional collaboration, community readiness, and client-centred care. Methods. In the absence of an overarching structure for examining PCNs, a framework was developed based on previous models of health system evaluation, explicit theory, and the research literature relevant to PCN functioning. This research evidence was used to substantiate the choice of model factors. Results. The proposed framework takes a systems approach with system structure, process of care, and patient outcomes levels of consideration. Each factor represented makes an independent contribution to the description and assessment of the network. Conclusions. Realizing palliative patients' needs for complex packages of treatment and social support, in a seamless, cost-effective manner, are major drivers of the impetus for network-integrated care. The framework proposed is a first step to guide evaluation to inform the development of appropriate strategies to further promote collaboration within the PCN and, ultimately, optimal palliative care that meets patients' needs and expectations. © 2010 Bainbridge et al; licensee BioMed Central Ltd.

A calming cacophony: Social identity can shape the experience of loud noise

Environmental Psychology has typically considered noise as pollution and focused upon its negative impact. However, recent research in psychology and anthropology indicates the experience of noise as aversive depends upon the meanings with which it is attributed. Moreover, such meanings seem to be dependent on the social context. Here we extend this research through studying the aural experience of a religious festival in North India which is characterised by loud, continuous and cacophonous noise. Reporting an experiment and semi-structured interviews, we show that loud noise is experienced as pleasant or unpleasant according to the meanings attributed to it. Specifically, the experiment shows the same noise is experienced more positively (and listened to longer) when attributed to the festival rather than to a non-festival source. In turn, the qualitative data show that within the Mela, noises judged as having a religious quality are reported as more positive than noises that are not. Moreover, the qualitative data suggest a key factor in the evaluation of noise is our participants’ social identities as pilgrims. This identity provides a framework for interpreting the auditory environment and noises judged as intruding into their religious experience were judged negatively, whereas noises judged as contributing to their religious experience were judged more positively. Our findings therefore point to the ways in which our social identities are implicated in the process of attributing meaning to the auditory environment.

A Preliminary Evaluation of a New Life Science Module for Year One Nursing and Midwifery Students

This report outlines the rationale for the design and implementation of a new life sciences module for year one nursing and midwifery students. It describes our experience to date in running the new module and presents some preliminary results which describe an improved student performance compared to our previous year one bioscience module.

Did children’s perceptions of an after-school social learning program predict change in their behavior?

This research explored the influence of children’s perceptions of a pro-social behavior after-school program on actual change in the children’s behavioral outcomes over the program’s duration. Children’s perceptions of three program processes were collected as well as self-reported pro-social and anti-social behavior before and after the program. Statistical models showed that: Positive perceptions of the program facilitators’ dispositions significantly predicted reductions in anti-social behavior; and positive perceptions with the program activities significantly predicted gains in pro-social behavior. The children’s perceptions of their peers’ behavior in the sessions were not found to a significant predictor of behavioral change. The two significant perceptual indicators predicted a small percentage of the change in the behavioral outcomes. However, as after-school social learning programs have a research history of problematic implementation children’s perceptions should be considered in future program design, evaluation and monitoring.

Streptococcus bovis bacteraemia: an evaluation of the long-term effect on cardiac outcomes

Introduction: Streptococcus bovis can lead to bacteraemia, septicaemia, and ultimately endocarditis. The objective of this study was to evaluate the long-term implications of S. bovis endocarditis on cardiac morbidity and mortality. 

Methods: A retrospective cohort study was performed between January 2000 and March 2009 to assess all patients diagnosed with S. bovis bacteraemia from the Belfast Health and Social Care Trust. The primary end-point for cardiac investigations was the presence of endocarditis. Secondary end-points included referral for cardiac surgery and overall mortality. 

Results: Sixty-one positive S. bovis blood cultures from 43 patients were included. Following echocardiography, seven patients were diagnosed with infective endocarditis (16.3 % of total patients); four patients (9.3 %) had native valve involvement while three (7.0 %) had prosthetic valve infection. Five of these seven patients had more than one positive S. bovis culture (71.4 %). Three had significant valve dysfunction that warranted surgical repair/replacement, one of whom was unfit for surgery. There was a 100 % recurrence rate amongst the valve replacement patients (n = 2) and six patients with endocarditis had colorectal pathology. Patients with endocarditis had similar long-term survival as those with non-endocarditic bacteraemia (57.1 % alive vs. 50 % of non-endocarditis patients, p = 0.73). 

Conclusion: Streptococcus bovis endocarditis patients tended to have pre-existing valvular heart disease and those with prosthetic heart valves had higher surgical intervention and relapse rates. These patients experienced a higher rate of co-existing colorectal pathology but currently have reasonable long-term outcomes. This may suggest that they represent a patient population that merits consideration for an early surgical strategy to maximise long-term results, however, further evaluation is warranted. © 2013 The Japanese Association for Thoracic Surgery.

Factors affecting the successful implementation and sustainability of the Liverpool Care Pathway for dying patients – a realist evaluation

Objectives: The Liverpool Care Pathway for the dying patient (LCP) was designed to improve end-of-life care in generalist health care settings. Controversy has led to its withdrawal in some jurisdictions. The main objective of this research was to identify the influences that facilitated or hindered successful LCP implementation.

Method: An organisational case study using realist evaluation in one health and social care trust in Northern Ireland. Two rounds of semi-structured interviews were conducted with two policy makers and twenty two participants with experience and/or involvement in management of the LCP during 2011 and 2012.

Results: Key resource inputs included facilitation with a view to maintaining LCP ‘visibility’, reducing anxiety among nurses and increasing their confidence regarding the delivery of end-of-life care; and nurse and medical education designed to increase professional self-efficacy and reduce misuse and misunderstanding of the LCP. Key enabling contexts were consistent senior management support; ongoing education and training tailored to the needs of each professional group; and an organisational cultural change in the hospital setting that encompassed end-of-life care.

Conclusion: There is a need to appreciate the organizationally complex nature of intervening to improve end-of-life care. Successful implementation of evidence-based interventions for end-of-life care requires commitment to planning, training and ongoing review that takes account of different perspectives, institutional hierarchies and relationships and the educational needs of professional disciplines. There is a need also to recognise that medical consultants require particular support in their role as gatekeepers and as a lead communication channel with patients and their relatives.

The Management of Long-Term Sickness Absence in Large Public Sector Healthcare Organisations: A Realist Evaluation Using Mixed Methods

Purpose The success of measures to reduce long-term sickness absence (LTSA) in public sector organisations is contingent on organisational context. This realist evaluation investigates how interventions interact with context to influence successful management of LTSA. Methods Multi-method case study in three Health and Social Care Trusts in Northern Ireland comprising realist literature review, semi-structured interviews (61 participants), Process-Mapping and feedback meetings (59 participants), observation of training, analysis of documents. Results Important activities included early intervention; workplace-based occupational rehabilitation; robust sickness absence policies with clear trigger points for action. Used appropriately, in a context of good interpersonal and interdepartmental communication and shared goals, these are able to increase the motivation of staff to return to work. Line managers are encouraged to take a proactive approach when senior managers provide support and accountability. Hindering factors: delayed intervention; inconsistent implementation of policy and procedure; lack of resources; organisational complexity; stakeholders misunderstanding each other’s goals and motives. Conclusions Different mechanisms have the potential to encourage common motivations for earlier return from LTSA, such as employees feeling that they have the support of their line manager to return to work and having the confidence to do so. Line managers’ proactively engage when they have confidence in the support of seniors and in their own ability to address LTSA. Fostering these motivations calls for a thoughtful, diagnostic process, taking into account the contextual factors (and whether they can be modified) and considering how a given intervention can be used to trigger the appropriate mechanisms.

Optical coherence tomography for the diagnosis, monitoring and guiding of treatment for neovascular age-related macular degeneration:a systematic review and economic evaluation

BACKGROUND: Age-related macular degeneration is the most common cause of sight impairment in the UK. In neovascular age-related macular degeneration (nAMD), vision worsens rapidly (over weeks) due to abnormal blood vessels developing that leak fluid and blood at the macula.

OBJECTIVES: To determine the optimal role of optical coherence tomography (OCT) in diagnosing people newly presenting with suspected nAMD and monitoring those previously diagnosed with the disease.

DATA SOURCES: Databases searched: MEDLINE (1946 to March 2013), MEDLINE In-Process & Other Non-Indexed Citations (March 2013), EMBASE (1988 to March 2013), Biosciences Information Service (1995 to March 2013), Science Citation Index (1995 to March 2013), The Cochrane Library (Issue 2 2013), Database of Abstracts of Reviews of Effects (inception to March 2013), Medion (inception to March 2013), Health Technology Assessment database (inception to March 2013).

REVIEW METHODS: Types of studies: direct/indirect studies reporting diagnostic outcomes.

INDEX TEST: time domain optical coherence tomography (TD-OCT) or spectral domain optical coherence tomography (SD-OCT).

COMPARATORS: clinical evaluation, visual acuity, Amsler grid, colour fundus photographs, infrared reflectance, red-free images/blue reflectance, fundus autofluorescence imaging, indocyanine green angiography, preferential hyperacuity perimetry, microperimetry. Reference standard: fundus fluorescein angiography (FFA). Risk of bias was assessed using quality assessment of diagnostic accuracy studies, version 2. Meta-analysis models were fitted using hierarchical summary receiver operating characteristic curves. A Markov model was developed (65-year-old cohort, nAMD prevalence 70%), with nine strategies for diagnosis and/or monitoring, and cost-utility analysis conducted. NHS and Personal Social Services perspective was adopted. Costs (2011/12 prices) and quality-adjusted life-years (QALYs) were discounted (3.5%). Deterministic and probabilistic sensitivity analyses were performed.

RESULTS: In pooled estimates of diagnostic studies (all TD-OCT), sensitivity and specificity [95% confidence interval (CI)] was 88% (46% to 98%) and 78% (64% to 88%) respectively. For monitoring, the pooled sensitivity and specificity (95% CI) was 85% (72% to 93%) and 48% (30% to 67%) respectively. The FFA for diagnosis and nurse-technician-led monitoring strategy had the lowest cost (£39,769; QALYs 10.473) and dominated all others except FFA for diagnosis and ophthalmologist-led monitoring (£44,649; QALYs 10.575; incremental cost-effectiveness ratio £47,768). The least costly strategy had a 46.4% probability of being cost-effective at £30,000 willingness-to-pay threshold.

LIMITATIONS: Very few studies provided sufficient information for inclusion in meta-analyses. Only a few studies reported other tests; for some tests no studies were identified. The modelling was hampered by a lack of data on the diagnostic accuracy of strategies involving several tests.

CONCLUSIONS: Based on a small body of evidence of variable quality, OCT had high sensitivity and moderate specificity for diagnosis, and relatively high sensitivity but low specificity for monitoring. Strategies involving OCT alone for diagnosis and/or monitoring were unlikely to be cost-effective. Further research is required on (i) the performance of SD-OCT compared with FFA, especially for monitoring but also for diagnosis; (ii) the performance of strategies involving combinations/sequences of tests, for diagnosis and monitoring; (iii) the likelihood of active and inactive nAMD becoming inactive or active respectively; and (iv) assessment of treatment-associated utility weights (e.g. decrements), through a preference-based study.

STUDY REGISTRATION: This study is registered as PROSPERO CRD42012001930.

FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Resilience and Burnout in Child protection social work: Individual and organisational themes from a systematic literature review

Child protection social work is acknowledged as a very stressful occupation, with high turnover and poor retention of staff being a major concern. This paper highlights themes that emerged from findings of sixty-five articles that were included as part of a systematic literature review. The review focused on the evaluation of research findings, which considered individual and organisational factors associated with resilience or burnout in child protection social work staff. The results identified a range of individual and organisational themes for staff in child protection social work. Nine themes were identified in total. These are categorised under ‘Individual’ and ‘Organisational’ themes. Themes categorised as individual included personal history of maltreatment, training and preparation for child welfare, coping, secondary traumatic stress, compassion fatigue and compassion satisfaction. Those classified as organisational included workload, social support and supervision, organisational culture and climate, organisational and professional commitment, and job satisfaction or dissatisfaction. The range of factors is discussed with recommendations and areas for future research are highlighted.

The uncritical realism of realist evaluation

This article is a response to Ray Pawson’s critique of critical realism, the philosophy of science elaborated by Roy Bhaskar. I argue with Pawson’s interpretation of critical realism’s positions on both natural and social science and his charges concerning its totalizing ontology, its arrogant epistemology and its naive methodology. The differences between critical realism and realist evaluation are not as significant as Pawson contends. The main differences between the two realisms lie in their approaches to the relationship between social structures and human agency, and between facts and values. I argue that evaluation scientists need to clearly distinguish structure and agency. They should also make their values explicit. The uncritical approach of realist evaluation, combined with its underplaying of the importance of agency, leaves it open to implication in the abuses of bureaucratic instrumentalism.

Evaluation of an Older Persons’ Assessment Educational Workbook with second year nursing students in the UK.

Background: As a first step to successfully meet the complex health and social needs of older people, patient assessment has become a central feature of government policy and practice in order to ensure that care planning is person-centred. A core component of nurse education is clinical practice in order to support the development of clinical skills and competence; therefore it is important to help students and their practice-based mentors to develop and apply older person assessment skills. Therefore, an educational workbook was developed to help 2nd year nursing students to learn a structured, systematic and individualised older person assessment process with the support of their mentor.

Aim: A pilot study to evaluate the impact of an Older Persons’ Assessment Educational Workbook and explore second year nursing students’ competence and their opinions and use of an older person’s assessment skills workbook.

Research Methodology: A pre-experimental design (pre and post-test with no comparison group) was undertaken with n=6 2nd year students in 2014. The outcome measure was the Nursing Competence Questionnaire and results were analysed using the Wilcoxin Signed Rank Test in SPSS version 21. Content analysis of completed workbooks and a survey (n=5) of opinions regarding the workbook was undertaken.

Key Findings- No pre-post-test difference was found in the Nursing Competence Questionnaire with p=0.058 for the total scale. However, as this was a pilot, the study was under-powered and all students’ scores improved. Content analysis of the workbook found that 3 of the 5 participants completed all components of the workbook, with a mean of 1051 words used (Std dev 281.8). Through the survey students reported the workbook as a useful guide when undertaking a patient assessment.

Conclusions: The workbook showed potential as an intervention to help support development of nursing students’ assessment skills in practice.

An evaluation of a tiered interrelated intervention to address hazardous/ harmful drinking

In Northern Ireland, alcohol misuse impacts negatively on individual drinkers, families and communities. The ‘Alcohol and You Project’ in the South Eastern Health and Social Care Trust is a funded project providing a range of inter-related services with the Trust and alcohol/drug misuse charities. It includes a self-help interactive website, brief intervention drop in clinics and counseling services. Queen's University Belfast is evaluating the effectiveness of the project to reduce hazardous/ harmful drinking.

THE SAAF STUDY: evaluation of the Safeguarding Children Assessment and Analysis Framework (SAAF), compared with management as usual, for improving outcomes for children and young people who have experienced, or are at risk of, maltreatment: study protocol for a randomised controlled trial

Background: Serious case reviews and research studies have indicated weaknesses in risk assessments conducted by child protection social workers. Social workers are adept at gathering information but struggle with analysis and assessment of risk. The Department for Education wants to know if the use of a structured decision-making tool can improve child protection assessments of risk.

Methods/design: This multi-site, cluster-randomised trial will assess the effectiveness of the Safeguarding Children Assessment and Analysis Framework (SAAF). This structured decision-making tool aims to improve social workers' assessments of harm, of future risk and parents' capacity to change. The comparison is management as usual.

Inclusion criteria: Children's Services Departments (CSDs) in England willing to make relevant teams available to be randomised, and willing to meet the trial's training and data collection requirements.

Exclusion criteria: CSDs where there were concerns about performance; where a major organisational restructuring was planned or under way; or where other risk assessment tools were in use.

Six CSDs are participating in this study. Social workers in the experimental arm will receive 2 days training in SAAF together with a range of support materials, and access to limited telephone consultation post-training. The primary outcome is child maltreatment. This will be assessed using data collected nationally on two key performance indicators: the first is the number of children in a year who have been subject to a second Child Protection Plan (CPP); the second is the number of re-referrals of children because of related concerns about maltreatment. Secondary outcomes are: i) the quality of assessments judged against a schedule of quality criteria and ii) the relationship between the three assessments required by the structured decision-making tool (level of harm, risk of (re) abuse and prospects for successful intervention).

Discussion: This is the first study to examine the effectiveness of SAAF. It will contribute to a very limited literature on the contribution that structured decision-making tools can make to improving risk assessment and case planning in child protection and on what is involved in their effective implementation.

Developing and evaluating the integration of Life and Social Sciences teaching to first-year Nursing and Midwifery students

Title: Evaluating the integrating of life and social sciences teaching to first-year nursing and midwifery students

Objectives: To evaluate an integrated teaching and learning approach to first-year nursing students, combining the life, social sciences and public health with a more integrated and clinical focused approach to teaching delivery

Background: Historically within the School of Nursing and Midwifery the life sciences and social sciences had been taught as separate modules with separate teaching teams. This had reflected in a somewhat dis-integrated approach to student learning and understanding without clear clinical focus on application. With focus upon student learning the teaching teams engaged with a stepped, incremental and progressive movement towards developing and delivering a more integrated structure of learning, combining the life sciences, social sciences and public health teaching and learning within the one extended first-year module. The focus was particularly on integrated understanding and clinical relevance. This paper discusses both the approach to developing the integrated model of teaching and the evaluation of that teaching.

Results: The module, combining life, social science and Public health teaching was positively evaluated by the students. Evaluations are compared and contrasted from to nursing student intakes.