Stakeholders and perspectivism in qualitative policy evaluation: A realist reflection

This paper examines the epistemological bases for the inclusion of stakeholders in policy research. While it concedes that the input of stakeholders provides essential expert and experiential knowledge for the understanding of complex policies and programmes, it contends that the approach which assumes that all interpretations of policy including those of stakeholders should be afforded equal validity, which we term relativist perspectivism, undermines the possibility of robust research by allowing power to replace methodological rigour as the primary research dynamic. It is noted that this problem tends to be more acute when the research is qualitative. A study into the gendered effects of Common Agricultural Policy reforms is used as an illustrative example of how research can be compromised by relativist perspectivism. It is argued that realist research methodologies uniquely provide the capacity to maintain epistemological robustness, while also being able to take due account of the perspectives of stakeholders.

Management of long-term sickness absence: a systematic realist review

Purpose
The increasing impact and costs of long term sickness absence have been well documented. However, the diversity and complexity of interventions and of the contexts in which these take place makes a traditional review problematic. Therefore, we undertook a systematic realist review to identify the dominant programme theories underlying best practice, to assess the evidence for these theories, and to throw light on important enabling or disabling contextual factors.

Method
A search of the scholarly literature from 1950 to 2011 identified 5,576 articles, of which 269 formed the basis of the review.

Results
We found that the dominant programme theories in relation to effective management related to: early intervention or referral by employers; having proactive organisational procedures; good communication and cooperation between stakeholders; and workplace-based occupational rehabilitation. Significant contextual factors were identified as the level of support for interventions from top management, the size and structure of the organisation, the level of financial and organisational investment in the management of long-term sickness absence, and the quality of relationships between managers and staff.

Conclusions
Consequently, those with responsibility for managing absence should bear in mind the contextual factors that are likely to have an impact on interventions, and do what they can to ensure stakeholders have at least a mutual understanding (if not a common purpose) in relation to their perceptions of interventions, goals, culture and practice in the management of long term sickness absence.

The use and limitation of realistic evaluation as a tool for evidence-based practice: a critical realist perspective

In this paper, we assess realistic evaluation’s articulation with evidence-based practice (EBP) from the perspective of critical realism. We argue that the adoption by realistic evaluation of a realist causal ontology means that it is better placed to explain complex healthcare interventions than the traditional method used by EBP, the randomized controlled trial (RCT). However, we do not conclude from this that the use of RCTs is without merit, arguing that it is possible to use both methods in combination under the rubric of realist theory. More negatively, we contend that the rejection of critical theory and utopianism by realistic evaluation in favour of the pragmatism of piecemeal social engineering means that it is vulnerable to accusations that it promotes technocratic interpretations of human problems. We conclude that, insofar as realistic evaluation adheres to the ontology of critical realism, it provides a sound contribution to EBP, but insofar as it rejects the critical turn of Bhaskar’s realism, it replicates the technocratic tendencies inherent in EBP.

Realist evaluation - promise, problems and practicalities

Realist evaluation is an innovative, multi-method approach to evaluating the effectiveness of complex health care interventions that is having an increasing impact on the research community. Drawing on their experience doing four realist evaluations in diverse areas of healthcare, the authors offer a comprehensive overview and critique of essential theory and practice. The first paper (Realist review and realist evaluation: an introduction) introduces the main components of the approach and shows how realist review can support realist evaluation. The second paper (Concepts and methodology for realist evaluation: help or hindrance?) provides further detail on the key concepts, shows how they can be operationalised, and discusses the advantages and difficulties of using these ideas. Following these two papers introducing and illustrating the major concepts, the third paper (Realist Evaluation: a critical realist critique) takes a step back to re-consider realist evaluation in relation to its critical realist roots, asking whether it leads to evaluators abandoning the attempt to understand (and if necessary challenge) the underlying values of health care interventions and contenting themselves merely with explicating the factors that help or hinder implementation. The fourth and final paper (Data analysis and theory development in realist evaluation) plunges back into the tangled undergrowth of multiple-method data collection and shows how disparate forms of data can be synthesised for theory development, and the results presented in a form that is useful to practitioners and policy-makers.

Multimedia psycho-educational interventions to support patient self-care in degenerative conditions: a realist review

Objective: Multimedia interventions are increasingly used to deliver information in order to promote self-care among patients with degenerative conditions. We carried out a realist review of the literature to investigate how the characteristics of multimedia psychoeducational interventions combine with the contexts in which they are introduced to help or hinder their effectiveness in supporting self-care for patients with degenerative conditions.

Method: Electronic databases (Medline, Science Direct, PSYCHinfo, EBSCO, and Embase) were searched in order to identify papers containing information on multimedia psychoeducational interventions. Using a realist review approach, we reviewed all relevant studies to identify theories that explained how the interventions work.

Results: Ten papers were included in the review. All interventions sought to promote self-care behaviors among participants. We examined the development and content of the multimedia interventions and the impact of patient motivation and of the organizational context of implementation. We judged seven studies to be methodologically weak. All completed studies showed small effects in favor of the intervention.

Significance of Results: Multimedia interventions may provide high-quality information in an accessible format, with the potential to promote self-care among patients with degenerative conditions, if the patient perceives the information as important and develops confidence about self-care. The evidence base is weak, so that research is needed to investigate effective modes of delivery at different resource levels. We recommend that developers consider how an intervention will reduce uncertainty and increase confidence in self-care, as well as the impact of the context in which it will be employed.