Methodological challenges in conducting a systematic review of community wide interventions to increase physical activity

Introduction: Evaluating the effectiveness of interventions designed to increase the physical activity in communities is often a difficult and complex task, requiring considerable expertise and investment, and often constrained by methodological limitations. These limitations, in turn, create additional challenges when these studies are used in systematic reviews as they hinder the confidence, precision and interpretation of results. The objective of this paper is to summarise the methodological challenges posed in conducting a systematic review of community-wide physical activity interventions to help inform those conducting future primary research and systematic reviews. Methods: We conducted a Cochrane systematic review of community-wide interventions to increase physical activity. We assessed the methodological quality of the included studies. We will investigate these in greater detail, particularly in relation to the potential impact on measures of effect, confidence in results, generalizability of results and general interpretation. Results: The systematic review was conducted and has been published in the Cochrane Library. A logic model was helpful in defining and interpreting the studies. Many studies of unsuitable study design were excluded; however several important methodological limitations of the primary studies evaluating community-wide physical activity interventions emerged. These included: - the failure to use validated tools to measure physical activity; - issues associated with pre and post test designs; - inadequate sampling of populations; - poor control groups; and - intervention and measurement protocols of inadequate duration. Although it is challenging to undertake rigorous evaluations of complex interventions, these issues result in significant uncertainty over the effectiveness of these interventions, and the possible factors required for a community-wide intervention to be successful. In particular, the combination of several of these limitations (e.g. un-validated tools, inadequate sampling, and short duration) is that studies may lack the sensitivity to detect any meaningful change. Multiple publications of findings for the same study also made interpretation difficult; however, interventions with parallel qualitative publications were helpful. Discussion: Evaluating community wide interventions to increase physical activity in a rigorous way is incredibly challenging. These findings reflect these challenges but have important ramifications for researchers conducting primary studies to determine the efficacy of such interventions, as well as for researchers conducting systematic reviews. This new review shows that the inadequacies of design and evaluation are continuing. It is hoped that the adoption of such suggestions may aid in the development of systematic reviews, but more importantly, in enabling translation of such findings into policy and practice.

Assessment of applicability and transferability of evidence-based antenatal interventions to the Australian indigenous setting

There is a need for public health interventions to be based on the best available evidence. Unfortunately, well-conducted studies from settings similar to that in which an intervention is to be implemented are often not available. Therefore, health practitioners are forced to make judgements about proven effective interventions in one setting and their suitability to make a difference in their own setting. The framework of Wang et al. has been proposed to help with this process. This paper provides a case study on the application of the framework to a decision-making process regarding antenatal care in Aboriginal and Torres Strait Islander communities in Queensland. This method involved undertaking a systematic search of the current available evidence, then conducting a second literature search to determine factors that may affect the applicability and transferability of these interventions into these communities. Finally, in consideration of these factors, clinical judgement decisions on the applicability and transferability of these interventions were made. This method identified several interventions or strategies for which there was evidence of improving antenatal care or outcomes. By using the framework, we concluded that several of these effective interventions would be feasible in Aboriginal and Torres Strait Islander communities within Queensland.

Evidence supporting exercise interventions for persons in early-stage Alzheimer’s disease

The purpose of this article is to grade research evidence supporting exercise-based interventions for persons with early-stage dementias and to report the recommendations of a consensus panel. The search produced 11 data based articles testing the effects of exercise interventions on a variety of outcomes. The body of evidence to support exercise interventions in the prevention and treatment of Alzheimer’s disease is growing and has potential as a treatment modality following translational studies in recreation therapy and other fields.

Linking scientific evidence and decision making : A case study of hand hygiene interventions

We consider how data from scientific research should be used for decision making in health services. Whether a hand hygiene intervention to reduce risk of nosocomial infection should be widely adopted is the case study. Improving hand hygiene has been described as the most important measure to prevent nosocomial infection. 1 Transmission of microorganisms is reduced, and fewer infections arise, which leads to a reduction in mortality2 and cost savings.3 Implementing a hand hygiene program is itself costly, so the extra investment should be tested for cost-effectiveness.4,5 The first part of our commentary is about cost-effectiveness models and how they inform decision making for health services. The second part is about how data on the effectiveness of hand hygiene programs arising from scientific studies are used, and 2 points are made: the threshold for statistical inference of .05 used to judge effectiveness studies is not important for decision making,6,7 and potentially valuable evidence about effectiveness might be excluded by decision makers because it is deemed low quality.8 The ideas put forward will help researchers and health services decision makers to appraise scientific evidence in a more powerful way.

Risk modelling in quality clinical registries : Monitoring lesion treatment failure rate in percutaneous coronary interventions

Aims: This paper describes the development of a risk adjustment (RA) model predictive of individual lesion treatment failure in percutaneous coronary interventions (PCI) for use in a quality monitoring and improvement program. Methods and results: Prospectively collected data for 3972 consecutive revascularisation procedures (5601 lesions) performed between January 2003 and September 2011 were studied. Data on procedures to September 2009 (n = 3100) were used to identify factors predictive of lesion treatment failure. Factors identified included lesion risk class (p < 0.001), occlusion type (p < 0.001), patient age (p = 0.001), vessel system (p < 0.04), vessel diameter (p < 0.001), unstable angina (p = 0.003) and presence of major cardiac risk factors (p = 0.01). A Bayesian RA model was built using these factors with predictive performance of the model tested on the remaining procedures (area under the receiver operating curve: 0.765, Hosmer–Lemeshow p value: 0.11). Cumulative sum, exponentially weighted moving average and funnel plots were constructed using the RA model and subjectively evaluated. Conclusion: A RA model was developed and applied to SPC monitoring for lesion failure in a PCI database. If linked to appropriate quality improvement governance response protocols, SPC using this RA tool might improve quality control and risk management by identifying variation in performance based on a comparison of observed and expected outcomes.

A systematic review of naturalistic interventions in refugee populations

Naturalistic interventions with refugee populations examine outcomes following mental health interventions in existing refugee service organisations. The current review aimed to examine outcomes of naturalistic interventions and quality of the naturalistic intervention literature in refugee populations with the view to highlight the strengths and limitations of naturalistic intervention studies. Database search was conducted using the search terms ‘refugee’, ‘asylum seeker’, ‘treatment’, ‘therapy’ and ‘intervention. No date limitations were applied, but searches were limited to articles written in English. Seven studies were identified that assessed the outcome of naturalistic interventions on adult refugees or asylum seekers in a country of resettlement using quantitative outcome measures. Results showed significant variation in the outcomes of naturalistic intervention studies, with a trend towards showing decreased symptomatology at post-intervention. However, conclusions are limited by methodological problems of the studies reviewed, particularly poor documentation of intervention methods and lack of control in the design of naturalistic intervention studies. Further examination of outcomes following naturalistic interventions is needed with studies which focus on increasing the rigour of the outcome assessment process.

The SCOOT experience : games in place : collaborative interventions in socio-spatial practices

The principal focus of this thesis is the representation of a significant creative practice in relation to the design and installation of the Location-Based Game, SCOOT. This project demonstrates new understandings relating to the contingencies and potentials for transferring positive aspects of digital gameplay to everyday physical environments in an effort to reveal hidden histories and revitalise peoples’ interactions with their local urban spaces.

Humans, ‘things’ and space : costing hospital infection control interventions

Background: Previous attempts at costing infection control programmes have tended to focus on accounting costs rather than economic costs. For studies using economic costs, estimates tend to be quite crude and probably underestimate the true cost. One of the largest costs of any intervention is staff time, but this cost is difficult to quantify and has been largely ignored in previous attempts. Aim: To design and evaluate the costs of hospital-based infection control interventions or programmes. This article also discusses several issues to consider when costing interventions, and suggests strategies for overcoming these issues. Methods: Previous literature and techniques in both health economics and psychology are reviewed and synthesized. Findings: This article provides a set of generic, transferable costing guidelines. Key principles such as definition of study scope and focus on large costs, as well as pitfalls (e.g. overconfidence and uncertainty), are discussed. Conclusion: These new guidelines can be used by hospital staff and other researchers to cost their infection control programmes and interventions more accurately.

The effectiveness of non-pharmacologic interventions in improving psychological outcomes for heart transplant recipients : a systematic review

Background The International Society for Heart and Lung Transplantation recommended in 2006 that intervention studies to maximize psychological outcomes after transplantation should be conducted. Potentially, studies reporting on the effectiveness of non-pharmacological interventions in improving psychological outcomes for heart transplant recipients may have been published since the call for this research. Thus, further evidence may currently be available to inform policy and practice decision-making regarding the implementation of such interventions. Accordingly, an evaluation of the evidence is required. Objectives The objective of this review was to identify the effectiveness of non-pharmacological interventions on psychological outcomes for heart transplant recipients.

Youth Alcohol and Drug Practice Guide 3 : Practice Strategies and Interventions

This guide canvasses a range of practice strategies and interventions utilised by workers and services who engage with young people experiencing problematic AOD use whilst also exploring the many and varied challenges associated with this type of work.

Letter : anxiety score as a risk factor for radial artery vasospasm during radial interventions : a pilot study

I read with interest the article in Angiology that determined the role of anxiety level on radial artery spasm during transradial coronary angiography.1 As the importance of conducting more randomised controlled trials using anxiolytics to define the relation between anxiety and vasospasm was noted by the authors, I offer the following insights for investigators to consider when conducting such research. While previous research has already identified that moderate procedural sedation and opioid analgesia reduces the incidence of vasospasm,2 the identification of risk factors in the present study is hypothesis generating as to how outcomes might be even further improved. It is possible that selectively applying either even more intensive sedation and analgesia or complementary non-pharmacological stress-reducing therapies, such as music therapy or visualisation and attentive behaviour, to patients ‘at-risk’ of vasospasm (women and those with high levels of anxiety prior to the procedure) might lead to even better patient outcomes...

A test of three interventions to promote people's communication of their consent for organ donation

People's decision to join an organ donor registry and have a discussion with family about their organ donation preference increases the likelihood that their family will consent to donation of their organs. This study explores the effectiveness of three interventions compared to a control condition to increase individual consent (registering and discussing donation wishes) for organ donation. Australian residents who had not previously communicated their consent (N = 177) were randomly allocated to complete an online survey representing either an extended theory of planned behaviour motivational intervention (strengthening intention via attitudes, subjective norms, control, moral norms and identity), a volitional intervention using constructs from the health action process approach (strengthening the translation of intentions into action using action plans and coping plans), a combined motivational and volitional intervention, or a control condition. Registering, but not discussing, intentions increased in the motivational compared to non-motivational conditions. For joining the organ donor registry, the combination of strengthening intentions (motivational) as well as forming specific action (when, where, how, and with whom for discussing) and coping (listing potential obstacles and how these may be overcome) plans (volitional) resulted in significantly higher rates of self-reported behaviour. There was no evidence for this effect on discussion.

Do nursing interventions targeting concurrent symptoms hold promise for managing fatigue in patients with advanced cancer?

TO THE EDITOR: It was with great interest that I read two recent articles by de Raaf et al1, and Bruera et al2. These authors are to be congratulated for completing two of the very few high quality randomized trials that evaluate complex interventions for managing fatigue in patients with advanced cancer. de Raaf et al conducted a non-blinded RCT with 152 patients with advanced cancer and reported significant reduction of fatigue in patients who received a nurse-led monitoring and protocol-guided treatment of physical symptoms compared with those who received usual care1. Patients who received this intervention experienced a significant improvement over time in general fatigue, at one-month follow-up and two-month follow-up. Another recent RCT conducted with 141 patients with advanced cancer by Bruera et al2 did not find any benefits of a nursing telephone intervention that involved systematic symptom assessment/management, medication review, psychosocial support and patient education in fatigue reduction, compared to those who received a control telephone intervention conducted by a non-professional...