Using meta-synthesis to facilitate evidence-based practice

In a previous column, Fineout-Overholt et al. (2008) discussed the use of systematic reviews in decision making for clinical practice, focusing primarily on the quantitative studies, such as randomised controlled trials. Narrative reviews were included but in less detail; this was intentional because the synthesis of qualitative evidence is a complex process and has evoked significant discussion over the past 5 years. Consequently, this column addresses some of the process issues surrounding qualitative evidence synthesis, or meta-synthesis as it is more commonly known, and offers ideas for how evidence arising from these can be used to inform education, teaching, and practice.

Evaluation of the questions used to elicit evidence about abuse from child witnesses : Australian study

This study provides one of the first objective evaluations of the performance of a group of Australian police officers when conducting interviews about child abuse. The interviews included 136 videotaped child witness statements, conducted between 2001 and 2007 by police officers from two jurisdictions of Australia. The results indicated many positive aspects of the interviewers' performance, including the use of ground rules at the outset of the interview, commencement of the free-narrative account by seeking the children's understanding of the purpose of the interview, and avoidance of suggestive questions. But the interviewers tended to raise issues of contention when the child did not provide an initial disclosure, and the proportion of open-ended questions was low relative to specific cued-recall and closed questions. Further many closed questions raised specific details not yet mentioned by the child. These behaviours were exhibited irrespective of the recency of interview or time since training. The implications of these findings are discussed.

Why do Australians, New Zealanders and Americans travel to Fiji? Evidence from cointegration, unit roots and parameter stability tests

The aim of this study was to estimate the demand for Fiji’s tourism from its three main source markets—Australia, New Zealand, and the US—using the bounds testing approach to cointegration. Our main finding was that visitor arrivals to Fiji and its key determinants are cointegrated over the 1970–2000 period. We then used the autoregressive distributed lag model to estimate short-run and long-run elasticities and found that income in origin countries, transport costs, and prices were significant determinants of Fiji’s tourism demand. We also found that coups negatively impact visitor arrivals from all markets. In testing for parameter stability, we established that the series were integrated of order one in the presence of a structural break. We then used the Hansen test for parameter stability and found that the parameters of our long-run model are stable over time.

An exploratory cluster randomised controlled trial of knowledge translation strategies to support evidence-informed decision-making in local governments (The KT4LG study)

Background: Childhood overweight and obesity is the most prevalent and, arguably, politically complex child health problem internationally. Governments, communities and industry have important roles to play, and are increasingly expected to deliver an evidence-informed system-wide prevention program. However, efforts are impeded by a lack of organisational access to and use of research evidence. This study aims to identify feasible, acceptable and ideally, effective knowledge translation (KT) strategies to increase evidence-informed decision making in local governments, within the context of childhood obesity prevention as a national policy priority.
Methods/Design: This paper describes the methods for KT4LG, a cluster randomised controlled trial which is exploratory in nature, given the limited evidence base and methodological advances. KT4LG aims to examine a program of KT strategies to increase the use of research evidence in informing public health decisions in local governments. KT4LG will also assess the feasibility and acceptability of the intervention. The intervention program comprises a facilitated program of evidence awareness, access to tailored research evidence, critical appraisal skills development, networking and evidence summaries and will be compared to provision of evidence summaries alone in the control program. 28 local governments were randomised to intervention or control, using computer generated numbers, stratified by budget tertile (high, medium or low). Questionnaires will be used to measure impact, costs, and outcomes, and key informant interviews will be used to examine processes, feasibility, and experiences. Policy tracer studies will be included to examine impact of intervention on policies within relevant government policy documents.
Discussion: Knowledge translation intervention studies with a focus on public health and prevention are very few in number. Thus, this study will provide essential data on the experience of program implementation and evaluation of a system-integrated intervention program employed within the local government public health context. Standardised programs of system, organisational and individual KT strategies have not been described or rigorously evaluated. As such, the findings will make a significant contribution to understanding whether a facilitated program of KT strategies hold promise for facilitating evidence-informed public health decision making within complex multisectoral government organisations.

A realist review of interventions and strategies to promote evidence-informed healthcare: a focus on change agency

Background
Change agency in its various forms is one intervention aimed at improving the effectiveness of the uptake of evidence. Facilitators, knowledge brokers and opinion leaders are examples of change agency strategies used to promote knowledge utilization. This review adopts a realist approach and addresses the following question: What change agency characteristics work, for whom do they work, in what circumstances and why?

Methods
The literature reviewed spanned the period 1997-2007. Change agency was operationalized as roles that are aimed at effecting successful change in individuals and organizations. A theoretical framework, developed through stakeholder consultation formed the basis for a search for relevant literature. Team members, working in sub groups, independently themed the data and developed chains of inference to form a series of hypotheses regarding change agency and the role of change agency in knowledge use.

Results
24, 478 electronic references were initially returned from search strategies. Preliminary screening of the article titles reduced the list of potentially relevant papers to 196. A review of full document versions of potentially relevant papers resulted in a final list of 52 papers. The findings add to the knowledge of change agency as they raise issues pertaining to how change agents’ function, how individual change agent characteristics effect evidence-informed health care, the influence of interaction between the change agent and the setting and the overall effect of change agency on knowledge utilization. Particular issues are raised such as how accessibility of the change agent, their cultural compatibility and their attitude mediate overall effectiveness. Findings also indicate the importance of promoting reflection on practice and role modeling. The findings of this study are limited by the complexity and diversity of the change agency literature, poor indexing of literature and a lack of theory-driven approaches.

Conclusion
This is the first realist review of change agency. Though effectiveness evidence is weak, change agent roles are evolving, as is the literature, which requires more detailed description of interventions, outcomes measures, the context, intensity, and levels at which interventions are implemented in order to understand how change agent interventions effect evidence-informed health care.

Primary health-care costs associated with special health care needs up to age 7 years: Australian population-based study.

We studied infants and children with and without special health care needs (SHCN) during the first 8 years of life to compare the (i) types and costs to the government's Medicare system of non-hospital health-care services and prescription medication in each year and (ii) cumulative costs according to persistence of SHCN.

Understanding evidence: a statewide survey to explore evidence-informed public health decision-making in a local government setting

 Background: The value placed on types of evidence within decision-making contexts is highly dependent on individuals, the organizations in which the work and the systems and sectors they operate in. Decision-making processes too are highly contextual. Understanding the values placed on evidence and processes guiding decision-making is crucial to designing strategies to support evidence-informed decision-making (EIDM). This paper describes how evidence is used to inform local government (LG) public health decisions.
Methods: The study used mixed methods including a cross-sectional survey and interviews. The Evidence-Informed Decision-Making Tool (EvIDenT) survey was designed to assess three key domains likely to impact on EIDM: access, confidence, and organizational culture. Other elements included the usefulness and influence of sources of evidence (people/groups and resources), skills and barriers, and facilitators to EIDM. Forty-five LGs from Victoria, Australia agreed to participate in the survey and up to four people from each organization were invited to complete the survey (n = 175). To further explore definitions of evidence and generate experiential data on EIDM practice, key informant interviews were conducted with a range of LG employees working in areas relevant to public health.
Results: In total, 135 responses were received (75% response rate) and 13 interviews were conducted. Analysis revealed varying levels of access, confidence and organizational culture to support EIDM. Significant relationships were found between domains: confidence, culture and access to research evidence. Some forms of evidence (e.g. community views) appeared to be used more commonly and at the expense of others (e.g. research evidence). Overall, a mixture of evidence (but more internal than external evidence) was influential in public health decision-making in councils. By comparison, a mixture of evidence (but more external than internal evidence) was deemed to be useful in public health decision-making.
Conclusions: This study makes an important contribution to understanding how evidence is used within the public health LG context.

Unconditional transfers goes to health? Evidence from Brazilian municipalities

This study assesses the impact of unconditional transfer resources on the health indicators of Brazilian municipalities. This transfer refers to the Participation Fund of Municipalities (FPM) where at least 15% of its value should be spent on public health. Based on a discontinuity of the rules of transfers, we explore Regression Discontinuous Design for the years 2002 to 2010, and find: (i) no significant effect of FPM on mortality reduction; (ii) a robust and significant reduction in morbidity, treated municipalities – on the right side of thresholds – on average have a per capita rate of morbidity 0.00821% lower than those on the left side of the cutoff points; (iii) the mechanisms through which a reduction on morbidity could be operated would be due to estimated increases in preventive measures such as consultations and medical and nurses visits, these were bigger for the treated group in, respectively, 0.32%, 0.038% and 0.039%.