Cautionary tales in the interpretation of systematic reviews of therapy trials

This is the second in a series of articles emphasizing the cautions in the interpretation of health-care studies. Systematic reviews are presented as comprehensive, unbiased summaries of evidence and are often referred to by clinicians, guideline developers and health policy-makers. Their strengths and limitations, and how their results can be subject to bias and misinterpretation, are discussed.

Appraising qualitative research for inclusion in systematic reviews:A quantitative and qualitative comparison of three methods

Objective: Qualitative research is increasingly valued as part of the evidence for policy and practice, but how it should be appraised is contested. Various appraisal methods, including checklists and other structured approaches, have been proposed but rarely evaluated. We aimed to compare three methods for appraising qualitative research papers that were candidates for inclusion in a systematic review of evidence on support for breast-feeding. Method: A sample of 12 research papers on support for breast-feeding was appraised by six qualitative reviewers using three appraisal methods: unprompted judgement, based on expert opinion; a UK Cabinet Office quality framework; and CASP, a Critical Appraisal Skills Programme tool. Papers were assigned, following appraisals, to 1 of 5 categories, which were dichotomized to indicate whether or not papers should be included in a systematic review. Patterns of agreement in categorization of papers were assessed quantitatively using κ statistics, and qualitatively using cross-case analysis. Results: Agreement in categorizing papers across the three methods was slight (κ =0.13; 95% CI 0.06-0.24). Structured approaches did not appear to yield higher agreement than that by unprompted judgement. Qualitative analysis revealed reviewers' dilemmas in deciding between the potential impact of findings and the quality of the research execution or reporting practice. Structured instruments appeared to make reviewers more explicit about the reasons for their judgements. Conclusions: Structured approaches may not produce greater consistency of judgements about whether to include qualitative papers in a systematic review. Future research should address how appraisals of qualitative research should be incorporated in systematic reviews. © The Royal Society of Medicine Press Ltd 2007.

Conflicting expectations in transforming government service processes: the story of e-payment for social welfare in Ireland

Despite its clear potential and attractiveness as a solution to a broad range of societal problems, E-Government has not been adopted to levels predicted in early 2000 literature. Whilst case studies of punctual development of E-Government initiatives abound, few countries have progressed to high levels of maturity in the systematic use of ICT in the relationship between government and citizens. At the same time, the current period brings challenges in terms of access to public services and costs of delivering these services which make the large scale use of ICT by governments more attractive than ever, if not even a necessity. This paper presents a detailed case study of a specific E-Government initiative in Ireland in the area of E-payments for G2C, in the social welfare area. Locating the current initiative in its historical context, it analyses the varied motivations and conflicting requirements of the numerous stakeholders and discusses the constraints that bear on the potential scenarios that could be followed at this point in time.

Cash or non-cash: that is the question - the story of e-payment for social welfare in Ireland part 2

E-Government in its various forms and extensions, notably T-Government, is often presented as the panacea for resolving such complex social problems as social exclusion, lack of governance transparency, poor value for money and other ailments of modern societies. Yet, E-Government has not been adopted up to predicted levels. Many case studies investigating success factors, maturity models, and the application of acceptance models have been presented over the last 15 years, but a deep understanding of the potential impact and consequences of E-Government is still lacking. This is especially true for those initiatives that involve socio-economic and cultural contexts, which makes their evaluation and the prediction of their impact difficult. This paper reports on an on-going E-Government initiative in Ireland aimed at implementing E-payments for G2C, notably in the social welfare area. Three sets of personal surveys have been carried out to understand the perceived impact of governmental plans of moving from an almost fully cash-based payment system to a fully electronic based solution. Early results indicate that perceived pre-requisites for the planned change may be misleading. The impact on recipients’ lives cannot solely be measured in terms of economic gains: the consequences of such implementation may well reach further than expected.

Pig producer perspectives on the use of meat inspection as an animal health and welfare diagnostic tool in the Republic of Ireland and Northern Ireland

Background
Currently, there is growing interest in developing ante and post mortem meat inspection (MI) to incorporate measures of pig health and welfare for use as a diagnostic tool on pig farms. However, the success of the development of the MI process requires stakeholder engagement with the process. Knowledge gaps and issues of trust can undermine the effective exchange and utilisation of information across the supply chain. A social science research methodology was employed to establish stakeholder perspectives towards the development of MI to include measures of pig health and welfare. In this paper the findings of semi-structured telephone interviews with 18 pig producers from the Republic of Ireland and Northern Ireland are presented.

Results
Producers recognised the benefit of the utilisation of MI data as a health and welfare diagnostic tool. This acknowledgment, however, was undermined for some by dissatisfaction with the current system of MI information feedback, by trust and fairness concerns, and by concerns regarding the extent to which data would be used in the producers’ interests. Tolerance of certain animal welfare issues may also have a negative impact on how producers viewed the potential of MI data. The private veterinary practitioner was viewed as playing a vital role in assisting them with the interpretation of MI data for herd health planning.

Conclusions
The development of positive relationships based on trust, commitment and satisfaction across the supply chain may help build a positive environment for the effective utilisation of MI data in improving pig health and welfare. The utilisation of MI as a diagnostic tool would benefit from the development of a communication strategy aimed at building positive relationships between stakeholders in the pig industry.

A taxing definition — a comment on the industry commission's draft proposals for defining community social welfare organisations

The draft report of the Industry Commission's charitable organisations inquiry introduces a new term for nonprofit organisations delivering human services. The new term is "community social welfare organisation" or "CSWO". The report recommends that tax deductibility of donations be extended such organisations. It then hints at making the definition of CSWO a standard criteria for state taxation exemptions. This paper examines the definition of the new term community social welfare organisation and charts its possible consequences if adopted by the federal government. The promise of tax deductibility status to previously shunned organisations is largely illusory. The Commission's aim of simplification through clarification of the definition is flawed and will not reduce the administration costs for the Australian Tax Office (ATO) or organisations.

Evidence of effectiveness : high level synthesis of research to prevent obesity and increase physical activity in children

Background Prevention of childhood obesity is a public health priority for Malaysia and many other countries. Physical activity for children is also decreasing at an alarming rate. Both conditions are associated with non-communicable diseases and with significant morbidity and mortality in later life. Systematic reviews of public health interventions provide a useful summary to inform public health practice by combining the results of a range of research studies on a specific intervention into a single report. Systematic reviews are deemed most valuable for health program development and evidence based practice. Unfortunately, many policy makers and practitioners are simply unaware of the evidence: which strategies which are most likely to provide benefit; and which strategies are known to be harmful or useless. This presentation provides a “birds eye” overview based upon recent (since 2007 to present) high quality systematic reviews of public health interventions. Method HealthEvidece.org and the Cochrane Library were searched for systematic reviews which evaluated interventions targeting obesity prevention and increasing physical activity for children. The findings of the included reviews were themed and summarized. Results Seven reviews were identified addressing obesity in the early years, and fifteen reviews addressing obesity more broadly in childhood. Additional reviews were identified aimed at increasing physical activity. The synthesis shows several strategies to be effective, however many popular strategies clearly are not. Several of the reviews were inconclusive due to an absence of robust primary studies. Amongst the findings, interventions undertaken in the school setting appear very promising. Conclusions There is significant evidence from systematic reviews to guide public health practice and policy, and to inform future research.

Physical activity and population health outcomes

SMA members Neville Owen, Adrian Bauman, Wendy Brown and Stewart Trost have recently been awarded two NHMRC grants for research which will focus on understanding and influencing physical activity to improve population health outcomes. They were awarded under the Capital Building for Population Health scheme and the Program Grants scheme. The total value of the grants is 86.5 million over five years. The new grants will allow the researchers to conduct rigorous behavioural and epidemiological research which will inform the development of innovative primary and secondary prevention initiatives and determine their effectiveness. This is important, because physical activity is significantly implicated in the prevention and management of established chronic health problems such as cardiovascular disease, type 2 diabetes, osteoporosis and some forms of cancer. It also has a key role to play in addressing the growing epidemic of childhood and adult obesity, and in the maintenance of functional well-being with age. However, in recent years, physical activity levels in Australia have declined, indicating that the net sum of all our efforts to encourage physical activity participation require renewed and innovative efforts. The proposed research programs will be based on the researchers' cross-disciplinary backgrounds in exercise physiology, psychology, health promotion and epidemiology, and will be integrated across four main domains:..