Critical appraisal of meta-analyses: an introductory guide for the practicing surgeon

ABSTRACT: Meta-analyses are an essential tool of clinical research. Meta-analyses of individual randomized controlled trials frequently constitute the highest possible level of scientific evidence for a given research question and allow surgeons to rapidly gain a comprehensive understanding of an important clinical issue. Moreover, meta-analyses often serve as cornerstones for evidence-based surgery, treatment guidelines, and knowledge transfer. Given the importance of meta-analyses to the medical (and surgical) knowledge base, it is of cardinal importance that surgeons have a basic grasp of the principles that guide a high-quality meta-analysis, and be able to weigh objectively the advantages and potential pitfalls of this clinical research tool. Unfortunately, surgeons are often ill-prepared to successfully conduct, critically appraise, and correctly interpret meta-analyses. The objective of this educational review is to provide surgeons with a brief introductory overview of the knowledge and skills required for understanding and critically appraising surgical meta-analyses as well as assessing their implications for their own surgical practice.

Evidence Focused Social Care: on Target or Off-Side?

As contentions continue to engulf the evidence-based practice (EBP) debate within social care, consensus seems to be gravitating towards the softer term of ‘evidence-aware’ practice, although there is as yet no definitive concept on the horizon. Set against a back-drop of competing ideologies, heavily influenced by the natural sciences, what is at stake is the essence of social work: there is a real danger that social work practice be reduced to mere base elements, which seek to eliminate all notions of uncertainly, so essential and endemic to our social world

Reporting quality of systematic review abstracts in leading oral implantology journals

OBJECTIVES Abstracts of systematic reviews are of critical importance, as consumers of research often do not access the full text. This study aimed to assess the reporting quality of systematic review (SR) abstracts in leading oral implantology journals. METHODS Six specialty journals were screened for SRs between 2008 and 2012. A 16-item checklist, based on the PRISMA statement, was used to examine the completeness of abstract reporting. RESULTS Ninety-three SR abstracts were included in this study. The majority were published in Clinical Oral Implants Research (43%). The mean overall reporting quality score was 72.5% (95% CI: 70.8-74.2). Most abstracts were structured (97.9%), adequately reporting objectives (97.9%) and conclusions (93.6%). Conversely, inadequate reporting of methods of the study, background (79.6%), appraisal (65.6%), and data synthesis (65.6%) were observed. Registration of reviews was not reported in any of the included abstracts. Multivariate analysis revealed no difference in reporting quality with respect to continent, number of authors, or meta-analysis conduct. CONCLUSIONS The results of this study suggest that the reporting quality of systematic review abstracts in implantology journals requires further improvement. CLINICAL SIGNIFICANCE Better reporting of SR abstracts is particularly important in ensuring the reliability of research findings, ultimately promoting the practice of evidence-based dentistry. Optimal reporting of SR abstracts should be encouraged, preferably by endorsing the PRISMA for abstracts guidelines.

Assessing the reporting quality in abstracts of randomized controlled trials in leading journals of oral implantology.

AIM Abstracts of randomized clinical trials are extremely important as trial appraisal is often based on the information included here. The objective of this study was to assess the quality of the reporting of RCT abstracts in journals of Oral Implantology. MATERIAL AND METHODS Six leading Implantology journals were screened for RCTs between years 2008 and 2012. A 21-item modified CONSORT for abstracts checklist was used to examine the completeness of abstract reporting. Descriptive statistics and linear regression modeling were employed for data analysis. RESULTS One hundred and sixty three RCT abstracts were included in this study. The majority of the RCTs were published in the Clinical Oral Implants Research (42.9%). The mean overall reporting quality score was 58.6% (95% CI: 57.6-59.7). The highest score was noted in the European Journal of Oral Implantology (63.8%; 95% CI: 61.8-65.8). Multivariate analysis demonstrated that abstract quality score was related to publication journal and number of research centers involved. Most abstracts adequately reported interventions (89.0%), objectives (77.9%) and conclusions (74.8%) while failed to report randomization procedures, allocation concealment, effect estimate, confidence intervals, and funding. Registration of RCTs was not reported in any of the abstracts. CONCLUSIONS The reporting quality in abstracts of RCTs published in Oral Implantology journals needs to be improved. Editors and authors should be encouraged to endorse the CONSORT for abstracts guidelines in order to achieve optimal quality in abstract reporting.

Excision of fascia in melanoma thicker than 2 mm: no evidence for improved clinical outcome.

BACKGROUND Lack of evidence-based data causes significant variation among surgeons concerning the depth of wide excision for primary cutaneous melanomas. OBJECTIVES To evaluate the clinical effect of excision of the deep fascia in melanomas thicker than 2 mm on patient outcome. METHODS We performed a retrospective cohort review (1996-2012) of patients with melanomas thicker than 2 mm. Included patients underwent excision with a 1-cm margin. Data collected included the patients' sex, age, tumour location, tumour type, Breslow depth and presence of ulceration. Local recurrences, locoregional and distant metastases, and disease-free and overall survival were compared between the fascia-excised and the fascia-preserved groups. RESULTS Out of 2182 patients with malignant melanomas, 213 melanomas thicker than 2 mm, with a median follow-up of 1547 days, were included. The mean age of the patients was 62·6 years and the mean Breslow depth was 4·2 mm. Analysis of data for death attributable to melanoma (P = 0·72), local recurrence (P = 0·71), and locoregional (P = 0·87) and distant metastases (P = 0·34) were not significantly different between the study groups. Furthermore, Kaplan-Meier and Cox regression analysis of both groups showed no evidence of significant difference regarding disease-free [P = 0·35; hazard ratio (HR) 1·25; 95% confidence interval (CI) 0·79-1·97] and overall survival (P = 0·63; HR 1·18; 95% CI 0·61-2·27). CONCLUSIONS We believe that excision of the deep fascia does not improve the outcome of melanomas thicker than 2 mm.

Tracing the Evidence: The Use of Evaluation Results in Direct-Democratic Campaigns

Although research on direct-democratic campaigns in Switzerland has intensified in the last decade, detailed information on the use of evidence in campaigns is still lacking. Our research aims to contribute both to research on direct democracy and to research on evidence-based policy making, by analyzing how evaluation results are used in directdemocratic campaigns. In this conceptual paper, the formulation of our hypothesis is based on a model of evaluation influence that traces the different uses of evaluation results in the process of a direct-democratic campaign. We assume that the policy analytical capacity of individual members in parliament, government and administration in the (pre)-parliamentary process fosters the use of evidence in campaigns. In the course of the campaign, symbolic use of evaluation in the form of justification, persuasion or mobilization prevails. We assume that the media is an important player in making transparent how political actors use evidence to support their positions. Evidence itself often remains ambiguous and uncertain, and evaluations are influenced by the values of the evaluator. To be able to make the right decisions, therefore, citizens should learn about possible interpretations in argumentative processes. For us, the context of direct democracy in Switzerland provides the setting for such a discourse that, besides evidence, brings up different opinions, values and beliefs.

Sharing evidence of sustainable land management impacts

Ensuring sustainable use of natural resources is crucial for maintaining the basis for our livelihoods. With threats from climate change, disputes over water, biodiversity loss, competing claims on land, and migration increasing worldwide, the demands for sustainable land management (SLM) practices will only increase in the future. For years already, various national and international organizations (GOs, NGOs, donors, research institutes, etc.) have been working on alternative forms of land management. And numerous land users worldwide – especially small farmers – have been testing, adapting, and refining new and better ways of managing land. All too often, however, the resulting SLM knowledge has not been sufficiently evaluated, documented and shared. Among other things, this has often prevented valuable SLM knowledge from being channelled into evidence-based decision-making processes. Indeed, proper knowledge management is crucial for SLM to reach its full potential. Since more than 20 years, the international WOCAT network documents and promotes SLM through its global platform. As a whole, the WOCAT methodology comprises tools for documenting, evaluating, and assessing the impact of SLM practices, as well as for knowledge sharing, analysis and use for decision support in the field, at the planning level, and in scaling up identified good practices. In early 2014, WOCAT’s growth and ongoing improvement culminated in its being officially recognized by the UNCCD as the primary recommended database for SLM best practices. Over the years, the WOCAT network confirmed that SLM helps to prevent desertification, to increase biodiversity, enhance food security and to make people less vulnerable to the effects of climate variability and change. In addi- tion, it plays an important role in mitigating climate change through improving soil organic matter and increasing vegetation cover. In-depth assessments of SLM practices from desertification sites enabled an evaluation of how SLM addresses prevalent dryland threats. The impacts mentioned most were diversified and enhanced production and better management of water and soil degradation, whether through water harvesting, improving soil moisture, or reducing runoff. Among others, favourable local-scale cost-benefit relationships of SLM practices play a crucial role in their adoption. An economic analysis from the WOCAT database showed that land users perceive a large majority of the technologies as having benefits that outweigh costs in the long term. The high investment costs associated with some practices may constitute a barrier to adoption, however, where appropriate, short-term support for land users can help to promote these practices. The increased global concerns on climate change, disaster risks and food security redirect attention to, and trigger more funds for SLM. To provide the necessary evidence-based rationale for investing in SLM and to reinforce expert and land users assessments of SLM impacts, more field research using inter- and transdisciplinary approaches is needed. This includes developing methods to quantify and value ecosystem services, both on-site and off-site, and assess the resilience of SLM practices, as currently aimed at within the EU FP7 projects CASCADE and RECARE.

Management of bullous pemphigoid: the European Dermatology Forum consensus in collaboration with the European Academy of Dermatology and Venereology

Bullous pemphigoid is the most common autoimmune subepidermal blistering disease of the skin and mucous membranes. This disease typically affects the elderly and presents with itch and localized or generalized bullous lesions. In up to 20% of affected patients, bullae may be completely absent, and only excoriations, prurigo-like lesions, eczematous lesions, urticated lesions and/or infiltrated plaques are observed. The disease is significantly associated with neurological disorders. The morbidity of bullous pemphigoid and its impact on quality of life are significant. So far, a limited number of national treatment guidelines have been proposed, but no common European consensus has emerged. Our consensus for the treatment of bullous pemphigoid has been developed under the guidance of the European Dermatology Forum in collaboration with the European Academy of Dermatology and Venereology. It summarizes evidence-based and expert-based recommendations.

The CONSORT Statement: Application within and adaptations for orthodontic trials

High-quality randomized controlled trials (RCTs) are an integral part of evidence-based medicine. RCTs are the bricks and mortar of high-quality systematic reviews, which are important determinants of health care policy and clinical practice. For published research to be used most effectively, investigators and authors should follow the guidelines for accurate and transparent reporting of RCTs. The consolidated standards of reporting trials (CONSORT) statement and its extensions are among the most widely used reporting guidelines in biomedical research. CONSORT was adopted by the American Journal of Orthodontics and Dentofacial Orthopedics in 2004. Since 2011, this Journal has been actively implementing compliance with the CONSORT reporting guidelines. The objective of this explanatory article is to highlight the relevance and implications of the various CONSORT items to help authors to achieve CONSORT compliance in their research submissions of RCTs to this and other orthodontic journals.

Multiple strategies to prevent premature termination in psychotherapy

A Review of Premature Termination in Psychotherapy: Strategies for Engaging Clients and Improving Outcomes by Joshua K. Swift and Roger P. Greenberg Washington, DC: American Psychological Association. 2015. 212 pp, ISBN 978-1-4338-1801- 1. $69.95 http://dx.doi.org/10.1037/a0038612 Premature Termination in Psychotherapy: Strategies for Engaging Clients and Improving Outcomes is one of the very best examples of the new generation of psychotherapy development. Based on rigorous research findings and a deep look into the preexisting literature, this book presents practical guidelines to understand premature termination and provides evidence-based strategies for how to engage patients in treatment. It will especially be a highlight for practitioners who are interested in a broad insight of the overall empirical literature. For graduate students in clinical and counseling psychology, this book might be an excellent prototype for how to bring rigorous quantitative research and convenient practice examples together.

A practice-based culminating experience: Writing a HRSA grant application with Texas Organ Sharing Alliance for public education efforts to increase solid organ donation

In November 2010, nearly 110,000 people in the United States were waiting for organs for transplantation. Despite the fact that the organ donor registration rate has doubled in the last year, Texas has the lowest registration rate in the nation. Due to the need for improved registration rates in Texas, this practice-based culminating experience was to write an application for federal funding for the central Texas organ procurement organization, Texas Organ Sharing Alliance. The culminating experience has two levels of significance for public health – (1) to engage in an activity to promote organ donation registration, and (2) to provide professional experience in grant writing. ^ The process began with a literature review. The review was to identify successful intervention activities in motivating organ donation registration that could be used in intervention design for the grant application. Conclusions derived from the literature review included (1) the need to specifically encourage family discussions, (2) religious and community leaders can be leveraged to facilitate organ donation conversations in families, (3) communication content must be culturally sensitive and (4) ethnic disparities in transplantation must be acknowledged and discussed.^ Post the literature review; the experience followed a five step process of developing the grant application. The steps included securing permission to proceed, assembling a project team, creation of a project plan and timeline, writing each element of the grant application including the design of proposed intervention activities, and completion of the federal grant application. ^ After the grant application was written, an evaluation of the grant writing process was conducted. Opportunities for improvement were identified. The first opportunity was the need for better timeline management to allow for review of the application by an independent party, iterative development of the budget proposal, and development of collaborative partnerships. Another improvement opportunity was the management of conflict regarding the design of the intervention that stemmed from marketing versus evidence-based approaches. The most important improvement opportunity was the need to develop a more exhaustive evaluation plan.^ Eight supplementary files are attached to appendices: Feasibility Discussion in Appendix 1, Grant Guidance and Workshop Notes in Appendix 2, Presentation to Texas Organ Sharing Alliance in Appendix 3, Team Recruitment Presentation in Appendix 5, Grant Project Narrative in Appendix 7, Federal Application Form in Appendix 8, and Budget Workbook with Budget Narrative in Appendix 9.^

U.S. school based sealant programs: Review of their most common characteristics

In the United States, dental caries is the most common chronic illness in children, occurring five to eight times as frequently as asthma. 11 Dental caries is an unmet health need, disproportionately affecting minority groups and individuals with low socio-economic status.15,34,36 School-Based Sealant Programs were developed to target children at risk, to provide dental services in a closer geographic area, to offer low cost preventive dental services, and to educate families about oral health and prevention.1 There is scientific, evidence based literature that shows the effectiveness of dental sealants preventing dental decay. 13^ Currently, there is no central source for cataloging School-Based Sealant Programs (SBSPs). Information is scattered around publications and documents. For instance, the National Health and Nutrition Examination Survey (NHANES) does not have information about all the existing SBSPs. ^ This literature review determined which are the most common characteristics of SBSPs in the U.S. and determined the extent to which these programs provide sealants to children of low socio-economic status. The method utilized was an electronic database search. Pubmed and EBESCO host databases were searched with Mesh terms like “dental school sealant programs”, “community dentistry”, “school based sealant programs” and “oral preventive programs”. Results were organized in terms of location, population served, providers, funding source and data shared. ^ The searches produced 77 studies, from which 40 were included in this work. Only 18 U.S. states were represented in the results; however these findings are very consistent with the Best Practice Approach – School Based Sealant Programs3. Most of the SBSPs provide their services to children from low income families, and utilized the lower labor cost providers permitted by their state regulations. The author intends that this thesis work will become an aide in the development of future programs, and as evidence for the sustainability of these programs.^

Debriefing after resuscitations in a pediatric emergency department

Multiple guidelines recommend debriefing of actual resuscitations to improve clinical performance. We implemented a novel standardized debriefing program using a Debriefing In Situ Conversation after Emergent Resuscitations Now (DISCERN) tool. Following the development of the evidence-based DISCERN tool, we conducted an observational study of all resuscitations (intubation, CPR, and/or defibrillation) at a pediatric emergency department (ED) over one year. Resuscitation interventions, patient survival, and physician team leader characteristics were analyzed as predictors for debriefing. Each debriefing's participants, time duration, and content were recorded. Thematic content of debriefings was categorized by framework approach into Team Emergency Assessment Measure (TEAM) elements. There were 241 resuscitations and 63 (26%) debriefings. A higher proportion of debriefings occurred after CPR (p<0.001) or ED death (p<0.001). Debriefing participants always included an attending and nurse; the median number of staff roles present was six. Median interval (from resuscitation end to start of debriefing) & debriefing durations were 33 (IQR 15,67) and 10 minutes (IQR 5,12), respectively. Common TEAM themes included co-operation/coordination (30%), communication (22%), and situational awareness (15%). Stated reasons for not debriefing included: unnecessary (78%), time constraints (19%), or other reasons (3%). Debriefings with the DISCERN tool usually involved higher acuity resuscitations, involved most of the indicated personnel, and lasted less than 10 minutes. This qualitative tool could be adapted to other settings. Future studies are needed to evaluate for potential impacts on education, quality improvement programming, and staff emotional well-being.^

The prevention of catheter related bloodstream infections in a pediatric population

Catheter related bloodstream infections are a significant barrier to success in many inpatient healthcare facilities. The goal of this study was to analyze and determine if an evidence based methodology to reduce the number of catheter related bloodstream infections in a pediatric inpatient healthcare facility had significant impact on the infection rate. Catheter related bloodstream infection rates were compared before and after program implementation. The patient population was selected based upon a recommendation in the 2010 National Healthcare Safety Network report on device related infections. This report indicated a need for more data on pediatric populations requiring admission to a long term care facility. The study design is a retrospective cohort study. Catheter related bloodstream infection data was gathered between 2008 and 2011. In October of 2008 a program implementation began to reduce the number of catheter related bloodstream infections. The key components of this initiative were to implement a standardized catheter maintenance checklist, introduce the usage of a chlorhexadine gluconate based product for catheter maintenance and skin antisepsis, and a multidisciplinary education plan that focused on hand hygiene and aseptic technique. The catheter related bloodstream infection rate in 2008 was 21.21 infections per 1000 patient-line days. After program implementation the 2009 catheter related bloodstream infection rate dropped to 1.11 per 1000 patient-line days. The infection rates in 2010 and 2011 were 2.19 and 1.47 respectively. Additionally, this study demonstrated that there was a potential cost savings of $620,000 to $1,240,000 between 2008 and 2009. In conclusion, an evidence based program based upon CDC guidelines can have a significant impact on catheter related bloodstream infection rates. ^

Attitudes and other barriers to the utilization of clinical research findings by American physicians: A systematic review

Background: The Institute of Medicine estimates that only a maximum of 25% of clinical research findings are incorporated into practice by physicians. To improve clinical practice, efforts have been made to promote evidence-based medicine and the use of clinical guidelines. Despite these efforts, the gap between research and clinical practice remains wide.^ Objective: To systematically review the literature describing the factors which influence the use of clinical research recommendations by American physicians.^ Hypothesis: Barriers exist in the application of clinical research into clinical practice, and are multifactorial. The establishment of the Clinical and Translational Awards (CTSA; special federal grants awarded to selected institutions to support clinical and translational research) has reduced the effect of these barriers and improved the process of clinical research translation into practice among American physicians.^ Aims: Identify barriers and facilitators of the use of research findings in clinical practice by American physicians. Contrast studies published six years before and after the creation of the CTSA.^ Methods: The sources of data include published literature from Medline, PubMed and PsycINFO. Selected studies must be qualitative, a survey of American clinicians, based on evidence-based medicine practice, clinical guidelines or treatment pathways. Systematic reviews and reports were excluded, as well as studies with less than 100 respondents.^ Results: In total, 1036 abstracts were reviewed; 115 full text potential articles were identified and reviewed, and a total of 31 studies met all criteria for inclusion in the final review.^ Conclusions: The barriers against the application of clinical research findings, in the forms of clinical guidelines, evidence-based medicine guides and clinical pathways, can be divided broadly into physician barriers, practice/system barriers and patient barriers. Physician barriers are the most common barriers, especially the lack of familiarity with guidelines and the lack of time. Of the factors which improve the use of research based guidelines, physician factors such as younger age, lower duration of clinical practice, specialty training, and practice in large group Health Maintenance Organization (HMO) settings with fewer patients seen were the most commonly cited.^