Evaluation of a national evidence-based health care course via teleconference in a developing country

Rationale, aims and objectives Continuing health education is essential but challenged. in 2006, the Brazilian Cochrane Center, in collaboration with the Ministry of Health, launched a mass teaching initiative in evidence-based health care (EBH) for public-sector professionals via teleconferencing. This 152-hour, interactive EBH course has enrolled over 4500 professionals. This study aimed to assess the acquisition EBH knowledge and skills, as well as the attitudes and perceptions of a sample of students enrolled in the 2009 course via teleconferencing.Methods This prospective cohort study analyzed three aspects of this 152-hour EBH course that recruited 1040 volunteer participants, all public health sector employees working in 131 different hospitals or health agencies. Pre- and post-course tests using a modified version of the Berlin questionnaire with 20 multiple-choice questions were used to examine knowledge acquisition in a sample of 297 students. Tests were completed upon registration and at course completion. the research projects submitted by 872 participants were evaluated to assess skill acquisition. Answers to an anonymous survey assessed the attitudes and perceptions of 914 participants.Results There was a significant increase in knowledge from baseline to course completion (mean scores 8.2 +/- 3.3 versus 13.7 +/- 3.0, P < 0.001). Over 90% of the research projects were judged to be of adequate quality (appropriate rationale for the study, well-formulated research question and feasible execution); over 95% of the participants were satisfied with the course.Conclusion the Brazilian EBH course via teleconference improved the knowledge and skills of public-sector health professionals and was approved by the vast majority of students.

What Are the Effects of Teaching Evidence-Based Health Care (EBHC)? Overview of Systematic Reviews

Background

An evidence-based approach to health care is recognized internationally as a key competency for healthcare practitioners. This overview systematically evaluated and organized evidence from systematic reviews on teaching evidence-based health care (EBHC).

Methods/Findings

We searched for systematic reviews evaluating interventions for teaching EBHC to health professionals compared to no intervention or different strategies. Outcomes covered EBHC knowledge, skills, attitudes, practices and health outcomes. Comprehensive searches were conducted in April 2013. Two reviewers independently selected eligible reviews, extracted data and evaluated methodological quality. We included 16 systematic reviews, published between 1993 and 2013. There was considerable overlap across reviews. We found that 171 source studies included in the reviews related to 81 separate studies, of which 37 are in more than one review. Studies used various methodologies to evaluate educational interventions of varying content, format and duration in undergraduates, interns, residents and practicing health professionals. The evidence in the reviews showed that multifaceted, clinically integrated interventions, with assessment, led to improvements in knowledge, skills and attitudes. Interventions improved critical appraisal skills and integration of results into decisions, and improved knowledge, skills, attitudes and behaviour amongst practicing health professionals. Considering single interventions, EBHC knowledge and attitude were similar for lecture-based versus online teaching. Journal clubs appeared to increase clinical epidemiology and biostatistics knowledge and reading behavior, but not appraisal skills. EBHC courses improved appraisal skills and knowledge. Amongst practicing health professionals, interactive online courses with guided critical appraisal showed significant increase in knowledge and appraisal skills. A short workshop using problem-based approaches, compared to no intervention, increased knowledge but not appraisal skills.

Conclusions

EBHC teaching and learning strategies should focus on implementing multifaceted, clinically integrated approaches with assessment. Future rigorous research should evaluate minimum components for multifaceted interventions, assessment of medium to long-term outcomes, and implementation of these interventions.

Patience, Persistence and Pragmatism: Experiences and Lessons Learnt from the Implementation of Clinically Integrated Teaching and Learning of Evidence-Based Health Care - A Qualitative Study

Background

Clinically integrated teaching and learning are regarded as the best options for improving evidence-based healthcare (EBHC) knowledge, skills and attitudes. To inform implementation of such strategies, we assessed experiences and opinions on lessons learnt of those involved in such programmes.

Methods and Findings

We conducted semi-structured interviews with 24 EBHC programme coordinators from around the world, selected through purposive sampling. Following data transcription, a multidisciplinary group of investigators carried out analysis and data interpretation, using thematic content analysis. Successful implementation of clinically integrated teaching and learning of EBHC takes much time. Student learning needs to start in pre-clinical years with consolidation, application and assessment following in clinical years. Learning is supported through partnerships between various types of staff including the core EBHC team, clinical lecturers and clinicians working in the clinical setting. While full integration of EBHC learning into all clinical rotations is considered necessary, this was not always achieved. Critical success factors were pragmatism and readiness to use opportunities for engagement and including EBHC learning in the curriculum; patience; and a critical mass of the right teachers who have EBHC knowledge and skills and are confident in facilitating learning. Role modelling of EBHC within the clinical setting emerged as an important facilitator. The institutional context exerts an important influence; with faculty buy-in, endorsement by institutional leaders, and an EBHC-friendly culture, together with a supportive community of practice, all acting as key enablers. The most common challenges identified were lack of teaching time within the clinical curriculum, misconceptions about EBHC, resistance of staff, lack of confidence of tutors, lack of time, and negative role modelling.

Conclusions

Implementing clinically integrated EBHC curricula requires institutional support, a critical mass of the right teachers and role models in the clinical setting combined with patience, persistence and pragmatism on the part of teachers.

How valuable are multiple treatment comparison methods in evidence-based health-care evaluation?

Objectives To compare the use of pair-wise meta-analysis methods to multiple treatment comparison (MTC) methods for evidence-based health-care evaluation to estimate the effectiveness and cost-effectiveness of alternative health-care interventions based on the available evidence. Methods Pair-wise meta-analysis and more complex evidence syntheses, incorporating an MTC component, are applied to three examples: 1) clinical effectiveness of interventions for preventing strokes in people with atrial fibrillation; 2) clinical and cost-effectiveness of using drug-eluting stents in percutaneous coronary intervention in patients with coronary artery disease; and 3) clinical and cost-effectiveness of using neuraminidase inhibitors in the treatment of influenza. We compare the two synthesis approaches with respect to the assumptions made, empirical estimates produced, and conclusions drawn. Results The difference between point estimates of effectiveness produced by the pair-wise and MTC approaches was generally unpredictable—sometimes agreeing closely whereas in other instances differing considerably. In all three examples, the MTC approach allowed the inclusion of randomized controlled trial evidence ignored in the pair-wise meta-analysis approach. This generally increased the precision of the effectiveness estimates from the MTC model. Conclusions The MTC approach to synthesis allows the evidence base on clinical effectiveness to be treated as a coherent whole, include more data, and sometimes relax the assumptions made in the pair-wise approaches. However, MTC models are necessarily more complex than those developed for pair-wise meta-analysis and thus could be seen as less transparent. Therefore, it is important that model details and the assumptions made are carefully reported alongside the results.

Creating local bibliographic databases: new tools for evidence-based health care*

The Internet has created new opportunities for librarians to present literature search results to clinicians. In order to take full advantage of these opportunities, libraries need to create locally maintained bibliographic databases. A simple method of creating a local bibliographic database and publishing it on the Web is described. The method uses off-the-shelf software and requires minimal programming. A hedge search strategy for outcome studies of clinical process interventions is created, and Ovid is used to search MEDLINE. The search results are saved and imported into EndNote libraries. The citations are modified, exported to a Microsoft Access database, and published on the Web. Clinicians can use a Web browser to search the database. The bibliographic database contains 13,803 MEDLINE citations of outcome studies. Most searches take between four and ten seconds and retrieve between ten and 100 citations. The entire cost of the software is under $900. Locally maintained bibliographic databases can be created easily and inexpensively. They significantly extend the evidence-based health care services that libraries can offer to clinicians.

Health service pathways for patients with chronic leg ulcers : identifying effective pathways for facilitation of evidence based wound care

Background: Chronic leg ulcers cause long term ill-health for older adults and the condition places a significant burden on health service resources. Although evidence on effective management of the condition is available, a significant evidence-practice gap is known to exist, with many suggested reasons e.g. multiple care providers, costs of care and treatments. This study aimed to identify effective health service pathways of care which facilitated evidence-based management of chronic leg ulcers. Methods: A sample of 70 patients presenting with a lower limb leg or foot ulcer at specialist wound clinics in Queensland, Australia were recruited for an observational study and survey. Retrospective data were collected on demographics, health, medical history, treatments, costs and health service pathways in the previous 12 months. Prospective data were collected on health service pathways, pain, functional ability, quality of life, treatments, wound healing and recurrence outcomes for 24 weeks from admission. Results: Retrospective data indicated that evidence based guidelines were poorly implemented prior to admission to the study, e.g. only 31% of participants with a lower limb ulcer had an ABPI or duplex assessment in the previous 12 months. On average, participants accessed care 2–3 times/week for 17 weeks from multiple health service providers in the twelve months before admission to the study clinics. Following admission to specialist wound clinics, participants accessed care on average once per week for 12 weeks from a smaller range of providers. The median ulcer duration on admission to the study was 22 weeks (range 2–728 weeks). Following admission to wound clinics, implementation of key indicators of evidence based care increased (p<0.001) and Kaplan-Meier survival analysis found the median time to healing was 12 weeks (95% CI 9.3–14.7). Implementation of evidence based care was significantly related to improved healing outcomes (p<0.001). Conclusions: This study highlights the complexities involved in accessing expertise and evidence based wound care for adults with chronic leg or foot ulcers. Results demonstrate that access to wound management expertise can promote streamlined health services and evidence based wound care, leading to efficient use of health resources and improved health.

Evidence-Based Health Practice

Research is one of the subjects that students in the health professions often find challenging and yet the process of finding, critiquing, using and evaluating information is essential to professional development and practice. This book introduces fundamental research concepts that are relevant to the wider health-care and disability support sector while also making strong connections to the various areas of practice that students identify with.Examples and cases are taken from a wide range of professions and countries to help students understand the significance of research used by colleagues from other disciplines and become interprofessional practitioners.

The impact of health information technology on the quality of medical and health care : a systematic review

Objective: To systematically review the published evidence of the impact of health information technology (HIT) on the quality of medical and health care specifically clinicians’ adherence to evidence-based guidelines and the corresponding impact this had on patient clinical outcomes. In order to be as inclusive as possible the research examined literature discussing the use of health information technologies and systems in both medical care such as clinical and surgical, and other health care such as allied health and preventive services.----- Design: Systematic review----- Data Sources: Relevant literature was systematically searched on English language studies indexed in MEDLINE and CINAHL(1998 to 2008), Cochrane Library, PubMed, Database of Abstracts of Review of Effectiveness (DARE), Google scholar and other relevant electronic databases. A search for eligible studies (matching the inclusion criteria) was also performed by searching relevant conference proceedings available through internet and electronic databases, as well as using reference lists identified from cited papers.----- Selection criteria: Studies were included in the review if they examined the impact of Electronic Health Record (EHR), Computerised Provider Order-Entry (CPOE), or Decision Support System (DS); and if the primary outcomes of the studies were focused on the level of compliance with evidence-based guidelines among clinicians. Measures could be either changes in clinical processes resulting from a change of the providers’ behaviour or specific patient outcomes that demonstrated the effectiveness of a particular treatment given by providers. ----- Methods: Studies were reviewed and summarised in tabular and text form. Due to heterogeneity between studies, meta-analysis was not performed.----- Results: Out of 17 studies that assessed the impact of health information technology on health care practitioners’ performance, 14 studies revealed a positive improvement in relation to their compliance with evidence-based guidelines. The primary domain of improvement was evident from preventive care and drug ordering studies. Results from the studies that included an assessment for patient outcomes however, were insufficient to detect either clinically or statistically important improvements as only a small proportion of these studies found benefits. For instance, only 3 studies had shown positive improvement, while 5 studies revealed either no change or adverse outcomes.----- Conclusion: Although the number of included studies was relatively small for reaching a conclusive statement about the effectiveness of health information technologies and systems on clinical care, the results demonstrated consistency with other systematic reviews previously undertaken. Widescale use of HIT has been shown to increase clinician’s adherence to guidelines in this review. Therefore, it presents ongoing opportunities to maximise the uptake of research evidence into practice for health care organisations, policy makers and stakeholders.

Evidence-based practice

This chapter traces the history of evidence-based practice (EBP) from its roots in evidence-based medicine to contemporary thinking about the usefulness of such an approach to public health practice. It defines EBP and differentiates it from terms such as evidence-based medicine, evidence-based policy and evidence-based health care. As EBP is concerned with identifying ‘good evidence’, this chapter will briefly describe the nature and production of knowledge, as it is important to understand the subjective nature of knowledge and the research process. This chapter considers the necessary skills for EBP, and discusses the processes of attaining the necessary evidence and its limitations. We examine the barriers and facilitators to identifying and implementing ‘best practice’, and when EBP is appropriate to use. There is a discussion about the limitations of EBP and the potential use of other sources of information to guide practice, and concluding information about the application of evidence to guide policy and practice.

Challenges of minimizing heat loss at birth: A narrative overview of evidence-based thermal care interventions

Evidence-based thermal care recommendations designed to minimize heat loss immediately at birth are readily available however, hypothermia still persists as a global challenge especially when caring for the most immature and smallest preterm infants. In this narrative overview we aim to provide the reader with a succinct summary of the causes and consequences of hypothermia, the extent of the problem (rates of hypothermia), principles of good thermal care, delivery room preventative measures, the research evidence underpinning existing interventions, current issues in practice, and the way forward. Due to the plethora of research literature available in this subject area, our article will focus primarily on evidence derived from systematic reviews and randomized or quasi-randomized controlled trials assessing the effectiveness of interventions to prevent hypothermia in the most vulnerable (preterm/low birth weight) infants where the intervention or combination of interventions is applied immediately at birth. © 2014.

A role for workforce competencies in evidence-based health promotion education

Education programs should be based on research about the knowledge and skills required for practice, rather than on intuition or tradition, but there is limited published curriculum research on health promotion education. This paper describes a case study of how workforce competencies have been used to assist evidence-based health promotion education in the areas of curriculum design, selection of assessment tasks and continuous quality assurance processes in an undergraduate program at an Australian university. A curriculum-competency mapping process successfully identified gaps and areas of overlap in an existing program. Previously published health promotion workforce competencies were effectively used in the process of selecting assessment items, providing clear guidelines for curriculum revision and a useful method to objectively assess competency content in an evidence informed framework. These health promotion workforce competencies constituted an additional tool to assess course quality. We recommend other tertiary institutions consider curriculum-competency mapping and curriculum based assessment selection as quality and evidence based curriculum review strategies.

Presenting evidence-based health information for people with multiple sclerosis : the IN-DEEP project protocol

Background - Increasingly, evidence-based health information, in particular evidence from systematic reviews, is being made available to lay audiences, in addition to health professionals. Research efforts have focused on different formats for the lay presentation of health information. However, there is a paucity of data on how patients integrate evidence-based health information with other factors such as their preferences for information and experiences with information-seeking. The aim of this project is to explore how people with multiple sclerosis (MS) integrate health information with their needs, experiences, preferences and values and how these factors can be incorporated into an online resource of evidence-based health information provision for people with MS and their families.

Methods - This project is an Australian-Italian collaboration between researchers, MS societies and people with MS. Using a four-stage mixed methods design, a model will be developed for presenting evidence-based health information on the Internet for people with MS and their families. This evidence-based health information will draw upon systematic reviews of MS interventions from The Cochrane Library. Each stage of the project will build on the last. After conducting focus groups with people with MS and their family members (Stage 1), we will develop a model for summarising and presenting Cochrane MS reviews that is integrated with supporting information to aid understanding and decision making. This will be reviewed and finalised with people with MS, family members, health professionals and MS Society staff (Stage 2), before being uploaded to the Internet and evaluated (Stages 3 and 4).

Discussion - This project aims to produce accessible and meaningful evidence-based health information about MS for use in the varied decision making and management situations people encounter in everyday life. It is expected that the findings will be relevant to broader efforts to provide evidence-based health information for patients and the general public. The international collaboration also permits exploration of cultural differences that could inform international practice.