Expanding the evidence within evidence-based healthcare:thinking about the context, acceptability and feasibility of interventions

Evidence-based medicine is crucial to contemporary healthcare. It is dependent on systematic review methodology modelled on an arguably inadequate hierarchy of evidence. There has been a significant increase in medical and health research using qualitative and mixed method designs. The perspective taken in this article is that we need to broaden our evidence base if we are to fully take account of issues of context, acceptability and feasibility in the development and implementation of healthcare interventions. One way of doing this is to use a range of methods that better fit the different aspects of intervention development and implementation. Methods for the systematic review of evidence, other than randomised-controlled trials, are available and there is a readiness to incorporate these other types of evidence into good-practice guidance, but we need a clear methodology to translate these advances in research into the world of policy.

Challenges, Strengths and Opportunities Related to Implementing Comprehensive Evidence-Based Guidelines on Breast Cancer Survivorship Care by Primary Care Physicians and Nurse Practitioners in Southeastern Ontario

Background Many breast cancer survivors continue to have a broad range of physical and psychosocial problems after breast cancer treatment. As cancer centres move forward with earlier discharge of stable breast cancer survivors to primary care follow-up it is important that comprehensive evidence-based breast cancer survivorship care is implemented to effectively address these needs. Research suggests primary care providers are willing to provide breast cancer survivorship care but many lack the knowledge and confidence to provide evidence-based care. Purpose The overall purpose of this thesis was to determine the challenges, strengths and opportunities related to implementing comprehensive evidence-based breast cancer survivorship guidelines by primary care physicians and nurse practitioners in southeastern Ontario. Methods This mixed-methods research was conducted in three phases: (1) synthesis and appraisal of clinical practice guidelines relevant to provision of breast cancer survivorship care within the primary care practice setting; (2) a brief quantitative survey of primary care providers to determine actual practices related to provision of evidence-based breast cancer survivorship care; and (3) individual interviews with primary care providers about the challenges, strengths and opportunities related to provision of comprehensive evidence-based breast cancer survivorship care. Results and Conclusions In the first phase, a comprehensive clinical practice framework was created to guide provision of breast cancer survivorship care and consisted of a one-page checklist outlining breast cancer survivorship issues relevant to primary care, a three-page summary of key recommendations, and a one-page list of guideline sources. The second phase identified several knowledge and practice gaps, and it was determined that guideline implementation rates were higher for recommendations related to prevention and surveillance aspects of survivorship care and lowest related to screening for and management of long-term effects. The third phase identified three major challenges to providing breast cancer survivorship care: inconsistent educational preparation, provider anxieties, and primary care burden; and three major strengths or opportunities to facilitate implementation of survivorship care guidelines: tools and technology, empowering survivors, and optimizing nursing roles. A better understanding of these challenges, strengths and opportunities will inform development of targeted knowledge translation interventions to provide support and education to primary care providers.

Quality of implementation in evidence-based positive parenting programs in Spain: Introduction to the special issue

The main contribution of this special issue is to present evaluation studies involving large-scale experiences of implementation of positive parenting programs delivered through home, group-based, and on-line formats in Spain. Two research questions were addressed: (1) what factors affect implementation; and (2) for whom and under which implementation conditions the programs lead to positive outcomes. Target populations were mainly families from low and middle socioeconomic backgrounds, and parents at psychosocial risk attending family support services in need of improving their parenting skills. All the programs fall under the umbrella of the positive parenting initiative launched by the Council of Europe, are evidence-based, follow a collaborative schema with national, regional, or local authorities, have multi-site implementation, and are supported by highly experienced researchers from Spanish universities. Special attention is given to the program adaptations to different contexts, the profile of parents who benefited most from the programs, analyses of the implementation process, and the assessment of parenting programs in the community. The information provided will help to increase our knowledge of evidence-based parenting programs in Spain, their implementation processes and results, and the future challenges that need to be addressed to continue the current expansion of evidence-based parenting programs.

Quality of implementation in an evidence-based family prevention program: the Family Competence Program

Family prevention programs need to be evidence-based in order to guarantee the success of their implementation. The Family Competence Program (FCP), a Spanish cultural adaptation of the Strengthening Families Program (SFP), has developed different measures and processes to gauge the quality of the implementation. This article is dedicated specifically to two of these measures: the evaluation of the facilitators and the assessment of the family engagement techniques. For evaluating the facilitators, a Delphi technique with experts and professionals is undertaken. For assessing the family techniques, both self-evaluation of trainers and evaluation by families are used. Finding underpin that, in the case of facilitators, is important that, after to skills and experience, they need to understand the theory of change of the program. In the case of family engagement techniques, more detailed, comprehensive talks, discussions and group activities lead to better family engagement outcomes.

Providing evidence-based answers to clinical questions - A pilot information service for general practitioners

Objective: To pilot a clinical information service for general practitioners. Methods: A representative sample of 31 GPs was invited to submit clinical questions to a local academic department of general practice. Their views on the service and the usefulness of the information were obtained by telephone interview. Results: Over one month, nine GPs (29% of the sample, 45% of those stating an interest), submitted 20 enquiries comprising 45 discrete clinical questions. The median time to search for evidence, appraise it and write answers to each enquiry was 2.5 hours (range, 1.0-7.4 hours). The median interval between receipt of questions and dispatch of answers was 3 clays (range, 1-12 days). Conclusions: The GPs found the answers useful in clinical decision making; in four out of 20 cases patient management was altered.

Predicting energy requirements in the clinical setting: Are current methods evidence based?

Estimating energy requirements is necessary in clinical practice when indirect calorimetry is impractical. This paper systematically reviews current methods for estimating energy requirements. Conclusions include: there is discrepancy between the characteristics of populations upon which predictive equations are based and current populations; tools are not well understood, and patient care can be compromised by inappropriate application of the tools. Data comparing tools and methods are presented and issues for practitioners are discussed. (C) 2003 International Life Sciences Institute.

Improving access to evidence-based mental health care: general practitioners and allied health professionals collaborate

This study evaluated whether projects conducted through the Access to Allied Health Services component of the Australian Better Outcomes in Mental Health Care initiative are improving access to evidence-based, non-pharmacological therapies for people with depression and anxiety. Synthesising data from the first 29 projects funded through the initiative, the study found that the models utilised in the projects have evolved over time. The projects have achieved a high level uptake; at a conservative estimate, 710 GPs and 160 allied health professionals (AHPs) have provided care to 3,476 consumers. The majority of these consumers have depression (77%) and/or anxiety disorders (55%); many are low income earners (57%); and a number have not previously accessed mental health care (40%). The projects have delivered 8,678 sessions of high quality care to these consumers, most commonly providing CBT-based cognitive and behavioural interventions (55% and 41%, respectively). In general, GPs, AHPs and consumers are sanguine about the projects, and have reported positive consumer outcomes. However, as with any new initiative, there are some practical and professional issues that need to be addressed. The projects are improving access to evidence-based, non-pharmacological therapies. The continuation and expansion of the initiative should be a priority.

An evidence-based medicine fellowship in a children's teaching hospital

This paper reports the introduction of an evidence-based medicine fellowship in a children’s teaching hospital. The results are presented of a self-reported ‘evidence-based medicine’ questionnaire, the clinical questions requested through the information retrieval service are outlined and the results of an information retrieval service user questionnaire are reported. It was confirmed that clinicians have frequent clinical questions that mostly remain unanswered. The responses to four questions with ‘good quality’ evidence-based answers were reviewed and suggest that at least one-quarter of doctors were not aware of the current best available evidence. There was a high level of satisfaction with the information retrieval service; 19% of users indicated that the information changed their clinical practice and 73% indicated that the information confirmed their clinical practice. The introduction of an evidence-based medicine fellowship is one method of disseminating the practice of evidence-based medicine in a tertiary children’s hospital.

Why do we need randomized and epidemiological studies on cardiovascular disease? Evidence-based cardiology VII

Over the last two decades the results of randomized clinical studies, which are powerful aids for correctly assessing therapeutical strategies, have consolidated cardiological practice. In addition, scientifically interesting hypotheses have been generated through the results of epidemiological studies. Properly conducted randomized studies without systematic errors and with statistical power adequate for demonstrating moderate and reasonable benefits in relevant clinical outcomes have provided reliable and strong results altering clinical practice, thus providing adequate treatment for patients with cardiovascular disease (CVD). The dissemination and use of evidence-based medicine in treating coronary artery disease (CAD), heart failure (HF), and in prevention will prevent hundreds of thousands of deaths annually in developed and developing countries. CVD is responsible for approximately 12 million deaths annually throughout the world, and approximately 60% of these deaths occur in developing countries. During recent years, an increase in mortality and morbidity rates due to CVD has occurred in developing countries. This increase is an indication that an epidemiological (demographic, economical, and health-related) transition is taking place in developing countries and this transition implies a global epidemic of CVD, which will require wide-ranging and globally effective strategies for prevention. The identification of conventional and emerging risk factors for CVD, as well as their management in high-risk individuals, has contributed to the decrease in the mortality rate due to CVD. Through a national collaboration, several multi-center and multinational randomized and epidemiological studies have been carried out throughout Brazil, thus contributing not only to a generalized scientific growth in different Brazilian hospitals but also to the consolidation of an increasingly evidence-based clinical practice.

Appropriateness of respiratory care: development of evidence-based guidelines in an acute care hospital

Background: Respiratory care is universally recognised as useful, but its indications and practice vary markedly. In order to improve appropriateness of respiratory care in our hospital, we developed evidence-based local guidelines in a collaborative effort involving physiotherapists, physicians, and health services researchers. Methods: Recommendations were developed using the standardised RAND appropriateness method. A literature search was performed for the period between 1995 and 2008 based on terms associated with guidelines and with respiratory care. Publications were assessed according to the Oxford classification of quality of evidence. A working group prepared proposals for recommendations which were then independently rated by a multidisciplinary expert panel. All recommendations were then discussed in common and indications for procedures were rated confidentially a second time by the experts. Each indication for respiratory care was classified as appropriate, uncertain, or inappropriate, based on the panel median rating and the degree of intra-panel agreement. Results: Recommendations were formulated for the following procedures: non-invasive ventilation, continuous positive airway pressure, intermittent positive pressure breathing, intrapulmonary percussive ventilation, mechanical insufflation-exsufflation, incentive spirometry, positive expiratory pressure, nasotracheal suctioning, noninstrumental airway clearance techniques. Each recommendation referred to a particular medical condition, and was assigned to a hierarchical category based on the quality of evidence from literature supporting the recommendation and on the consensus of experts. Conclusion: Despite a marked heterogeneity of scientific evidence, the method used allowed us to develop commonly agreed local guidelines for respiratory care. In addition, this work fostered a closer relationship between physiotherapists and physicians in our institution.

Evidence-based guidelines on the therapeutic use of repetitive transcranial magnetic stimulation (rTMS).

A group of European experts was commissioned to establish guidelines on the therapeutic use of repetitive transcranial magnetic stimulation (rTMS) from evidence published up until March 2014, regarding pain, movement disorders, stroke, amyotrophic lateral sclerosis, multiple sclerosis, epilepsy, consciousness disorders, tinnitus, depression, anxiety disorders, obsessive-compulsive disorder, schizophrenia, craving/addiction, and conversion. Despite unavoidable inhomogeneities, there is a sufficient body of evidence to accept with level A (definite efficacy) the analgesic effect of high-frequency (HF) rTMS of the primary motor cortex (M1) contralateral to the pain and the antidepressant effect of HF-rTMS of the left dorsolateral prefrontal cortex (DLPFC). A Level B recommendation (probable efficacy) is proposed for the antidepressant effect of low-frequency (LF) rTMS of the right DLPFC, HF-rTMS of the left DLPFC for the negative symptoms of schizophrenia, and LF-rTMS of contralesional M1 in chronic motor stroke. The effects of rTMS in a number of indications reach level C (possible efficacy), including LF-rTMS of the left temporoparietal cortex in tinnitus and auditory hallucinations. It remains to determine how to optimize rTMS protocols and techniques to give them relevance in routine clinical practice. In addition, professionals carrying out rTMS protocols should undergo rigorous training to ensure the quality of the technical realization, guarantee the proper care of patients, and maximize the chances of success. Under these conditions, the therapeutic use of rTMS should be able to develop in the coming years.

Are the health messages in schoolbooks based on scientific evidence? A descriptive study.

BACKGROUND Most textbooks contains messages relating to health. This profuse information requires analysis with regards to the quality of such information. The objective was to identify the scientific evidence on which the health messages in textbooks are based. METHODS The degree of evidence on which such messages are based was identified and the messages were subsequently classified into three categories: Messages with high, medium or low levels of evidence; Messages with an unknown level of evidence; and Messages with no known evidence. RESULTS 844 messages were studied. Of this total, 61% were classified as messages with an unknown level of evidence. Less than 15% fell into the category where the level of evidence was known and less than 6% were classified as possessing high levels of evidence. More than 70% of the messages relating to "Balanced Diets and Malnutrition", "Food Hygiene", "Tobacco", "Sexual behaviour and AIDS" and "Rest and ergonomics" are based on an unknown level of evidence. "Oral health" registered the highest percentage of messages based on a high level of evidence (37.5%), followed by "Pregnancy and newly born infants" (35%). Of the total, 24.6% are not based on any known evidence. Two of the messages appeared to contravene known evidence. CONCLUSION Many of the messages included in school textbooks are not based on scientific evidence. Standards must be established to facilitate the production of texts that include messages that are based on the best available evidence and which can improve children's health more effectively.

Discriminant validity and test-retest reliability of a self-administered Internet-based questionnaire testing doctors' knowledge in evidence-based medicine.

Aims and objectives  This study aimed to determine the discriminant validity and the test-retest reliability of a questionnaire testing the impact of evidence-based medicine (EBM) training on doctors' knowledge and skills. Methods  Questionnaires were sent electronically to all doctors working as residents and chief residents in two French speaking hospital networks in Switzerland. Participants completed the questionnaire twice, within a 4-week interval. The discriminant validity was examined in comparing doctors' performance according to their reported EBM previous training. Proportion of agreement between both sessions of the questionnaire, Cohen's kappa and 'uniform kappa' determined its test-retest reliability. Results  The participation rate was 9.8%/7.1% to first/second session. Performance increased according to the level of doctors' previous training in EBM. The observed proportion of agreement between both sessions was over 70% for 14/19 questions, and the 'uniform kappa' was superior to 0.60 for 15/19 questions. Conclusion  The discriminant validity and test-retest reliability of the questionnaire were satisfying. The low participation rate did not prevent the study from achieving its aims.

Appropriateness of respiratory care: evidence-based guidelines.

PRINCIPLES: Respiratory care is universally recognised as useful, but its indications and practice vary markedly. In order to improve the appropriateness of respiratory care in our hospital, we developed evidence-based local guidelines in a collaborative effort involving physiotherapists, physicians and health service researchers. METHODS: Recommendations were developed using the standardised RAND appropriateness method. A literature search was conducted based on terms associated with guidelines and with respiratory care. A working group prepared proposals for recommendations which were then independently rated by a multidisciplinary expert panel. All recommendations were then discussed in common and indications for procedures were rated confidentially a second time by the experts. The recommendations were then formulated on the basis of the level of evidence in the literature and on the consensus among these experts. RESULTS: Recommendations were formulated for the following procedures: non-invasive ventilation, continuous positive airway pressure, intermittent positive pressure breathing, intrapulmonary percussive ventilation, mechanical insufflation-exsufflation, incentive spirometry, positive expiratory pressure, nasotracheal suctioning and non-instrumental airway clearance techniques. Each recommendation referred to a particular medical condition and was assigned to a hierarchical category based on the quality of the evidence from the literature supporting the recommendation and on the consensus among the experts. CONCLUSION: Despite a marked heterogeneity of scientific evidence, the method used allowed us to develop commonly agreed local guidelines for respiratory care. In addition, this work fostered a closer relationship between physiotherapists and physicians in our institution.

Brief DISCERN, six questions for the evaluation of evidence-based content of health-related websites.

OBJECTIVE: To extract and to validate a brief version of the DISCERN which could identify mental health-related websites with good content quality. METHOD: The present study is based on the analysis of data issued from six previous studies which used DISCERN and a standardized tool for the evaluation of content quality (evidence-based health information) of 388 mental health-related websites. After extracting the Brief DISCERN, several psychometric properties (content validity through a Factor analysis, internal consistency by the Cronbach's alpha index, predictive validity through the diagnostic tests, concurrent validity by the strength of association between the Brief DISCERN and the original DISCERN scores) were investigated to ascertain its general applicability. RESULTS: A Brief DISCERN composed of two factors and six items was extracted from the original 16 items version of the DISCERN. Cronbach's alpha coefficients were more than acceptable for the complete questionnaire (alpha=0.74) and for the two distinct domains: treatments information (alpha=0.87) and reliability (alpha=0.83). Sensibility and specificity of the Brief DISCERN cut-off score > or =16 in the detection of good content quality websites were 0.357 and 0.945, respectively. Its predictive positive and negative values were 0.98 and 0.83, respectively. A statistically significant linear correlation was found between the total scores of the Brief DISCERN and those of the original DISCERN (r=0.84 and p<0.0005). CONCLUSION: The Brief DISCERN seems to be a reliable and valid instrument able to discriminate between websites with good and poor content quality. PRACTICE IMPLICATIONS: The Brief DISCERN is a simple tool which could facilitate the identification of good information on the web by patients and general consumers.