A Path Forward: Evidence-Based Approaches to Educational Policy and Practice

In the complex landscape of public education, participants at all levels are searching for policy and practice levers that can raise overall performance and close achievement gaps. The collection of articles in this edition of the Journal of Applied Research on Children takes a big step toward providing the tools and tactics needed for an evidence-based approach to educational policy and practice.

Proof in the pedagogic pudding? The challenges of promoting evidence-based teaching practice in a research-focused institution

Drawing upon the findings of a mixed methodological study, this paper critically analyses the cultural, pedagogical, and organisational issues encountered by academics and support staff working within a newly established Centre for Learning Innovation and Professional Practice tasked with facilitating a new teaching-focused policy in a previously research-led institution. The aim of this policy is to assure that, across the institution, teaching is given the same priority and kudos as research. Focusing specifically staff perceptions of the impact of the new policy on various aspects of academic life including, pedagogic practice, student support, staff training, and organisational management, the paper critically addresses the cultural and attitudinal challenges of change management (Kotter, 1996) within a ‘grey-brick’ university. In doing so it makes a significant contribution to current academic theory and debate in the areas of pedagogic practice and organisational management.

Providing evidence-based answers to clinical questions - A pilot information service for general practitioners

Objective: To pilot a clinical information service for general practitioners. Methods: A representative sample of 31 GPs was invited to submit clinical questions to a local academic department of general practice. Their views on the service and the usefulness of the information were obtained by telephone interview. Results: Over one month, nine GPs (29% of the sample, 45% of those stating an interest), submitted 20 enquiries comprising 45 discrete clinical questions. The median time to search for evidence, appraise it and write answers to each enquiry was 2.5 hours (range, 1.0-7.4 hours). The median interval between receipt of questions and dispatch of answers was 3 clays (range, 1-12 days). Conclusions: The GPs found the answers useful in clinical decision making; in four out of 20 cases patient management was altered.

Predicting energy requirements in the clinical setting: Are current methods evidence based?

Estimating energy requirements is necessary in clinical practice when indirect calorimetry is impractical. This paper systematically reviews current methods for estimating energy requirements. Conclusions include: there is discrepancy between the characteristics of populations upon which predictive equations are based and current populations; tools are not well understood, and patient care can be compromised by inappropriate application of the tools. Data comparing tools and methods are presented and issues for practitioners are discussed. (C) 2003 International Life Sciences Institute.

Improving access to evidence-based mental health care: general practitioners and allied health professionals collaborate

This study evaluated whether projects conducted through the Access to Allied Health Services component of the Australian Better Outcomes in Mental Health Care initiative are improving access to evidence-based, non-pharmacological therapies for people with depression and anxiety. Synthesising data from the first 29 projects funded through the initiative, the study found that the models utilised in the projects have evolved over time. The projects have achieved a high level uptake; at a conservative estimate, 710 GPs and 160 allied health professionals (AHPs) have provided care to 3,476 consumers. The majority of these consumers have depression (77%) and/or anxiety disorders (55%); many are low income earners (57%); and a number have not previously accessed mental health care (40%). The projects have delivered 8,678 sessions of high quality care to these consumers, most commonly providing CBT-based cognitive and behavioural interventions (55% and 41%, respectively). In general, GPs, AHPs and consumers are sanguine about the projects, and have reported positive consumer outcomes. However, as with any new initiative, there are some practical and professional issues that need to be addressed. The projects are improving access to evidence-based, non-pharmacological therapies. The continuation and expansion of the initiative should be a priority.

An evidence-based medicine fellowship in a children's teaching hospital

This paper reports the introduction of an evidence-based medicine fellowship in a children’s teaching hospital. The results are presented of a self-reported ‘evidence-based medicine’ questionnaire, the clinical questions requested through the information retrieval service are outlined and the results of an information retrieval service user questionnaire are reported. It was confirmed that clinicians have frequent clinical questions that mostly remain unanswered. The responses to four questions with ‘good quality’ evidence-based answers were reviewed and suggest that at least one-quarter of doctors were not aware of the current best available evidence. There was a high level of satisfaction with the information retrieval service; 19% of users indicated that the information changed their clinical practice and 73% indicated that the information confirmed their clinical practice. The introduction of an evidence-based medicine fellowship is one method of disseminating the practice of evidence-based medicine in a tertiary children’s hospital.

Why do we need randomized and epidemiological studies on cardiovascular disease? Evidence-based cardiology VII

Over the last two decades the results of randomized clinical studies, which are powerful aids for correctly assessing therapeutical strategies, have consolidated cardiological practice. In addition, scientifically interesting hypotheses have been generated through the results of epidemiological studies. Properly conducted randomized studies without systematic errors and with statistical power adequate for demonstrating moderate and reasonable benefits in relevant clinical outcomes have provided reliable and strong results altering clinical practice, thus providing adequate treatment for patients with cardiovascular disease (CVD). The dissemination and use of evidence-based medicine in treating coronary artery disease (CAD), heart failure (HF), and in prevention will prevent hundreds of thousands of deaths annually in developed and developing countries. CVD is responsible for approximately 12 million deaths annually throughout the world, and approximately 60% of these deaths occur in developing countries. During recent years, an increase in mortality and morbidity rates due to CVD has occurred in developing countries. This increase is an indication that an epidemiological (demographic, economical, and health-related) transition is taking place in developing countries and this transition implies a global epidemic of CVD, which will require wide-ranging and globally effective strategies for prevention. The identification of conventional and emerging risk factors for CVD, as well as their management in high-risk individuals, has contributed to the decrease in the mortality rate due to CVD. Through a national collaboration, several multi-center and multinational randomized and epidemiological studies have been carried out throughout Brazil, thus contributing not only to a generalized scientific growth in different Brazilian hospitals but also to the consolidation of an increasingly evidence-based clinical practice.

Appropriateness of respiratory care: development of evidence-based guidelines in an acute care hospital

Background: Respiratory care is universally recognised as useful, but its indications and practice vary markedly. In order to improve appropriateness of respiratory care in our hospital, we developed evidence-based local guidelines in a collaborative effort involving physiotherapists, physicians, and health services researchers. Methods: Recommendations were developed using the standardised RAND appropriateness method. A literature search was performed for the period between 1995 and 2008 based on terms associated with guidelines and with respiratory care. Publications were assessed according to the Oxford classification of quality of evidence. A working group prepared proposals for recommendations which were then independently rated by a multidisciplinary expert panel. All recommendations were then discussed in common and indications for procedures were rated confidentially a second time by the experts. Each indication for respiratory care was classified as appropriate, uncertain, or inappropriate, based on the panel median rating and the degree of intra-panel agreement. Results: Recommendations were formulated for the following procedures: non-invasive ventilation, continuous positive airway pressure, intermittent positive pressure breathing, intrapulmonary percussive ventilation, mechanical insufflation-exsufflation, incentive spirometry, positive expiratory pressure, nasotracheal suctioning, noninstrumental airway clearance techniques. Each recommendation referred to a particular medical condition, and was assigned to a hierarchical category based on the quality of evidence from literature supporting the recommendation and on the consensus of experts. Conclusion: Despite a marked heterogeneity of scientific evidence, the method used allowed us to develop commonly agreed local guidelines for respiratory care. In addition, this work fostered a closer relationship between physiotherapists and physicians in our institution.

Evidence-based guidelines on the therapeutic use of repetitive transcranial magnetic stimulation (rTMS).

A group of European experts was commissioned to establish guidelines on the therapeutic use of repetitive transcranial magnetic stimulation (rTMS) from evidence published up until March 2014, regarding pain, movement disorders, stroke, amyotrophic lateral sclerosis, multiple sclerosis, epilepsy, consciousness disorders, tinnitus, depression, anxiety disorders, obsessive-compulsive disorder, schizophrenia, craving/addiction, and conversion. Despite unavoidable inhomogeneities, there is a sufficient body of evidence to accept with level A (definite efficacy) the analgesic effect of high-frequency (HF) rTMS of the primary motor cortex (M1) contralateral to the pain and the antidepressant effect of HF-rTMS of the left dorsolateral prefrontal cortex (DLPFC). A Level B recommendation (probable efficacy) is proposed for the antidepressant effect of low-frequency (LF) rTMS of the right DLPFC, HF-rTMS of the left DLPFC for the negative symptoms of schizophrenia, and LF-rTMS of contralesional M1 in chronic motor stroke. The effects of rTMS in a number of indications reach level C (possible efficacy), including LF-rTMS of the left temporoparietal cortex in tinnitus and auditory hallucinations. It remains to determine how to optimize rTMS protocols and techniques to give them relevance in routine clinical practice. In addition, professionals carrying out rTMS protocols should undergo rigorous training to ensure the quality of the technical realization, guarantee the proper care of patients, and maximize the chances of success. Under these conditions, the therapeutic use of rTMS should be able to develop in the coming years.

Are the health messages in schoolbooks based on scientific evidence? A descriptive study.

BACKGROUND Most textbooks contains messages relating to health. This profuse information requires analysis with regards to the quality of such information. The objective was to identify the scientific evidence on which the health messages in textbooks are based. METHODS The degree of evidence on which such messages are based was identified and the messages were subsequently classified into three categories: Messages with high, medium or low levels of evidence; Messages with an unknown level of evidence; and Messages with no known evidence. RESULTS 844 messages were studied. Of this total, 61% were classified as messages with an unknown level of evidence. Less than 15% fell into the category where the level of evidence was known and less than 6% were classified as possessing high levels of evidence. More than 70% of the messages relating to "Balanced Diets and Malnutrition", "Food Hygiene", "Tobacco", "Sexual behaviour and AIDS" and "Rest and ergonomics" are based on an unknown level of evidence. "Oral health" registered the highest percentage of messages based on a high level of evidence (37.5%), followed by "Pregnancy and newly born infants" (35%). Of the total, 24.6% are not based on any known evidence. Two of the messages appeared to contravene known evidence. CONCLUSION Many of the messages included in school textbooks are not based on scientific evidence. Standards must be established to facilitate the production of texts that include messages that are based on the best available evidence and which can improve children's health more effectively.

Discriminant validity and test-retest reliability of a self-administered Internet-based questionnaire testing doctors' knowledge in evidence-based medicine.

Aims and objectives  This study aimed to determine the discriminant validity and the test-retest reliability of a questionnaire testing the impact of evidence-based medicine (EBM) training on doctors' knowledge and skills. Methods  Questionnaires were sent electronically to all doctors working as residents and chief residents in two French speaking hospital networks in Switzerland. Participants completed the questionnaire twice, within a 4-week interval. The discriminant validity was examined in comparing doctors' performance according to their reported EBM previous training. Proportion of agreement between both sessions of the questionnaire, Cohen's kappa and 'uniform kappa' determined its test-retest reliability. Results  The participation rate was 9.8%/7.1% to first/second session. Performance increased according to the level of doctors' previous training in EBM. The observed proportion of agreement between both sessions was over 70% for 14/19 questions, and the 'uniform kappa' was superior to 0.60 for 15/19 questions. Conclusion  The discriminant validity and test-retest reliability of the questionnaire were satisfying. The low participation rate did not prevent the study from achieving its aims.