Evidence-Based Practice in PubMed: Are Shared Filters Useful to Health Sciences Academic Users?

Objectives In April 2010, the Université de Montréal’s Health Sciences Library has implemented shared filters in its institutional PubMed account. Most of these filters are designed to highlight resources for evidence-based practice, such as Clinical Queries, Systematic Reviews and Evidence-based Synopsis. We now want to measure how those filters are perceived and used by our users. Methods For one month, data was gathered through an online questionnaire proposed to users of Université de Montréal’s PubMed account. A print version was also distributed to participants in information literacy workshops given by the health sciences librarians. Respondents were restricted to users affiliated to Université de Montréal’s faculties of Medicine, Dentistry, Veterinary Sciences, Nursing and Pharmacy. Basic user information such as year/program of study or department affiliation was also collected. The questionnaire allowed users to identify the filters they use, assess the relevance of filters, and also suggest new ones. Results Survey results showed that the shared filters of Université de Montreal’s PubMed account were found useful by the majority of respondents. Filters allowing rapid access to secondary resources ranked among the most relevant (Reviews, Systematic Reviews, Cochrane Database of Systematic Reviews, Practice Guidelines and Clinical Evidence). For Clinical Study Queries, Randomized Controlled Trial (Therapy/Narrow) was considered the most useful. Some new shared filters have been suggested by respondents. Finally, 18% of the respondents indicated that they did not quite understand the relevance of filters. Conclusion Based on the survey results, shared filters considered most useful will be kept, some will be enhanced and others removed so that suggested ones could be added. The fact that some respondents did not understand well the relevance of filters could potentially be addressed through our PubMed workshops, online library guides or by renaming some filters in a more meaningful way.

The double triangular test in practice

The double triangular test was introduced twenty years ago, and the purpose of this paper is to review applications that have been made since then. In fact, take-up of the method was rather slow until the late 1990s, but in recent years several clinical trial reports have been published describing its use in a wide range of therapeutic areas. The core of this paper is a detailed account of five trials that have been published since 2000 in which the method was applied to studies of pancreatic cancer, breast cancer, myocardial infarction, epilepsy and bedsores. Before those accounts are given, the method is described and the history behind its evolution is presented. The future potential of the method for sequential case-control and equivalence trials is also discussed. Copyright © 2004 John Wiley & Sons, Ltd.

Meta-analysis of individual patient data from randomised trials: a review of methods used in practice

Background: Meta-analyses based on individual patient data (IPD) are regarded as the gold standard for systematic reviews. However, the methods used for analysing and presenting results from IPD meta-analyses have received little discussion. Methods We review 44 IPD meta-analyses published during the years 1999–2001. We summarize whether they obtained all the data they sought, what types of approaches were used in the analysis, including assumptions of common or random effects, and how they examined the effects of covariates. Results: Twenty-four out of 44 analyses focused on time-to-event outcomes, and most analyses (28) estimated treatment effects within each trial and then combined the results assuming a common treatment effect across trials. Three analyses failed to stratify by trial, analysing the data is if they came from a single mega-trial. Only nine analyses used random effects methods. Covariate-treatment interactions were generally investigated by subgrouping patients. Seven of the meta-analyses included data from less than 80% of the randomized patients sought, but did not address the resulting potential biases. Conclusions: Although IPD meta-analyses have many advantages in assessing the effects of health care, there are several aspects that could be further developed to make fuller use of the potential of these time-consuming projects. In particular, IPD could be used to more fully investigate the influence of covariates on heterogeneity of treatment effects, both within and between trials. The impact of heterogeneity, or use of random effects, are seldom discussed. There is thus considerable scope for enhancing the methods of analysis and presentation of IPD meta-analysis.

Hypotensive effects of hawthorn for patients with diabetes taking prescription drugs: a randomised controlled trial

Background Hawthorn (Crataegus laevigata) leaves, flowers and berries are used by herbal practitioners in the UK to treat hypertension in conjunction with prescribed drugs. Small-scale human studies support this approach. Aim To investigate the effects of hawthorn for hypertension in patients with type 2 diabetes taking prescribed drugs. Design of study Randomised controlled trial. Setting General practices in Reading, UK. Method Patients with type 2 diabetes (n = 79) were randomised to daily 1200 mg hawthorn extract (n = 39) or placebo (n = 40) for 16 weeks. At baseline and outcome a wellbeing questionnaire was completed and blood pressure and fasting blood samples taken. A food frequency questionnaire estimated nutrient intake. Results Hypotensive drugs were used by 71% of the study population with a mean intake of 4.4 hypoglycaemic and/or hypotensive drugs. Fat intake was lower and sugar intake higher than recommendations, and low micronutrient intake was prevalent. There was a significant group difference in mean diastolic blood pressure reductions (P = 0.035): the hawthorn group showed greater reductions (baseline: 85.6 mmHg, 95% confidence interval [Cl] = 83.3 to 87.8; outcome: 83.0 mmHg, 95% Cl = 80.5 to 85.7) than the placebo group (baseline: 84.5 mmHg, 95% Cl = 82 to 87; outcome: 85.0 mmHg, 95% Cl = 82.2 to 87.8). There was no group difference in systolic blood pressure reduction from baseline (3.6 and 0.8 mmHg for hawthorn and placebo groups, respectively; P = 0.329). Although mean fat intake met current recommendations, mean sugar intake was higher and there were indications of potential multiple micronutrient deficiencies. No herb-drug interaction was found and minor health complaints were reduced from baseline in both groups. Conclusions This is the first randomised controlled trial to demonstrate a hypotensive effect of hawthorn in patients with diabetes taking medication.

A practical approach to a multi-level analysis with a sparse binary outcome within a large surgical trial

Objectives: To assess the potential source of variation that surgeon may add to patient outcome in a clinical trial of surgical procedures. Methods: Two large (n = 1380) parallel multicentre randomized surgical trials were undertaken to compare laparoscopically assisted hysterectomy with conventional methods of abdominal and vaginal hysterectomy; involving 43 surgeons. The primary end point of the trial was the occurrence of at least one major complication. Patients were nested within surgeons giving the data set a hierarchical structure. A total of 10% of patients had at least one major complication, that is, a sparse binary outcome variable. A linear mixed logistic regression model (with logit link function) was used to model the probability of a major complication, with surgeon fitted as a random effect. Models were fitted using the method of maximum likelihood in SAS((R)). Results: There were many convergence problems. These were resolved using a variety of approaches including; treating all effects as fixed for the initial model building; modelling the variance of a parameter on a logarithmic scale and centring of continuous covariates. The initial model building process indicated no significant 'type of operation' across surgeon interaction effect in either trial, the 'type of operation' term was highly significant in the abdominal trial, and the 'surgeon' term was not significant in either trial. Conclusions: The analysis did not find a surgeon effect but it is difficult to conclude that there was not a difference between surgeons. The statistical test may have lacked sufficient power, the variance estimates were small with large standard errors, indicating that the precision of the variance estimates may be questionable.

Weaning preterm infants: a randomised controlled trial

Objective: To assess the effect on growth and iron status in preterm infants of a specially devised weaning strategy compared with current best practices in infant feeding. The preterm weaning strategy recommended the early onset of weaning and the use of foods with a higher energy and protein content than standard milk formula, and foods that are rich sources of iron and zinc. Subjects and design: In a blinded, controlled study, 68 preterm infants (mean (SD) birth weight 1470 (430) g and mean (SD) gestational age 31.3 (2.9) weeks) were randomised to either the preterm weaning strategy group (n = 37) or a current best practice control group (n = 31), from hospital discharge until 1 year gestation corrected age (GCA). Main outcome measures: Weight, supine length, occipitofrontal head circumference, and intakes of energy, protein, and minerals were determined at 0, 6, and 12 months GCA. Levels of haemoglobin, serum iron, and serum ferritin were assayed at 0 and 6 months GCA. Results: Significant positive effects of treatment included: greater increase in standard deviation length scores and length growth velocity; increased intake of energy, protein, and carbohydrate at 6 months GCA and iron at 12 months GCA; increased haemoglobin and serum iron levels at 6 months GCA. Conclusions: The preterm weaning strategy significantly influenced dietary intakes with consequent beneficial effects on growth in length and iron status. This strategy should be adopted as the basis of feeding guidelines for preterm infants after hospital discharge. School of Applied Statistics Faculty of Life Sciences

Hypotensive effects of hawthorn for patients with diabetes taking prescription drugs: a randomised controlled trial

Background: Hawthorn (Crataegus laevigata) leaves, flowers and berries are used by herbal practitioners in the UK to treat hypertension in conjunction with prescribed drugs. Small-scale human studies support this approach. Aim: To investigate the effects of hawthorn for hypertension in patients with type 2 diabetes taking prescribed drugs. Design of study: Randomised controlled trial. Setting: General practices in Reading, UK. Method: Patients with type 2 diabetes (n = 79) were randomised to daily 1200 mg hawthorn extract (n = 39) or placebo (n = 40) for 16 weeks. At baseline and outcome a wellbeing questionnaire was completed and blood pressure and fasting blood samples taken. A food frequency questionnaire estimated nutrient intake. Results: Hypotensive drugs were used by 71% of the study population with a mean intake of 4.4 hypoglycaemic and/or hypotensive drugs. Fat intake was lower and sugar intake higher than recommendations, and low micronutrient intake was prevalent. There was a significant group difference in mean diastolic blood pressure reductions (P = 0.035): the hawthorn group showed greater reductions (baseline: 85.6 mmHg, 95% confidence interval [Cl] = 83.3 to 87.8; outcome: 83.0 mmHg, 95% Cl = 80.5 to 85.7) than the placebo group (baseline: 84.5 mmHg, 95% Cl = 82 to 87; outcome: 85.0 mmHg, 95% Cl = 82.2 to 87.8). There was no group difference in systolic blood pressure reduction from baseline (3.6 and 0.8 mmHg for hawthorn and placebo groups, respectively; P = 0.329). Although mean fat intake met current recommendations, mean sugar intake was higher and there were indications of potential multiple micronutrient deficiencies. No herb-drug interaction was found and minor health complaints were reduced from baseline in both groups. Conclusions: This is the first randomised controlled trial to demonstrate a hypotensive effect of hawthorn in patients with diabetes taking medication.

Flavonoids and cognitive function: a review of human randomized controlled trial studies and recommendations for future studies

Evidence in support of the neuroprotective effects of flavonoids has increased significantly in recent years, although to date much of this evidence has emerged from animal rather than human studies. Nonetheless, with a view to making recommendations for future good practice, we review 15 existing human dietary intervention studies that have examined the effects of particular types of flavonoid on cognitive performance. The studies employed a total of 55 different cognitive tests covering a broad range of cognitive domains. Most studies incorporated at least one measure of executive function/working memory, with nine reporting significant improvements in performance as a function of flavonoid supplementation compared to a control group. However, some domains were overlooked completely (e.g. implicit memory, prospective memory), and for the most part there was little consistency in terms of the particular cognitive tests used making across study comparisons difficult. Furthermore, there was some confusion concerning what aspects of cognitive function particular tests were actually measuring. Overall, while initial results are encouraging, future studies need to pay careful attention when selecting cognitive measures, especially in terms of ensuring that tasks are actually sensitive enough to detect treatment effects.

Protocol for the PINCER trial: a cluster randomised trial comparing the effectiveness of a pharmacist-led IT-based intervention with simple feedback in reducing rates of clinically important errors in medicines management in general practices

Background: Medication errors are an important cause of morbidity and mortality in primary care. The aims of this study are to determine the effectiveness, cost effectiveness and acceptability of a pharmacist-led information-technology-based complex intervention compared with simple feedback in reducing proportions of patients at risk from potentially hazardous prescribing and medicines management in general (family) practice. Methods: Research subject group: "At-risk" patients registered with computerised general practices in two geographical regions in England. Design: Parallel group pragmatic cluster randomised trial. Interventions: Practices will be randomised to either: (i) Computer-generated feedback; or (ii) Pharmacist-led intervention comprising of computer-generated feedback, educational outreach and dedicated support. Primary outcome measures: The proportion of patients in each practice at six and 12 months post intervention: - with a computer-recorded history of peptic ulcer being prescribed non-selective non-steroidal anti-inflammatory drugs - with a computer-recorded diagnosis of asthma being prescribed beta-blockers - aged 75 years and older receiving long-term prescriptions for angiotensin converting enzyme inhibitors or loop diuretics without a recorded assessment of renal function and electrolytes in the preceding 15 months. Secondary outcome measures; These relate to a number of other examples of potentially hazardous prescribing and medicines management. Economic analysis: An economic evaluation will be done of the cost per error avoided, from the perspective of the UK National Health Service (NHS), comparing the pharmacist-led intervention with simple feedback. Qualitative analysis: A qualitative study will be conducted to explore the views and experiences of health care professionals and NHS managers concerning the interventions, and investigate possible reasons why the interventions prove effective, or conversely prove ineffective. Sample size: 34 practices in each of the two treatment arms would provide at least 80% power (two-tailed alpha of 0.05) to demonstrate a 50% reduction in error rates for each of the three primary outcome measures in the pharmacist-led intervention arm compared with a 11% reduction in the simple feedback arm. Discussion: At the time of submission of this article, 72 general practices have been recruited (36 in each arm of the trial) and the interventions have been delivered. Analysis has not yet been undertaken.

Cognitive tests used in chronic adult human randomised controlled trial micronutrient and phytochemical intervention studies

In recent years there has been a rapid growth of interest in exploring the relationship between nutritional therapies and the maintenance of cognitive function in adulthood. Emerging evidence reveals an increasingly complex picture with respect to the benefits of various food constituents on learning, memory and psychomotor function in adults. However, to date, there has been little consensus in human studies on the range of cognitive domains to be tested or the particular tests to be employed. To illustrate the potential difficulties that this poses, we conducted a systematic review of existing human adult randomised controlled trial (RCT) studies that have investigated the effects of 24 d to 36 months of supplementation with flavonoids and micronutrients on cognitive performance. There were thirty-nine studies employing a total of 121 different cognitive tasks that met the criteria for inclusion. Results showed that less than half of these studies reported positive effects of treatment, with some important cognitive domains either under-represented or not explored at all. Although there was some evidence of sensitivity to nutritional supplementation in a number of domains (for example, executive function, spatial working memory), interpretation is currently difficult given the prevailing 'scattergun approach' for selecting cognitive tests. Specifically, the practice means that it is often difficult to distinguish between a boundary condition for a particular nutrient and a lack of task sensitivity. We argue that for significant future progress to be made, researchers need to pay much closer attention to existing human RCT and animal data, as well as to more basic issues surrounding task sensitivity, statistical power and type I error.

Proposed best practice for statisticians in the reporting and publication of pharmaceutical industry-sponsored clinical trials

In this paper we set out what we consider to be a set of best practices for statisticians in the reporting of pharmaceutical industry-sponsored clinical trials. We make eight recommendations covering: author responsibilities and recognition; publication timing; conflicts of interest; freedom to act; full author access to data; trial registration and independent review. These recommendations are made in the context of the prominent role played by statisticians in the design, conduct, analysis and reporting of pharmaceutical sponsored trials and the perception of the reporting of these trials in the wider community.

Randomized controlled trial of full and brief cognitive-behaviour therapy and wait-list for paediatric obsessive-compulsive disorder

Background: Reviews and practice guidelines for paediatric obsessive-compulsive disorder (OCD) recommend cognitive-behaviour therapy (CBT) as the psychological treatment of choice, but note that it has not been sufficiently evaluated for children and adolescents and that more randomized controlled trials are needed. The aim of this trial was to evaluate effectiveness and optimal delivery of CBT, emphasizing cognitive interventions. Methods: A total of 96 children and adolescents with OCD were randomly allocated to the three conditions each of approximately 12 weeks duration: full CBT (average therapist contact: 12 sessions) and brief CBT (average contact: 5 sessions, with use of therapist-guided workbooks), and wait-list/delayed treatment. The primary outcome measure was the child version of the semi-structured interviewer-based Yale-Brown Obsessive Compulsive Scale. Clinical Trial registration: http://www.controlled-trials.com/ISRCTN/; unique identifier: ISRCTN29092580. Results: There was statistically significant symptomatic improvement in both treatment groups compared with the wait-list group, with no significant differences in outcomes between the two treatment groups. Controlled treatment effect sizes in intention-to-treat analyses were 2.2 for full CBT and 1.6 for brief CBT. Improvements were maintained at follow-up an average of 14 weeks later. Conclusions: The findings demonstrate the benefits of CBT emphasizing cognitive interventions for children and adolescents with OCD and suggest that relatively lower therapist intensity delivery with use of therapist-guided workbooks is an efficient mode of delivery.

PINCER trial: a cluster randomised trial comparing the effectiveness and cost-effectiveness of a pharmacist-led IT-based intervention with simple feedback in reducing rates of clinically important errors in medicines management in general practices

Background: Medication errors in general practice are an important source of potentially preventable morbidity and mortality. Building on previous descriptive, qualitative and pilot work, we sought to investigate the effectiveness, cost-effectiveness and likely generalisability of a complex pharm acist-led IT-based intervention aiming to improve prescribing safety in general practice. Objectives: We sought to: • Test the hypothesis that a pharmacist-led IT-based complex intervention using educational outreach and practical support is more effective than simple feedback in reducing the proportion of patients at risk from errors in prescribing and medicines management in general practice. • Conduct an economic evaluation of the cost per error avoided, from the perspective of the National Health Service (NHS). • Analyse data recorded by pharmacists, summarising the proportions of patients judged to be at clinical risk, the actions recommended by pharmacists, and actions completed in the practices. • Explore the views and experiences of healthcare professionals and NHS managers concerning the intervention; investigate potential explanations for the observed effects, and inform decisions on the future roll-out of the pharmacist-led intervention • Examine secular trends in the outcome measures of interest allowing for informal comparison between trial practices and practices that did not participate in the trial contributing to the QRESEARCH database. Methods Two-arm cluster randomised controlled trial of 72 English general practices with embedded economic analysis and longitudinal descriptive and qualitative analysis. Informal comparison of the trial findings with a national descriptive study investigating secular trends undertaken using data from practices contributing to the QRESEARCH database. The main outcomes of interest were prescribing errors and medication monitoring errors at six- and 12-months following the intervention. Results: Participants in the pharmacist intervention arm practices were significantly less likely to have been prescribed a non-selective NSAID without a proton pump inhibitor (PPI) if they had a history of peptic ulcer (OR 0.58, 95%CI 0.38, 0.89), to have been prescribed a beta-blocker if they had asthma (OR 0.73, 95% CI 0.58, 0.91) or (in those aged 75 years and older) to have been prescribed an ACE inhibitor or diuretic without a measurement of urea and electrolytes in the last 15 months (OR 0.51, 95% CI 0.34, 0.78). The economic analysis suggests that the PINCER pharmacist intervention has 95% probability of being cost effective if the decision-maker’s ceiling willingness to pay reaches £75 (6 months) or £85 (12 months) per error avoided. The intervention addressed an issue that was important to professionals and their teams and was delivered in a way that was acceptable to practices with minimum disruption of normal work processes. Comparison of the trial findings with changes seen in QRESEARCH practices indicated that any reductions achieved in the simple feedback arm were likely, in the main, to have been related to secular trends rather than the intervention. Conclusions Compared with simple feedback, the pharmacist-led intervention resulted in reductions in proportions of patients at risk of prescribing and monitoring errors for the primary outcome measures and the composite secondary outcome measures at six-months and (with the exception of the NSAID/peptic ulcer outcome measure) 12-months post-intervention. The intervention is acceptable to pharmacists and practices, and is likely to be seen as costeffective by decision makers.

Randomized controlled trial of parent-enhanced CBT compared with individual CBT for obsessive-compulsive disorder in young people

Objective: Obsessive-compulsive disorder (OCD) in young people can be effectively treated with Cognitive Behavior Therapy (CBT). Practice guidelines in the United Kingdom recommend that CBT be delivered with parental or family involvement; however, there is no evidence from randomized trials that this enhances effectiveness. The aim of this trial was to assess if CBT with high parental involvement was more effective than CBT with low parental involvement (individual CBT) in reducing symptoms of OCD. Method: Fifty young people ages 12–17 years with OCD were randomly allocated to individual CBT or parent-enhanced CBT. In parent-enhanced CBT parents attended all treatment sessions; in individual CBT, parents attended only Sessions 1, 7, and the final session. Participants received up to 14 sessions of CBT. Data were analyzed using intent-to-treat and per-protocol methods. The primary outcome measure was the Children’s Yale-Brown Obsessive Compulsion Scale (Scahill et al., 1997). Results: Both forms of CBT significantly reduced symptoms of OCD and anxiety. Change in OCD symptoms was maintained at 6 months. Per-protocol analysis suggested that parent-enhanced CBT may be associated with significantly larger reductions in anxiety symptoms. Conclusions: High and low parental involvement in CBT for OCD in young people were both effective, and there was no evidence that 1 method of delivery was superior on the primary outcome measure. However, this study was small. Future trials should be adequately powered and examine interactions with the age of the young person and comorbid anxiety disorders.

Corticospinal tract integrity and lesion volume play different roles in chronic hemiparesis and its improvement through motor practice

Background. Initial evidence suggests that the integrity of the ipsilesional corticospinal tract (CST) after stroke is strongly related to motor function in the chronic state but not the treatment gain induced by motor rehabilitation. Objective. We examined the association of motor status and treatment benefit by testing patients with a wide range of severity of hemiparesis of the left and right upper extremity. Method. Diffusion tensor imaging was performed in 22 patients beyond 12 months after onset of stroke with severe to moderate hemiparesis. Motor function was tested before and after 2 weeks of modified constraint-induced movement therapy. Results. CST integrity, but not lesion volume, correlated with the motor ability measures of the Wolf Motor Function Test and the Motor Activity Log. No differences were found between left and right hemiparesis. Motor performance improved significantly with the treatment regime, and did so equally for patients with left and right arm paresis. However, treatment benefit was not associated with either CST integrity or lesion volume. Conclusion. CST integrity correlated best in this small trial with chronic long-term status but not treatment-induced improvements. The CST may play a different role in the mechanisms mediating long-term outcome compared to those underlying practice-induced gains after a chronic plateau in motor function.