Speech therapy after stroke: trial shows only that practice varies

Bowen and colleagues’ methods and conclusions raise concerns.1 At best, the trial evaluates the variability in current practice. In no way is it a robust test of treatment. Two communication impairments (aphasia and dysarthria) were included. In the post-acute stage spontaneous recovery is highly unpredictable, and changes in the profile of impairment during this time are common.2 Both impairments manifest in different forms,3 which may be more or less responsive to treatment. A third kind of impairment, apraxia of speech, was not excluded but was not targeted in therapy. All three impairments can and do co-occur. Whether randomised controlled trial designs can effectively cope with such complex disorders has been discussed elsewhere.4 Treatment was defined within terms of current practice but was unconstrained. Therefore, the treatment group would have received a variety of therapeutic approaches and protocols, some of which may indeed be ineffective. Only 53% of the contact time with a speech and language therapist was direct (one to one), the rest was impairment based therapy. In contrast, all of the visitors’ time was direct contact, usually in conversation. In both groups, the frequency and length of contact time varied. We already know that the transfer from impairment based therapy to functional communication can be limited and varies across individuals.5 However, it is not possible to conclude from this trial that one to one impairment based therapy should be replaced. For that, a well defined impairment therapy protocol must be directly compared with a similarly well defined functional communication therapy, with an attention control.

Description and process evaluation of pharmacists’ interventions in a pharmacist-led information technology-enabled multicentre cluster randomised controlled trial for reducing medication errors in general practice (PINCER trial)

Objective To undertake a process evaluation of pharmacists' recommendations arising in the context of a complex IT-enabled pharmacist-delivered randomised controlled trial (PINCER trial) to reduce the risk of hazardous medicines management in general practices. Methods PINCER pharmacists manually recorded patients’ demographics, details of interventions recommended, actions undertaken by practice staff and time taken to manage individual cases of hazardous medicines management. Data were coded and double entered into SPSS v15, and then summarised using percentages for categorical data (with 95% CI) and, as appropriate, means (SD) or medians (IQR) for continuous data. Key findings Pharmacists spent a median of 20 minutes (IQR 10, 30) reviewing medical records, recommending interventions and completing actions in each case of hazardous medicines management. Pharmacists judged 72% (95%CI 70, 74) (1463/2026) of cases of hazardous medicines management to be clinically relevant. Pharmacists recommended 2105 interventions in 74% (95%CI 73, 76) (1516/2038) of cases and 1685 actions were taken in 61% (95%CI 59, 63) (1246/2038) of cases; 66% (95%CI 64, 68) (1383/2105) of interventions recommended by pharmacists were completed and 5% (95%CI 4, 6) (104/2105) of recommendations were accepted by general practitioners (GPs), but not completed at the end of the pharmacists’ placement; the remaining recommendations were rejected or considered not relevant by GPs. Conclusions The outcome measures were used to target pharmacist activity in general practice towards patients at risk from hazardous medicines management. Recommendations from trained PINCER pharmacists were found to be broadly acceptable to GPs and led to ameliorative action in the majority of cases. It seems likely that the approach used by the PINCER pharmacists could be employed by other practice pharmacists following appropriate training.

Adding a treatment arm to an ongoing clinical trial: a review of methodology and practice

Incorporating an emerging therapy as a new randomisation arm in a clinical trial that is open to recruitment would be desirable to researchers, regulators and patients to ensure that the trial remains current, new treatments are evaluated as quickly as possible, and the time and cost for determining optimal therapies is minimised. It may take many years to run a clinical trial from concept to reporting within a rapidly changing drug development environment; hence, in order for trials to be most useful to inform policy and practice, it is advantageous for them to be able to adapt to emerging therapeutic developments. This paper reports a comprehensive literature review on methodologies for, and practical examples of, amending an ongoing clinical trial by adding a new treatment arm. Relevant methodological literature describing statistical considerations required when making this specific type of amendment is identified, and the key statistical concepts when planning the addition of a new treatment arm are extracted, assessed and summarised. For completeness, this includes an assessment of statistical recommendations within general adaptive design guidance documents. Examples of confirmatory ongoing trials designed within the frequentist framework that have added an arm in practice are reported; and the details of the amendment are reviewed. An assessment is made as to how well the relevant statistical considerations were addressed in practice, and the related implications. The literature review confirmed that there is currently no clear methodological guidance on this topic, but that guidance would be advantageous to help this efficient design amendment to be used more frequently and appropriately in practice. Eight confirmatory trials were identified to have added a treatment arm, suggesting that trials can benefit from this amendment and that it can be practically feasible; however, the trials were not always able to address the key statistical considerations, often leading to uninterpretable or invalid outcomes. If the statistical concepts identified within this review are considered and addressed during the design of a trial amendment, it is possible to effectively assess a new treatment arm within an ongoing trial without compromising the original trial outcomes.

The double triangular test in practice

The double triangular test was introduced twenty years ago, and the purpose of this paper is to review applications that have been made since then. In fact, take-up of the method was rather slow until the late 1990s, but in recent years several clinical trial reports have been published describing its use in a wide range of therapeutic areas. The core of this paper is a detailed account of five trials that have been published since 2000 in which the method was applied to studies of pancreatic cancer, breast cancer, myocardial infarction, epilepsy and bedsores. Before those accounts are given, the method is described and the history behind its evolution is presented. The future potential of the method for sequential case-control and equivalence trials is also discussed. Copyright © 2004 John Wiley & Sons, Ltd.

Meta-analysis of individual patient data from randomised trials: a review of methods used in practice

Background: Meta-analyses based on individual patient data (IPD) are regarded as the gold standard for systematic reviews. However, the methods used for analysing and presenting results from IPD meta-analyses have received little discussion. Methods We review 44 IPD meta-analyses published during the years 1999–2001. We summarize whether they obtained all the data they sought, what types of approaches were used in the analysis, including assumptions of common or random effects, and how they examined the effects of covariates. Results: Twenty-four out of 44 analyses focused on time-to-event outcomes, and most analyses (28) estimated treatment effects within each trial and then combined the results assuming a common treatment effect across trials. Three analyses failed to stratify by trial, analysing the data is if they came from a single mega-trial. Only nine analyses used random effects methods. Covariate-treatment interactions were generally investigated by subgrouping patients. Seven of the meta-analyses included data from less than 80% of the randomized patients sought, but did not address the resulting potential biases. Conclusions: Although IPD meta-analyses have many advantages in assessing the effects of health care, there are several aspects that could be further developed to make fuller use of the potential of these time-consuming projects. In particular, IPD could be used to more fully investigate the influence of covariates on heterogeneity of treatment effects, both within and between trials. The impact of heterogeneity, or use of random effects, are seldom discussed. There is thus considerable scope for enhancing the methods of analysis and presentation of IPD meta-analysis.

Hypotensive effects of hawthorn for patients with diabetes taking prescription drugs: a randomised controlled trial

Background Hawthorn (Crataegus laevigata) leaves, flowers and berries are used by herbal practitioners in the UK to treat hypertension in conjunction with prescribed drugs. Small-scale human studies support this approach. Aim To investigate the effects of hawthorn for hypertension in patients with type 2 diabetes taking prescribed drugs. Design of study Randomised controlled trial. Setting General practices in Reading, UK. Method Patients with type 2 diabetes (n = 79) were randomised to daily 1200 mg hawthorn extract (n = 39) or placebo (n = 40) for 16 weeks. At baseline and outcome a wellbeing questionnaire was completed and blood pressure and fasting blood samples taken. A food frequency questionnaire estimated nutrient intake. Results Hypotensive drugs were used by 71% of the study population with a mean intake of 4.4 hypoglycaemic and/or hypotensive drugs. Fat intake was lower and sugar intake higher than recommendations, and low micronutrient intake was prevalent. There was a significant group difference in mean diastolic blood pressure reductions (P = 0.035): the hawthorn group showed greater reductions (baseline: 85.6 mmHg, 95% confidence interval [Cl] = 83.3 to 87.8; outcome: 83.0 mmHg, 95% Cl = 80.5 to 85.7) than the placebo group (baseline: 84.5 mmHg, 95% Cl = 82 to 87; outcome: 85.0 mmHg, 95% Cl = 82.2 to 87.8). There was no group difference in systolic blood pressure reduction from baseline (3.6 and 0.8 mmHg for hawthorn and placebo groups, respectively; P = 0.329). Although mean fat intake met current recommendations, mean sugar intake was higher and there were indications of potential multiple micronutrient deficiencies. No herb-drug interaction was found and minor health complaints were reduced from baseline in both groups. Conclusions This is the first randomised controlled trial to demonstrate a hypotensive effect of hawthorn in patients with diabetes taking medication.

A practical approach to a multi-level analysis with a sparse binary outcome within a large surgical trial

Objectives: To assess the potential source of variation that surgeon may add to patient outcome in a clinical trial of surgical procedures. Methods: Two large (n = 1380) parallel multicentre randomized surgical trials were undertaken to compare laparoscopically assisted hysterectomy with conventional methods of abdominal and vaginal hysterectomy; involving 43 surgeons. The primary end point of the trial was the occurrence of at least one major complication. Patients were nested within surgeons giving the data set a hierarchical structure. A total of 10% of patients had at least one major complication, that is, a sparse binary outcome variable. A linear mixed logistic regression model (with logit link function) was used to model the probability of a major complication, with surgeon fitted as a random effect. Models were fitted using the method of maximum likelihood in SAS((R)). Results: There were many convergence problems. These were resolved using a variety of approaches including; treating all effects as fixed for the initial model building; modelling the variance of a parameter on a logarithmic scale and centring of continuous covariates. The initial model building process indicated no significant 'type of operation' across surgeon interaction effect in either trial, the 'type of operation' term was highly significant in the abdominal trial, and the 'surgeon' term was not significant in either trial. Conclusions: The analysis did not find a surgeon effect but it is difficult to conclude that there was not a difference between surgeons. The statistical test may have lacked sufficient power, the variance estimates were small with large standard errors, indicating that the precision of the variance estimates may be questionable.

Weaning preterm infants: a randomised controlled trial

Objective: To assess the effect on growth and iron status in preterm infants of a specially devised weaning strategy compared with current best practices in infant feeding. The preterm weaning strategy recommended the early onset of weaning and the use of foods with a higher energy and protein content than standard milk formula, and foods that are rich sources of iron and zinc. Subjects and design: In a blinded, controlled study, 68 preterm infants (mean (SD) birth weight 1470 (430) g and mean (SD) gestational age 31.3 (2.9) weeks) were randomised to either the preterm weaning strategy group (n = 37) or a current best practice control group (n = 31), from hospital discharge until 1 year gestation corrected age (GCA). Main outcome measures: Weight, supine length, occipitofrontal head circumference, and intakes of energy, protein, and minerals were determined at 0, 6, and 12 months GCA. Levels of haemoglobin, serum iron, and serum ferritin were assayed at 0 and 6 months GCA. Results: Significant positive effects of treatment included: greater increase in standard deviation length scores and length growth velocity; increased intake of energy, protein, and carbohydrate at 6 months GCA and iron at 12 months GCA; increased haemoglobin and serum iron levels at 6 months GCA. Conclusions: The preterm weaning strategy significantly influenced dietary intakes with consequent beneficial effects on growth in length and iron status. This strategy should be adopted as the basis of feeding guidelines for preterm infants after hospital discharge. School of Applied Statistics Faculty of Life Sciences

Hypotensive effects of hawthorn for patients with diabetes taking prescription drugs: a randomised controlled trial

Background: Hawthorn (Crataegus laevigata) leaves, flowers and berries are used by herbal practitioners in the UK to treat hypertension in conjunction with prescribed drugs. Small-scale human studies support this approach. Aim: To investigate the effects of hawthorn for hypertension in patients with type 2 diabetes taking prescribed drugs. Design of study: Randomised controlled trial. Setting: General practices in Reading, UK. Method: Patients with type 2 diabetes (n = 79) were randomised to daily 1200 mg hawthorn extract (n = 39) or placebo (n = 40) for 16 weeks. At baseline and outcome a wellbeing questionnaire was completed and blood pressure and fasting blood samples taken. A food frequency questionnaire estimated nutrient intake. Results: Hypotensive drugs were used by 71% of the study population with a mean intake of 4.4 hypoglycaemic and/or hypotensive drugs. Fat intake was lower and sugar intake higher than recommendations, and low micronutrient intake was prevalent. There was a significant group difference in mean diastolic blood pressure reductions (P = 0.035): the hawthorn group showed greater reductions (baseline: 85.6 mmHg, 95% confidence interval [Cl] = 83.3 to 87.8; outcome: 83.0 mmHg, 95% Cl = 80.5 to 85.7) than the placebo group (baseline: 84.5 mmHg, 95% Cl = 82 to 87; outcome: 85.0 mmHg, 95% Cl = 82.2 to 87.8). There was no group difference in systolic blood pressure reduction from baseline (3.6 and 0.8 mmHg for hawthorn and placebo groups, respectively; P = 0.329). Although mean fat intake met current recommendations, mean sugar intake was higher and there were indications of potential multiple micronutrient deficiencies. No herb-drug interaction was found and minor health complaints were reduced from baseline in both groups. Conclusions: This is the first randomised controlled trial to demonstrate a hypotensive effect of hawthorn in patients with diabetes taking medication.

Flavonoids and cognitive function: a review of human randomized controlled trial studies and recommendations for future studies

Evidence in support of the neuroprotective effects of flavonoids has increased significantly in recent years, although to date much of this evidence has emerged from animal rather than human studies. Nonetheless, with a view to making recommendations for future good practice, we review 15 existing human dietary intervention studies that have examined the effects of particular types of flavonoid on cognitive performance. The studies employed a total of 55 different cognitive tests covering a broad range of cognitive domains. Most studies incorporated at least one measure of executive function/working memory, with nine reporting significant improvements in performance as a function of flavonoid supplementation compared to a control group. However, some domains were overlooked completely (e.g. implicit memory, prospective memory), and for the most part there was little consistency in terms of the particular cognitive tests used making across study comparisons difficult. Furthermore, there was some confusion concerning what aspects of cognitive function particular tests were actually measuring. Overall, while initial results are encouraging, future studies need to pay careful attention when selecting cognitive measures, especially in terms of ensuring that tasks are actually sensitive enough to detect treatment effects.

Protocol for the PINCER trial: a cluster randomised trial comparing the effectiveness of a pharmacist-led IT-based intervention with simple feedback in reducing rates of clinically important errors in medicines management in general practices

Background: Medication errors are an important cause of morbidity and mortality in primary care. The aims of this study are to determine the effectiveness, cost effectiveness and acceptability of a pharmacist-led information-technology-based complex intervention compared with simple feedback in reducing proportions of patients at risk from potentially hazardous prescribing and medicines management in general (family) practice. Methods: Research subject group: "At-risk" patients registered with computerised general practices in two geographical regions in England. Design: Parallel group pragmatic cluster randomised trial. Interventions: Practices will be randomised to either: (i) Computer-generated feedback; or (ii) Pharmacist-led intervention comprising of computer-generated feedback, educational outreach and dedicated support. Primary outcome measures: The proportion of patients in each practice at six and 12 months post intervention: - with a computer-recorded history of peptic ulcer being prescribed non-selective non-steroidal anti-inflammatory drugs - with a computer-recorded diagnosis of asthma being prescribed beta-blockers - aged 75 years and older receiving long-term prescriptions for angiotensin converting enzyme inhibitors or loop diuretics without a recorded assessment of renal function and electrolytes in the preceding 15 months. Secondary outcome measures; These relate to a number of other examples of potentially hazardous prescribing and medicines management. Economic analysis: An economic evaluation will be done of the cost per error avoided, from the perspective of the UK National Health Service (NHS), comparing the pharmacist-led intervention with simple feedback. Qualitative analysis: A qualitative study will be conducted to explore the views and experiences of health care professionals and NHS managers concerning the interventions, and investigate possible reasons why the interventions prove effective, or conversely prove ineffective. Sample size: 34 practices in each of the two treatment arms would provide at least 80% power (two-tailed alpha of 0.05) to demonstrate a 50% reduction in error rates for each of the three primary outcome measures in the pharmacist-led intervention arm compared with a 11% reduction in the simple feedback arm. Discussion: At the time of submission of this article, 72 general practices have been recruited (36 in each arm of the trial) and the interventions have been delivered. Analysis has not yet been undertaken.

Cognitive tests used in chronic adult human randomised controlled trial micronutrient and phytochemical intervention studies

In recent years there has been a rapid growth of interest in exploring the relationship between nutritional therapies and the maintenance of cognitive function in adulthood. Emerging evidence reveals an increasingly complex picture with respect to the benefits of various food constituents on learning, memory and psychomotor function in adults. However, to date, there has been little consensus in human studies on the range of cognitive domains to be tested or the particular tests to be employed. To illustrate the potential difficulties that this poses, we conducted a systematic review of existing human adult randomised controlled trial (RCT) studies that have investigated the effects of 24 d to 36 months of supplementation with flavonoids and micronutrients on cognitive performance. There were thirty-nine studies employing a total of 121 different cognitive tasks that met the criteria for inclusion. Results showed that less than half of these studies reported positive effects of treatment, with some important cognitive domains either under-represented or not explored at all. Although there was some evidence of sensitivity to nutritional supplementation in a number of domains (for example, executive function, spatial working memory), interpretation is currently difficult given the prevailing 'scattergun approach' for selecting cognitive tests. Specifically, the practice means that it is often difficult to distinguish between a boundary condition for a particular nutrient and a lack of task sensitivity. We argue that for significant future progress to be made, researchers need to pay much closer attention to existing human RCT and animal data, as well as to more basic issues surrounding task sensitivity, statistical power and type I error.

Proposed best practice for statisticians in the reporting and publication of pharmaceutical industry-sponsored clinical trials

In this paper we set out what we consider to be a set of best practices for statisticians in the reporting of pharmaceutical industry-sponsored clinical trials. We make eight recommendations covering: author responsibilities and recognition; publication timing; conflicts of interest; freedom to act; full author access to data; trial registration and independent review. These recommendations are made in the context of the prominent role played by statisticians in the design, conduct, analysis and reporting of pharmaceutical sponsored trials and the perception of the reporting of these trials in the wider community.

Randomized controlled trial of full and brief cognitive-behaviour therapy and wait-list for paediatric obsessive-compulsive disorder

Background: Reviews and practice guidelines for paediatric obsessive-compulsive disorder (OCD) recommend cognitive-behaviour therapy (CBT) as the psychological treatment of choice, but note that it has not been sufficiently evaluated for children and adolescents and that more randomized controlled trials are needed. The aim of this trial was to evaluate effectiveness and optimal delivery of CBT, emphasizing cognitive interventions. Methods: A total of 96 children and adolescents with OCD were randomly allocated to the three conditions each of approximately 12 weeks duration: full CBT (average therapist contact: 12 sessions) and brief CBT (average contact: 5 sessions, with use of therapist-guided workbooks), and wait-list/delayed treatment. The primary outcome measure was the child version of the semi-structured interviewer-based Yale-Brown Obsessive Compulsive Scale. Clinical Trial registration: http://www.controlled-trials.com/ISRCTN/; unique identifier: ISRCTN29092580. Results: There was statistically significant symptomatic improvement in both treatment groups compared with the wait-list group, with no significant differences in outcomes between the two treatment groups. Controlled treatment effect sizes in intention-to-treat analyses were 2.2 for full CBT and 1.6 for brief CBT. Improvements were maintained at follow-up an average of 14 weeks later. Conclusions: The findings demonstrate the benefits of CBT emphasizing cognitive interventions for children and adolescents with OCD and suggest that relatively lower therapist intensity delivery with use of therapist-guided workbooks is an efficient mode of delivery.

PINCER trial: a cluster randomised trial comparing the effectiveness and cost-effectiveness of a pharmacist-led IT-based intervention with simple feedback in reducing rates of clinically important errors in medicines management in general practices

Background: Medication errors in general practice are an important source of potentially preventable morbidity and mortality. Building on previous descriptive, qualitative and pilot work, we sought to investigate the effectiveness, cost-effectiveness and likely generalisability of a complex pharm acist-led IT-based intervention aiming to improve prescribing safety in general practice. Objectives: We sought to: • Test the hypothesis that a pharmacist-led IT-based complex intervention using educational outreach and practical support is more effective than simple feedback in reducing the proportion of patients at risk from errors in prescribing and medicines management in general practice. • Conduct an economic evaluation of the cost per error avoided, from the perspective of the National Health Service (NHS). • Analyse data recorded by pharmacists, summarising the proportions of patients judged to be at clinical risk, the actions recommended by pharmacists, and actions completed in the practices. • Explore the views and experiences of healthcare professionals and NHS managers concerning the intervention; investigate potential explanations for the observed effects, and inform decisions on the future roll-out of the pharmacist-led intervention • Examine secular trends in the outcome measures of interest allowing for informal comparison between trial practices and practices that did not participate in the trial contributing to the QRESEARCH database. Methods Two-arm cluster randomised controlled trial of 72 English general practices with embedded economic analysis and longitudinal descriptive and qualitative analysis. Informal comparison of the trial findings with a national descriptive study investigating secular trends undertaken using data from practices contributing to the QRESEARCH database. The main outcomes of interest were prescribing errors and medication monitoring errors at six- and 12-months following the intervention. Results: Participants in the pharmacist intervention arm practices were significantly less likely to have been prescribed a non-selective NSAID without a proton pump inhibitor (PPI) if they had a history of peptic ulcer (OR 0.58, 95%CI 0.38, 0.89), to have been prescribed a beta-blocker if they had asthma (OR 0.73, 95% CI 0.58, 0.91) or (in those aged 75 years and older) to have been prescribed an ACE inhibitor or diuretic without a measurement of urea and electrolytes in the last 15 months (OR 0.51, 95% CI 0.34, 0.78). The economic analysis suggests that the PINCER pharmacist intervention has 95% probability of being cost effective if the decision-maker’s ceiling willingness to pay reaches £75 (6 months) or £85 (12 months) per error avoided. The intervention addressed an issue that was important to professionals and their teams and was delivered in a way that was acceptable to practices with minimum disruption of normal work processes. Comparison of the trial findings with changes seen in QRESEARCH practices indicated that any reductions achieved in the simple feedback arm were likely, in the main, to have been related to secular trends rather than the intervention. Conclusions Compared with simple feedback, the pharmacist-led intervention resulted in reductions in proportions of patients at risk of prescribing and monitoring errors for the primary outcome measures and the composite secondary outcome measures at six-months and (with the exception of the NSAID/peptic ulcer outcome measure) 12-months post-intervention. The intervention is acceptable to pharmacists and practices, and is likely to be seen as costeffective by decision makers.