Matched-pair study showed higher quality of placebo-controlled trials in Western phytotherapy than conventional medicine

OBJECTIVES: Herbal medicine (phytotherapy) is widely used, but the evidence for its effectiveness is a matter of ongoing debate. We compared the quality and results of trials of Western phytotherapy and conventional medicine. STUDY DESIGN AND SETTING: A random sample of placebo-controlled trials of Western phytotherapy was identified in a comprehensive literature search (19 electronic databases). Conventional medicine trials matched for condition and type of outcome were selected from the Cochrane Central Controlled Trials Register (issue 1, 2003). Data were extracted in duplicate. Trials described as double-blind, with adequate generation of allocation sequence and adequate concealment of allocation were assumed to be of higher methodological quality. RESULTS: Eighty-nine herbal medicine and 89 matched conventional medicine trials were analyzed. Studies of Western herbalism were smaller, less likely to be published in English, and less likely to be indexed in MEDLINE than their counterparts from conventional medicine. Nineteen (21%) herbal and four (5%) conventional medicine trials were of higher quality. In both groups, smaller trials showed more beneficial treatment effects than larger trials. CONCLUSIONS: Our findings challenge the widely held belief that the quality of the evidence on the effectiveness of herbal medicine is generally inferior to the evidence available for conventional medicine.

Placebo-controlled trials of Chinese herbal medicine and conventional medicine - comparative study

BACKGROUND: Chinese herbal medicine (CHM) is increasingly used in the West, but the evidence on its effectiveness is a matter of debate. We compared the characteristics, study quality and results of clinical trials of CHM and conventional medicine. METHODS: Comparative study of placebo-controlled trials of CHM and conventional medicine. Eleven bibliographic databases and searches by hand of 48 Chinese-language journals. Conventional medicine trials matched for condition and type of outcome were randomly selected from the Cochrane Controlled Trials Register (issue 1, 2003). Trials described as double-blind, with adequate generation of allocation sequence and adequate concealment of allocation, were assumed to be of high quality. Data were analysed using funnel plots and multivariable meta-regression models. RESULTS: 136 CHM trials (119 published in Chinese, 17 published in English) and 136 matched conventional medicine trials (125 published in English) were analysed. The quality of Chinese-language CHM trials tended to be lower than that of English-language CHM trials and conventional medicine trials. Three (2%) CHM trials and 10 (7%) conventional medicine trials were of high quality. In all groups, smaller trials showed more beneficial treatment effects than larger trials. CHM trials published in Chinese showed considerably larger effects than CHM trials published in English (adjusted ratio of ORs 0.29, 95% confidence intervals 0.17-0.52). CONCLUSIONS: Biases are present both in placebo-controlled trials of CHM and conventional medicine, but may be most pronounced in CHM trials published in Chinese-language journals. Only few CHM trials of adequate methodology exist and the effectiveness of CHM therefore remains poorly documented.

Grey literature in meta-analyses of randomized trials of health care interventions

BACKGROUND: The inclusion of grey literature (i.e. literature that has not been formally published) in systematic reviews may help to overcome some of the problems of publication bias, which can arise due to the selective availability of data. OBJECTIVES: To review systematically research studies, which have investigated the impact of grey literature in meta-analyses of randomized trials of health care interventions. SEARCH STRATEGY: We searched the Cochrane Methodology Register (The Cochrane Library Issue 3, 2005), MEDLINE (1966 to 20 May 2005), the Science Citation Index (June 2005) and contacted researchers who may have carried out relevant studies. SELECTION CRITERIA: A study was considered eligible for this review if it compared the effect of the inclusion and exclusion of grey literature on the results of a cohort of meta-analyses of randomized trials. DATA COLLECTION AND ANALYSIS: Data were extracted from each report independently by two reviewers. The main outcome measure was an estimate of the impact of trials from the grey literature on the pooled effect estimates of the meta-analyses. Information was also collected on the area of health care, the number of meta-analyses, the number of trials, the number of trial participants, the year of publication of the trials, the language and country of publication of the trials, the number and type of grey and published literature, and methodological quality. MAIN RESULTS: Five studies met the inclusion criteria. All five studies showed that published trials showed an overall greater treatment effect than grey trials. This difference was statistically significant in one of the five studies. Data could be combined for three of the five studies. This showed that, on average, published trials showed a 9% greater treatment effect than grey trials (ratio of odds ratios for grey versus published trials 1.09; 95% CI 1.03-1.16). Overall there were more published trials included in the meta-analyses than grey trials (median 224 (IQR 108-365) versus 45(IQR 40-102)). Published trials had more participants on average. The most common types of grey literature were abstracts (55%) and unpublished data (30%). There is limited evidence to show whether grey trials are of poorer methodological quality than published trials. AUTHORS' CONCLUSIONS: This review shows that published trials tend to be larger and show an overall greater treatment effect than grey trials. This has important implications for reviewers who need to ensure they identify grey trials, in order to minimise the risk of introducing bias into their review.

CA15-3 and alkaline phosphatase as predictors for breast cancer recurrence: a combined analysis of seven International Breast Cancer Study Group trials

BACKGROUND: We evaluated the ability of CA15-3 and alkaline phosphatase (ALP) to predict breast cancer recurrence. PATIENTS AND METHODS: Data from seven International Breast Cancer Study Group trials were combined. The primary end point was relapse-free survival (RFS) (time from randomization to first breast cancer recurrence), and analyses included 3953 patients with one or more CA15-3 and ALP measurement during their RFS period. CA15-3 was considered abnormal if >30 U/ml or >50% higher than the first value recorded; ALP was recorded as normal, abnormal, or equivocal. Cox proportional hazards models with a time-varying indicator for abnormal CA15-3 and/or ALP were utilized. RESULTS: Overall, 784 patients (20%) had a recurrence, before which 274 (35%) had one or more abnormal CA15-3 and 35 (4%) had one or more abnormal ALP. Risk of recurrence increased by 30% for patients with abnormal CA15-3 [hazard ratio (HR) = 1.30; P = 0.0005], and by 4% for those with abnormal ALP (HR = 1.04; P = 0.82). Recurrence risk was greatest for patients with either (HR = 2.40; P < 0.0001) and with both (HR = 4.69; P < 0.0001) biomarkers abnormal. ALP better predicted liver recurrence. CONCLUSIONS: CA15-3 was better able to predict breast cancer recurrence than ALP, but use of both biomarkers together provided a better early indicator of recurrence. Whether routine use of these biomarkers improves overall survival remains an open question.

A meta-analysis of 16 randomized trials of sirolimus-eluting stents versus paclitaxel-eluting stents in patients with coronary artery disease

OBJECTIVES: Our purpose was to make a synthesis of the available evidence on the relative efficacy and safety of 2 drug-eluting stents (DES)--sirolimus-eluting stent (SES) and paclitaxel-eluting stent (PES)--in patients with coronary artery disease. BACKGROUND: It is not known whether there are differences in late outcomes between the 2 most commonly used DES: SES and PES. METHODS: Sixteen randomized trials of SES versus PES with a total number of 8,695 patients were included in this meta-analysis. A full set of individual outcome data from 5,562 patients was also available. Mean follow-up period ranged from 9 to 37 months. The primary efficacy end point was the need for reintervention (target lesion revascularization). The primary safety end point was stent thrombosis. Secondary end points were death and recurrent myocardial infarction (MI). RESULTS: No significant heterogeneity was found across trials. Compared with PES, SES significantly reduced the risk of reintervention (hazard ratio [HR] 0.74; 95% confidence interval [CI] 0.63 to 0.87, p < 0.001) and stent thrombosis (HR 0.66; 95% CI 0.46 to 0.94, p = 0.02) without significantly impacting on the risk of death (HR 0.92; 95% CI 0.74 to 1.13, p = 0.43) or MI (HR 0.84; 95% CI 0.69 to 1.03, p = 0.10). CONCLUSIONS: Sirolimus-eluting stents are superior to PES in terms of a significant reduction of the risk of reintervention and stent thrombosis. The risk of death was not significantly different between the 2 DES, but there was a trend toward a higher risk of MI with PES, especially after the first year from the procedure.

Randomised controlled trials of homeopathy in hyperactive children: treatment procedure leads to an unconventional study design. Experience with open-label homeopathic treatment preceding the Swiss ADHD placebo controlled, randomised, double-blind, cross-over trial

BACKGROUND: Treatment of patients with attention deficit hyperactivity disorder (ADHD) with homeopathy is difficult. The Swiss randomised, placebo controlled, cross-over trial in ADHD patients (Swiss ADHD trial) was designed with an open-label screening phase prior to the randomised controlled phase. During the screening phase, the response of each child to successive homeopathic medications was observed until the optimal medication was identified. Only children who reached a predefined level of improvement participated in the randomised, cross-over phase. Although the randomised phase revealed a significant beneficial effect of homeopathy, the cross-over caused a strong carryover effect diminishing the apparent difference between placebo and verum treatment. METHODS: This retrospective analysis explores the screening phase data with respect to the risk of failure to demonstrate a specific effect of a randomised controlled trial (RCT) with randomisation at the start of the treatment. RESULTS: During the screening phase, 84% (70/83) of the children responded to treatment and reached eligibility for the randomised trial after a median time of 5 months (range 1-18), with a median of 3 different medications (range 1-9). Thirteen children (16%) did not reach eligibility. Five months after treatment start, the difference in Conners Global Index (CGI) rating between responders and non-responders became highly significant (p = 0.0006). Improvement in CGI was much greater following the identification of the optimal medication than in the preceding suboptimal treatment period (p < 0.0001). CONCLUSIONS: Because of the necessity of identifying an optimal medication before response to treatment can be expected, randomisation at the start of treatment in an RCT of homeopathy in ADHD children has a high risk of failure to demonstrate a specific treatment effect, if the observation time is shorter than 12 months.

Adjunctive corticosteroids for Pneumocystis jiroveci pneumonia in patients with HIV infection: a meta-analysis of randomised controlled trials

BACKGROUND: The objective of this study was to review the effects of adjunctive corticosteroids on overall mortality and the need for mechanical ventilation in HIV-infected patients with Pneumocystis jiroveci pneumonia (PCP) and substantial hypoxemia (arterial oxygen partial pressure <70 mmHg or alveolar-arterial gradient >35 mmHg on room air). METHODS: We conducted a systematic search of the literature for randomised trials published up to December 2004. Selected trials compared adjunctive corticosteroids with placebo or usual care in HIV-infected patients with PCP and reported mortality data. Two teams of reviewers independently evaluated the methodology and extracted data from each primary study. RESULTS: Six studies were included in the meta-analysis. Risk ratios for overall mortality for adjunctive corticosteroids were 0.54 (95% confidence interval [CI], 0.38-0.79) at 1 month and 0.67 (95% CI, 0.49-0.93) at 3-4 months of follow-up. Numbers needed to treat, to prevent 1 death, are 9 patients in a setting without highly active antiretroviral therapy (HAART) available and 22 patients with HAART available. Only the 3 largest trials provided data on the need for mechanical ventilation with a risk ratio of 0.37 (95% CI, 0.20-0.70) in favour of adjunctive corticosteroids. CONCLUSION: The number and size of trials investigating adjunctive corticosteroids for HIV-infected patients with PCP is small, but our results suggest a beneficial effect for patients with substantial hypoxemia.

Clinical end points in coronary stent trials: a case for standardized definitions

BACKGROUND: Although most clinical trials of coronary stents have measured nominally identical safety and effectiveness end points, differences in definitions and timing of assessment have created confusion in interpretation. METHODS AND RESULTS: The Academic Research Consortium is an informal collaboration between academic research organizations in the United States and Europe. Two meetings, in Washington, DC, in January 2006 and in Dublin, Ireland, in June 2006, sponsored by the Academic Research Consortium and including representatives of the US Food and Drug Administration and all device manufacturers who were working with the Food and Drug Administration on drug-eluting stent clinical trial programs, were focused on consensus end point definitions for drug-eluting stent evaluations. The effort was pursued with the objective to establish consistency among end point definitions and provide consensus recommendations. On the basis of considerations from historical legacy to key pathophysiological mechanisms and relevance to clinical interpretability, criteria for assessment of death, myocardial infarction, repeat revascularization, and stent thrombosis were developed. The broadly based consensus end point definitions in this document may be usefully applied or recognized for regulatory and clinical trial purposes. CONCLUSION: Although consensus criteria will inevitably include certain arbitrary features, consensus criteria for clinical end points provide consistency across studies that can facilitate the evaluation of safety and effectiveness of these devices.

Peripheral endovascular revascularization trials: high noon for uniform reporting standards

In the era of evidence based medicine, proof of clinical benefits and cost-effectiveness need to be firmly based on transparent comparisons between various therapeutic alternatives. Standards for reports are a prerequisite for comparisons across reports and should reflect the patient's perspective. According standards have been successfully introduced in many fields of modern medicine, but not yet for peripheral endovascular interventions. Given the overwhelmingly increasing importance of endovascular revascularization in patients with chronic lower limb ischemia, this report provides an updated outline of the heterogeneity of current reporting practice and highlights the need for uniform reporting standards.

Clinical endpoints in peripheral endovascular revascularization trials: a case for standardized definitions

BACKGROUND: Endovascular therapy is a rapidly expanding option for the treatment of patients with peripheral arterial disease (PAD), leading to a myriad of published studies reporting on various revascularization strategies. However, these reports are often difficult to interpret and compare because they do not utilize uniform clinical endpoint definitions. Moreover, few of these studies describe clinical outcomes from a patients' perspective. METHODS AND RESULTS: The DEFINE Group is a collaborative effort of an ad-hoc multidisciplinary team from various specialties involved in peripheral arterial disease therapy in Europe and the United States. DEFINE's goal was to arrive at a broad based consensus for baseline and endpoint definitions in peripheral endovascular revascularization trials for chronic lower limb ischemia. In this project, which started in 2006, the individual team members reviewed the existing pertinent literature. Following this, a series of telephone conferences and face-to-face meetings were held to agree upon definitions. Input was also obtained from regulatory (United States Food and Drug Administration) and industry (device manufacturers with an interest in peripheral endovascular revascularization) stakeholders, respectively. The efforts resulted in the current document containing proposed baseline and endpoint definitions in chronic lower limb PAD. Although the consensus has inevitably included certain arbitrary choices and compromises, adherence to these proposed standard definitions would provide consistency across future trials, thereby facilitating evaluation of clinical effectiveness and safety of various endovascular revascularization techniques. CONCLUSION: This current document is based on a broad based consensus involving relevant stakeholders from the medical community, industry and regulatory bodies. It is proposed that the consensus document may have value for study design of future clinical trials in chronic lower limb ischemia as well as for regulatory purposes.

Clinical trials in head injury

Secondary brain damage, following severe head injury is considered to be a major cause for bad outcome. Impressive reductions of the extent of brain damage in experimental studies have raised high expectations for cerebral neuroprotective treatment, in the clinic. Therefore multiple compounds were and are being evaluated in trials. In this review we discuss the pathomechanisms of traumatic brain damage, based upon their clinical importance. The role of hypothermia, mannitol, barbiturates, steroids, free radical scavengers, arachidonic acid inhibitors, calcium channel blockers, N-methyl-D-aspartate (NMDA) antagonists, and potassium channel blockers, will be discussed. The importance of a uniform strategic approach for evaluation of potentially interesting new compounds in clinical trials, to ameliorate outcome in patients with severe head injury, is proposed. To achieve this goal, two nonprofit organizations were founded: the European Brain Injury Consortium (EBIC) and the American Brain Injury Consortium (ABIC). Their aim lies in conducting better clinical trials, which incorporate lessons learned from previous trials, such that the succession of negative, or incomplete studies, as performed in previous years, will cease.

Is adjuvant chemotherapy of benefit for postmenopausal women who receive endocrine treatment for highly endocrine-responsive, node-positive breast cancer? International Breast Cancer Study Group Trials VII and 12-93

To compare the efficacy of chemoendocrine treatment with that of endocrine treatment (ET) alone for postmenopausal women with highly endocrine responsive breast cancer. In the International Breast Cancer Study Group (IBCSG) Trials VII and 12-93, postmenopausal women with node-positive, estrogen receptor (ER)-positive or ER-negative, operable breast cancer were randomized to receive either chemotherapy or endocrine therapy or combined chemoendocrine treatment. Results were analyzed overall in the cohort of 893 patients with endocrine-responsive disease, and according to prospectively defined categories of ER, age and nodal status. STEPP analyses assessed chemotherapy effect. The median follow-up was 13 years. Adding chemotherapy reduced the relative risk of a disease-free survival event by 19% (P = 0.02) compared with ET alone. STEPP analyses showed little effect of chemotherapy for tumors with high levels of ER expression (P = 0.07), or for the cohort with one positive node (P = 0.03). Chemotherapy significantly improves disease-free survival for postmenopausal women with endocrine-responsive breast cancer, but the magnitude of the effect is substantially attenuated if ER levels are high.