Selection of Matching Variables in Community Health Intervention Trials

In a matched experimental design, the effectiveness of matching in reducing bias and increasing power depends on the strength of the association between the matching variable and the outcome of interest. In particular, in the design of a community health intervention trial, the effectiveness of a matched design, where communities are matched according to some community characteristic, depends on the strength of the correlation between the matching characteristic and the change in the health behavior being measured. We attempt to estimate the correlation between community characteristics and changes in health behaviors in four datasets from community intervention trials and observational studies. Community characteristics that are highly correlated with changes in health behaviors would potentially be effective matching variables in studies of health intervention programs designed to change those behaviors. Among the community characteristics considered, the urban-rural character of the community was the most highly correlated with changes in health behaviors. The correlations between Per Capita Income, Percent Low Income & Percent aged over 65 and changes in health behaviors were marginally statistically significant (p < 0.08).

Sensitivity Analysis for the Assessment of Causal Vaccine Effects on Viral Load in HIV Vaccine Trials

Vaccines with limited ability to prevent HIV infection may positively impact the HIV/AIDS pandemic by preventing secondary transmission and disease in vaccine recipients who become infected. To evaluate the impact of vaccination on secondary transmission and disease, efficacy trials assess vaccine effects on HIV viral load and other surrogate endpoints measured after infection. A standard test that compares the distribution of viral load between the infected subgroups of vaccine and placebo recipients does not assess a causal effect of vaccine, because the comparison groups are selected after randomization. To address this problem, we formulate clinically relevant causal estimands using the principal stratification framework developed by Frangakis and Rubin (2002), and propose a class of logistic selection bias models whose members identify the estimands. Given a selection model in the class, procedures are developed for testing and estimation of the causal effect of vaccination on viral load in the principal stratum of subjects who would be infected regardless of randomization assignment. We show how the procedures can be used for a sensitivity analysis that quantifies how the causal effect of vaccination varies with the presumed magnitude of selection bias.

Periprocedural and late consequences of overlapping Cypher sirolimus-eluting stents: pooled analysis of five clinical trials

OBJECTIVES: The purpose of this research was to determine the relative safety and efficacy of multiple (> or =2) overlapping Cypher sirolimus-eluting stents (SES) (Johnson ; Johnson, New Brunswick, New Jersey). BACKGROUND: Overlapping coronary stents are common. The periprocedural and late clinical and angiographic consequences of overlapped coronary stents are not clearly defined, particularly for drug-eluting stents. METHODS: All patients enrolled into five clinical trials of the SES were analyzed. Three of these trials were prospective randomized comparisons of the SES to the bare-metal stent (BMS), and two were prospective non-randomized trials of SES-treated patients with historical controls. All clinical and angiographic outcomes in overlap-stent-treated patients were compared by stent type and with single-stent-treated patients for the same stent device. RESULTS: In all, 575 patients with stent overlap (337 SES, 238 BMS) and 1,162 patients with single stents (697 SES, 465 BMS) were analyzed. Stent overlap was associated with a greater late lumen loss in stent and more frequent angiographic restenosis regardless of stent type. Among overlap-stent-treated patients, the SES provided similar magnitude of restenosis benefit as observed for single-stent-treated patients. Overlapped SES was not associated with an increase in myocardial infarction. CONCLUSIONS: The strategy of SES overlap, when required, is both safe and efficacious in reducing restenosis with no increase in the incidence of myocardial infarction or major adverse cardiovascular events, when compared with a bare metal coronary stent prosthesis.

Designed Extension of Survival Studies: Application to Clinical Trials with Unrecognized Heterogeneity

It is well known that unrecognized heterogeneity among patients, such as is conferred by genetic subtype, can undermine the power of randomized trial, designed under the assumption of homogeneity, to detect a truly beneficial treatment. We consider the conditional power approach to allow for recovery of power under unexplained heterogeneity. While Proschan and Hunsberger (1995) confined the application of conditional power design to normally distributed observations, we consider more general and difficult settings in which the data are in the framework of continuous time and are subject to censoring. In particular, we derive a procedure appropriate for the analysis of the weighted log rank test under the assumption of a proportional hazards frailty model. The proposed method is illustrated through application to a brain tumor trial.

A SURVEY OF THE LIKELIHOOD APPROACH TO BIOEQUIVALENCE TRIALS

Bioequivalence trials are abbreviated clinical trials whereby a generic drug or new formulation is evaluated to determine if it is "equivalent" to a corresponding previously approved brand-name drug or formulation. In this manuscript, we survey the process of testing bioequivalence and advocate the likelihood paradigm for representing the resulting data as evidence. We emphasize the unique conflicts between hypothesis testing and confidence intervals in this area - which we believe are indicative of the existence of the systemic defects in the frequentist approach - that the likelihood paradigm avoids. We suggest the direct use of profile likelihoods for evaluating bioequivalence and examine the main properties of profile likelihoods and estimated likelihoods under simulation. This simulation study shows that profile likelihoods are a reasonable alternative to the (unknown) true likelihood for a range of parameters commensurate with bioequivalence research. Our study also shows that the standard methods in the current practice of bioequivalence trials offers only weak evidence from the evidential point of view.

Matched-pair study showed higher quality of placebo-controlled trials in Western phytotherapy than conventional medicine

OBJECTIVES: Herbal medicine (phytotherapy) is widely used, but the evidence for its effectiveness is a matter of ongoing debate. We compared the quality and results of trials of Western phytotherapy and conventional medicine. STUDY DESIGN AND SETTING: A random sample of placebo-controlled trials of Western phytotherapy was identified in a comprehensive literature search (19 electronic databases). Conventional medicine trials matched for condition and type of outcome were selected from the Cochrane Central Controlled Trials Register (issue 1, 2003). Data were extracted in duplicate. Trials described as double-blind, with adequate generation of allocation sequence and adequate concealment of allocation were assumed to be of higher methodological quality. RESULTS: Eighty-nine herbal medicine and 89 matched conventional medicine trials were analyzed. Studies of Western herbalism were smaller, less likely to be published in English, and less likely to be indexed in MEDLINE than their counterparts from conventional medicine. Nineteen (21%) herbal and four (5%) conventional medicine trials were of higher quality. In both groups, smaller trials showed more beneficial treatment effects than larger trials. CONCLUSIONS: Our findings challenge the widely held belief that the quality of the evidence on the effectiveness of herbal medicine is generally inferior to the evidence available for conventional medicine.

Placebo-controlled trials of Chinese herbal medicine and conventional medicine - comparative study

BACKGROUND: Chinese herbal medicine (CHM) is increasingly used in the West, but the evidence on its effectiveness is a matter of debate. We compared the characteristics, study quality and results of clinical trials of CHM and conventional medicine. METHODS: Comparative study of placebo-controlled trials of CHM and conventional medicine. Eleven bibliographic databases and searches by hand of 48 Chinese-language journals. Conventional medicine trials matched for condition and type of outcome were randomly selected from the Cochrane Controlled Trials Register (issue 1, 2003). Trials described as double-blind, with adequate generation of allocation sequence and adequate concealment of allocation, were assumed to be of high quality. Data were analysed using funnel plots and multivariable meta-regression models. RESULTS: 136 CHM trials (119 published in Chinese, 17 published in English) and 136 matched conventional medicine trials (125 published in English) were analysed. The quality of Chinese-language CHM trials tended to be lower than that of English-language CHM trials and conventional medicine trials. Three (2%) CHM trials and 10 (7%) conventional medicine trials were of high quality. In all groups, smaller trials showed more beneficial treatment effects than larger trials. CHM trials published in Chinese showed considerably larger effects than CHM trials published in English (adjusted ratio of ORs 0.29, 95% confidence intervals 0.17-0.52). CONCLUSIONS: Biases are present both in placebo-controlled trials of CHM and conventional medicine, but may be most pronounced in CHM trials published in Chinese-language journals. Only few CHM trials of adequate methodology exist and the effectiveness of CHM therefore remains poorly documented.

Grey literature in meta-analyses of randomized trials of health care interventions

BACKGROUND: The inclusion of grey literature (i.e. literature that has not been formally published) in systematic reviews may help to overcome some of the problems of publication bias, which can arise due to the selective availability of data. OBJECTIVES: To review systematically research studies, which have investigated the impact of grey literature in meta-analyses of randomized trials of health care interventions. SEARCH STRATEGY: We searched the Cochrane Methodology Register (The Cochrane Library Issue 3, 2005), MEDLINE (1966 to 20 May 2005), the Science Citation Index (June 2005) and contacted researchers who may have carried out relevant studies. SELECTION CRITERIA: A study was considered eligible for this review if it compared the effect of the inclusion and exclusion of grey literature on the results of a cohort of meta-analyses of randomized trials. DATA COLLECTION AND ANALYSIS: Data were extracted from each report independently by two reviewers. The main outcome measure was an estimate of the impact of trials from the grey literature on the pooled effect estimates of the meta-analyses. Information was also collected on the area of health care, the number of meta-analyses, the number of trials, the number of trial participants, the year of publication of the trials, the language and country of publication of the trials, the number and type of grey and published literature, and methodological quality. MAIN RESULTS: Five studies met the inclusion criteria. All five studies showed that published trials showed an overall greater treatment effect than grey trials. This difference was statistically significant in one of the five studies. Data could be combined for three of the five studies. This showed that, on average, published trials showed a 9% greater treatment effect than grey trials (ratio of odds ratios for grey versus published trials 1.09; 95% CI 1.03-1.16). Overall there were more published trials included in the meta-analyses than grey trials (median 224 (IQR 108-365) versus 45(IQR 40-102)). Published trials had more participants on average. The most common types of grey literature were abstracts (55%) and unpublished data (30%). There is limited evidence to show whether grey trials are of poorer methodological quality than published trials. AUTHORS' CONCLUSIONS: This review shows that published trials tend to be larger and show an overall greater treatment effect than grey trials. This has important implications for reviewers who need to ensure they identify grey trials, in order to minimise the risk of introducing bias into their review.

CA15-3 and alkaline phosphatase as predictors for breast cancer recurrence: a combined analysis of seven International Breast Cancer Study Group trials

BACKGROUND: We evaluated the ability of CA15-3 and alkaline phosphatase (ALP) to predict breast cancer recurrence. PATIENTS AND METHODS: Data from seven International Breast Cancer Study Group trials were combined. The primary end point was relapse-free survival (RFS) (time from randomization to first breast cancer recurrence), and analyses included 3953 patients with one or more CA15-3 and ALP measurement during their RFS period. CA15-3 was considered abnormal if >30 U/ml or >50% higher than the first value recorded; ALP was recorded as normal, abnormal, or equivocal. Cox proportional hazards models with a time-varying indicator for abnormal CA15-3 and/or ALP were utilized. RESULTS: Overall, 784 patients (20%) had a recurrence, before which 274 (35%) had one or more abnormal CA15-3 and 35 (4%) had one or more abnormal ALP. Risk of recurrence increased by 30% for patients with abnormal CA15-3 [hazard ratio (HR) = 1.30; P = 0.0005], and by 4% for those with abnormal ALP (HR = 1.04; P = 0.82). Recurrence risk was greatest for patients with either (HR = 2.40; P < 0.0001) and with both (HR = 4.69; P < 0.0001) biomarkers abnormal. ALP better predicted liver recurrence. CONCLUSIONS: CA15-3 was better able to predict breast cancer recurrence than ALP, but use of both biomarkers together provided a better early indicator of recurrence. Whether routine use of these biomarkers improves overall survival remains an open question.

A meta-analysis of 16 randomized trials of sirolimus-eluting stents versus paclitaxel-eluting stents in patients with coronary artery disease

OBJECTIVES: Our purpose was to make a synthesis of the available evidence on the relative efficacy and safety of 2 drug-eluting stents (DES)--sirolimus-eluting stent (SES) and paclitaxel-eluting stent (PES)--in patients with coronary artery disease. BACKGROUND: It is not known whether there are differences in late outcomes between the 2 most commonly used DES: SES and PES. METHODS: Sixteen randomized trials of SES versus PES with a total number of 8,695 patients were included in this meta-analysis. A full set of individual outcome data from 5,562 patients was also available. Mean follow-up period ranged from 9 to 37 months. The primary efficacy end point was the need for reintervention (target lesion revascularization). The primary safety end point was stent thrombosis. Secondary end points were death and recurrent myocardial infarction (MI). RESULTS: No significant heterogeneity was found across trials. Compared with PES, SES significantly reduced the risk of reintervention (hazard ratio [HR] 0.74; 95% confidence interval [CI] 0.63 to 0.87, p < 0.001) and stent thrombosis (HR 0.66; 95% CI 0.46 to 0.94, p = 0.02) without significantly impacting on the risk of death (HR 0.92; 95% CI 0.74 to 1.13, p = 0.43) or MI (HR 0.84; 95% CI 0.69 to 1.03, p = 0.10). CONCLUSIONS: Sirolimus-eluting stents are superior to PES in terms of a significant reduction of the risk of reintervention and stent thrombosis. The risk of death was not significantly different between the 2 DES, but there was a trend toward a higher risk of MI with PES, especially after the first year from the procedure.