Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications

OBJECTIVE: To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN: Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING: Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES: 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS: Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS: Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

Outcomes following three-line vision loss during treatment of neovascular age-related macular degeneration: subgroup analyses from MARINA and ANCHOR

This study aims to assess the impact of continued ranibizumab treatment for neovascular age-related macular degeneration on patients from the MARINA and ANCHOR randomised clinical studies who lost ≥ 3 lines of best-corrected visual acuity (BCVA) at any time during the first year of treatment.

Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications.

OBJECTIVE To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

Reporting on methods of subgroup analysis in clinical trials: a survey of four scientific journals

Results of subgroup analysis (SA) reported in randomized clinical trials (RCT) cannot be adequately interpreted without information about the methods used in the study design and the data analysis. Our aim was to show how often inaccurate or incomplete reports occur. First, we selected eight methodological aspects of SA on the basis of their importance to a reader in determining the confidence that should be placed in the author's conclusions regarding such analysis. Then, we reviewed the current practice of reporting these methodological aspects of SA in clinical trials in four leading journals, i.e., the New England Journal of Medicine, the Journal of the American Medical Association, the Lancet, and the American Journal of Public Health. Eight consecutive reports from each journal published after July 1, 1998 were included. Of the 32 trials surveyed, 17 (53%) had at least one SA. Overall, the proportion of RCT reporting a particular methodological aspect ranged from 23 to 94%. Information on whether the SA preceded/followed the analysis was reported in only 7 (41%) of the studies. Of the total possible number of items to be reported, NEJM, JAMA, Lancet and AJPH clearly mentioned 59, 67, 58 and 72%, respectively. We conclude that current reporting of SA in RCT is incomplete and inaccurate. The results of such SA may have harmful effects on treatment recommendations if accepted without judicious scrutiny. We recommend that editors improve the reporting of SA in RCT by giving authors a list of the important items to be reported.

Multiplicity of data in trial reports and the reliability of meta-analyses: empirical study

Objectives To examine the extent of multiplicity of data in trial reports and to assess the impact of multiplicity on meta-analysis results. Design Empirical study on a cohort of Cochrane systematic reviews. Data sources All Cochrane systematic reviews published from issue 3 in 2006 to issue 2 in 2007 that presented a result as a standardised mean difference (SMD). We retrieved trial reports contributing to the first SMD result in each review, and downloaded review protocols. We used these SMDs to identify a specific outcome for each meta-analysis from its protocol. Review methods Reviews were eligible if SMD results were based on two to ten randomised trials and if protocols described the outcome. We excluded reviews if they only presented results of subgroup analyses. Based on review protocols and index outcomes, two observers independently extracted the data necessary to calculate SMDs from the original trial reports for any intervention group, time point, or outcome measure compatible with the protocol. From the extracted data, we used Monte Carlo simulations to calculate all possible SMDs for every meta-analysis. Results We identified 19 eligible meta-analyses (including 83 trials). Published review protocols often lacked information about which data to choose. Twenty-four (29%) trials reported data for multiple intervention groups, 30 (36%) reported data for multiple time points, and 29 (35%) reported the index outcome measured on multiple scales. In 18 meta-analyses, we found multiplicity of data in at least one trial report; the median difference between the smallest and largest SMD results within a meta-analysis was 0.40 standard deviation units (range 0.04 to 0.91). Conclusions Multiplicity of data can affect the findings of systematic reviews and meta-analyses. To reduce the risk of bias, reviews and meta-analyses should comply with prespecified protocols that clearly identify time points, intervention groups, and scales of interest.

A systematic review with procedural assessments and meta-analysis of Low Level Laser Therapy in lateral elbow tendinopathy (tennis elbow)

Background: Recent reviews have indicated that low level level laser therapy (LLLT) is ineffective in lateral elbow tendinopathy (LET) without assessing validity of treatment procedures and doses or the influence of prior steroid injections. Methods: Systematic review with meta-analysis, with primary outcome measures of pain relief and/or global improvement and subgroup analyses of methodological quality, wavelengths and treatment procedures. Results: 18 randomised placebo-controlled trials (RCTs) were identified with 13 RCTs (730 patients) meeting the criteria for meta-analysis. 12 RCTs satisfied half or more of the methodological criteria. Publication bias was detected by Egger's graphical test, which showed a negative direction of bias. Ten of the trials included patients with poor prognosis caused by failed steroid injections or other treatment failures, or long symptom duration or severe baseline pain. The weighted mean difference (WMD) for pain relief was 10.2 mm [95% CI: 3.0 to 17.5] and the RR for global improvement was 1.36 [1.16 to 1.60]. Trials which targeted acupuncture points reported negative results, as did trials with wavelengths 820, 830 and 1064 nm. In a subgroup of five trials with 904 nm lasers and one trial with 632 nm wavelength where the lateral elbow tendon insertions were directly irradiated, WMD for pain relief was 17.2 mm [95% CI: 8.5 to 25.9] and 14.0 mm [95% CI: 7.4 to 20.6] respectively, while RR for global pain improvement was only reported for 904 nm at 1.53 [95% CI: 1.28 to 1.83]. LLLT doses in this subgroup ranged between 0.5 and 7.2 Joules. Secondary outcome measures of painfree grip strength, pain pressure threshold, sick leave and follow-up data from 3 to 8 weeks after the end of treatment, showed consistently significant results in favour of the same LLLT subgroup (p < 0.02). No serious side-effects were reported. Conclusion: LLLT administered with optimal doses of 904 nm and possibly 632 nm wavelengths directly to the lateral elbow tendon insertions, seem to offer short-term pain relief and less disability in LET, both alone and in conjunction with an exercise regimen. This finding contradicts the conclusions of previous reviews which failed to assess treatment procedures, wavelengths and optimal doses.

Increased risk of psychosis in rural-born individuals: An Australian catchment-area study

The aim of the Brisbane Psychosis Study was to examine a range of candidate genetic and nongenetic risk factors in a large, representative sample of patients with psychosis and well controls. The patients (n=310) were drawn from a census conducted as part of the National Survey of Mental Health and Wellbeing. An age and sex-matched well control group (n = 303) was drawn from the same catchment area. Candidate risk factors assessed included migrant status of proband and proband's parents, occupation of father at time of proband's birth, place of birth and place of residence during the first 5 years of life (urbanicity), self-reported pregnancy and birth complications, season of birth and family history. The main analyses were group (cases versus controls) comparisons, with planned subgroup analyses (1) group comparisons for Australian-born subjects only, (2) within-patient comparisons of affective versus nonaffective psychoses. Of the individuals with psychosis, 68% had DSMIII-R schizophrenia. In the main analyses, there were no significant group differences on season of birth, place of birth, place of residency in the first 5 years, occupation of fathers at time of birth or pregnancy and birth complications. Patients had significantly more family members with schizophrenia. Significantly fewer of the patients were migrants or offspring of migrants compared to the controls. When only Australianborn subjects were assessed (n=457), the findings were essentially unchanged apart from a significant excess of cases born in rural sites (chi-square=9.54, df3, p=0.02). There were no significant differences in the risk factors for the comparison involving affective versus nonaffective psychoses. Potential explanations for the inverse urban-rural risk gradient are reviewed. The Stanley Foundation supported this project

Finger and A-B ridge count, and fluctuating asymmetry in psychosis: A catchment area case-control study

Dermatoglyphic measures are of interest to schizophrenia research because they serve as persistent markers of deviant development in foetal life. Several studies have reported alterations in A–B ridge counts, total finger ridge counts and measures related to asymmetry in schizophrenia. The aim of this study was to assess these measures in an Australian catchment area, case-control study. Individuals with psychosisŽns246.were drawn from a catchment-area prevalence study, and well controlsŽns229. were recruited from the same area. Finger and palm prints were taken usingan inkless technique and all dermatoglyphic measures were assessed by a trained rater blind to case status. The dermatoglyphic measures Žfinger ridge count, A–B ridge count, and their derived asymmetry measures. were divided into quartiles based on the distribution of these variables in controls. The main analysis Žlogistic regression controlled for age and sex.examined all psychotic disorders, with planned subgroup analyses comparing controls with Ž1. nonaffective psychosis Žschizophrenia, delusional disorder, schizophreniform psychosis, atypical psychosis.andŽ2. affective psychosis Ždepression with psychosis, bipolar disorder, schizoaffective psychosis.. There were no statistically significant alterations in the odds of havinga psychotic disorder for any of the dermatoglyphic measures. The results did not change when we examined affective and nonaffective psychosis separately. The dermatoglyphic features that distinguish schizophreniar psychosis in other studies were not identified in this Australian study. Regional variations in these findings may provide clues to differential ethnicrgenetic and environmental factors that are associated with schizophrenia. The Stanley Foundation supported this project.

Perioperative epidural analgesia and outcome after major abdominal surgery in high-risk patients

In a primary analysis of a large recently completed randomized trial in 915 high-risk patients undergoing major abdominal surgery, we found no difference in outcome between patients receiving perioperative epidural analgesia and those receiving IV opioids, apart from the incidence of respiratory failure. Therefore, we performed a selected number of predetermined subgroup analyses to identify specific types of patients who may have derived benefit from epidural analgesia. We found no difference in outcome between epidural and control groups in subgroups at increased risk of respiratory or cardiac complications or undergoing aortic surgery, nor in a subgroup with failed epidural block (all P > 0.05). There was a small reduction in the duration of postoperative ventilation (geometric mean [SD]: control group, 0.3 [6.5] h, versus epidural group, 0.2 [4.8] h, P = 0.048). No differences were found in length of stay in intensive care or in the hospital. There was no relationship between frequency of use of epidural analgesia in routine practice outside the trial and benefit from epidural analgesia in the trial. We found no evidence that perioperative epidural analgesia significantly influences major morbidity or mortality after major abdominal surgery.

Arg72Pro TP53 polymorphism and cancer susceptibility: a comprehensive meta-analysis of 302 case-control studies

Arg72Pro is a common polymorphism in TP53, showing differences in its biological functions. Case-control studies have been performed to elucidate the role of Arg72Pro in cancer, although the results are conflicting and heterogeneous. Here, we analyzed pooled data from case-control studies to determine the role of Arg72Pro in different cancer sites. We performed a systematic review and meta-analysis of 302 case-control studies that analyzed Arg72Pro in cancer susceptibility. Odds ratios were estimated for different tumor sites using distinct genetic models, and the heterogeneity between studies was explored using I(2) values and meta-regression. We adopted quality criteria to classify the studies. Subgroup analyses were done for tumor sites according to ethnicity, histological, and anatomical sites. Results indicated that Arg72Pro is associated with higher susceptibility to cancer in some tumor sites, mainly hepatocarcinoma. For some tumor sites, quality of studies was associated with the size of genetic association, mainly in cervical, head and neck, gastric, and lung cancer. However, study quality did not explain the observed heterogeneity substantially. Meta-regression showed that ethnicity, allelic frequency and genotyping method were responsible for a substantial part of the heterogeneity observed. Our results suggest ethnicity and histological and anatomical sites may modulate the penetrance of Arg72Pro in cancer susceptibility. This meta-analysis denotes the importance for more studies with good quality and that the covariates responsible for heterogeneity should be controlled to obtain a more conclusive response about the function of Arg72Pro in cancer.

Association between pre-diagnostic circulating vitamin D concentration and risk of colorectal cancer in European populations:a nested case-control study

Objective. To examine the association between pre-diagnostic circulating vitamin D concentration, dietary intake of vitamin D and calcium, and the risk of colorectal cancer in European populations. Design Nested case-control study. Setting. The study was conducted within the EPIC study, a cohort of more than 520 000 participants from 10 western European countries. Participants: 1248 cases of incident colorectal cancer, which developed after enrolment into the cohort, were matched to 1248 controls. Main outcome measures. Circulating vitamin D concentration (25-hydroxy-vitamin-D, 25-(OH)D) was measured by enzyme immunoassay. Dietary and lifestyle data were obtained from questionnaires. Incidence rate ratios and 95% confidence intervals for the risk of colorectal cancer by 25-(OH)D concentration and levels of dietary calcium and vitamin D intake were estimated from multivariate conditional logistic regression models, with adjustment for potential dietary and other confounders. Results. 25-(OH)D concentration showed a strong inverse linear dose-response association with risk of colorectal cancer (P for trend <0.001). Compared with a pre-defined mid-level concentration of 25-(OH)D (50.0-75.0 nmol/l), lower levels were associated with higher colorectal cancer risk (<25.0 nmol/l: incidence rate ratio 1.32 (95% confidence interval 0.87 to 2.01); 25.0-49.9 nmol/l: 1.28 (1.05 to 1.56), and higher concentrations associated with lower risk (75.0-99.9 nmol/l: 0.88 (0.68 to 1.13); ≥100.0 nmol/l: 0.77 (0.56 to 1.06)). In analyses by quintile of 25-(OH)D concentration, patients in the highest quintile had a 40% lower risk of colorectal cancer than did those in the lowest quintile (P<0.001). Subgroup analyses showed a strong association for colon but not rectal cancer (P for heterogeneity=0.048). Greater dietary intake of calcium was associated with a lower colorectal cancer risk. Dietary vitamin D was not associated with disease risk. Findings did not vary by sex and were not altered by corrections for season or month of blood donation. Conclusions The results of this large observational study indicate a strong inverse association between levels of pre-diagnostic 25-(OH)D concentration and risk of colorectal cancer in western European populations. Further randomised trials are needed to assess whether increases in circulating 25-(OH)D concentration can effectively decrease the risk of colorectal cancer.

Circulating prolactin and in situ breast cancer risk in the European EPIC cohort: a case-control study.

INTRODUCTION The relationship between circulating prolactin and invasive breast cancer has been investigated previously, but the association between prolactin levels and in situ breast cancer risk has received less attention. METHODS We analysed the relationship between pre-diagnostic prolactin levels and the risk of in situ breast cancer overall, and by menopausal status and use of postmenopausal hormone therapy (HT) at blood donation. Conditional logistic regression was used to assess this association in a case-control study nested within the European Prospective Investigation into Cancer and Nutrition (EPIC) cohort, including 307 in situ breast cancer cases and their matched control subjects. RESULTS We found a significant positive association between higher circulating prolactin levels and risk of in situ breast cancer among all women [pre-and postmenopausal combined, ORlog2 = 1.35 (95%CI 1.04-1.76), Ptrend = 0.03]. No statistically significant heterogeneity was found between prolactin levels and in situ cancer risk by menopausal status (Phet = 0.98) or baseline HT use (Phet = 0.20), although the observed association was more pronounced among postmenopausal women using HT compared to non-users (Ptrend = 0.06 vs Ptrend = 0.35). In subgroup analyses, the observed positive association was strongest in women diagnosed with in situ breast tumors <4 years compared to ≥4 years after blood donation (Ptrend = 0.01 vs Ptrend = 0.63; Phet = 0.04) and among nulliparous women compared to parous women (Ptrend = 0.03 vs Ptrend = 0.15; Phet = 0.07). CONCLUSIONS Our data extends prior research linking prolactin and invasive breast cancer to the outcome of in situ breast tumours and shows that higher circulating prolactin is associated with increased risk of in situ breast cancer.