An empirical comparison of methods for meta-analysis of diagnostic accuracy showed hierarchical models are necessary

OBJECTIVE: Meta-analysis of studies of the accuracy of diagnostic tests currently uses a variety of methods. Statistically rigorous hierarchical models require expertise and sophisticated software. We assessed whether any of the simpler methods can in practice give adequately accurate and reliable results. STUDY DESIGN AND SETTING: We reviewed six methods for meta-analysis of diagnostic accuracy: four simple commonly used methods (simple pooling, separate random-effects meta-analyses of sensitivity and specificity, separate meta-analyses of positive and negative likelihood ratios, and the Littenberg-Moses summary receiver operating characteristic [ROC] curve) and two more statistically rigorous approaches using hierarchical models (bivariate random-effects meta-analysis and hierarchical summary ROC curve analysis). We applied the methods to data from a sample of eight systematic reviews chosen to illustrate a variety of patterns of results. RESULTS: In each meta-analysis, there was substantial heterogeneity between the results of different studies. Simple pooling of results gave misleading summary estimates of sensitivity and specificity in some meta-analyses, and the Littenberg-Moses method produced summary ROC curves that diverged from those produced by more rigorous methods in some situations. CONCLUSION: The closely related hierarchical summary ROC curve or bivariate models should be used as the standard method for meta-analysis of diagnostic accuracy.

Hierarchical modeling gave plausible estimates of associations between metabolic syndrome and components of antiretroviral therapy

OBJECTIVE: Hierarchical modeling has been proposed as a solution to the multiple exposure problem. We estimate associations between metabolic syndrome and different components of antiretroviral therapy using both conventional and hierarchical models. STUDY DESIGN AND SETTING: We use discrete time survival analysis to estimate the association between metabolic syndrome and cumulative exposure to 16 antiretrovirals from four drug classes. We fit a hierarchical model where the drug class provides a prior model of the association between metabolic syndrome and exposure to each antiretroviral. RESULTS: One thousand two hundred and eighteen patients were followed for a median of 27 months, with 242 cases of metabolic syndrome (20%) at a rate of 7.5 cases per 100 patient years. Metabolic syndrome was more likely to develop in patients exposed to stavudine, but was less likely to develop in those exposed to atazanavir. The estimate for exposure to atazanavir increased from hazard ratio of 0.06 per 6 months' use in the conventional model to 0.37 in the hierarchical model (or from 0.57 to 0.81 when using spline-based covariate adjustment). CONCLUSION: These results are consistent with trials that show the disadvantage of stavudine and advantage of atazanavir relative to other drugs in their respective classes. The hierarchical model gave more plausible results than the equivalent conventional model.

Prediction of Psychosis by Mismatch Negativity

BACKGROUND: To develop risk-adapted prevention of psychosis, an accurate estimation of the individual risk of psychosis at a given time is needed. Inclusion of biological parameters into multilevel prediction models is thought to improve predictive accuracy of models on the basis of clinical variables. To this aim, mismatch negativity (MMN) was investigated in a sample clinically at high risk, comparing individuals with and without subsequent conversion to psychosis. METHODS: At baseline, an auditory oddball paradigm was used in 62 subjects meeting criteria of a late risk at-state who remained antipsychotic-naive throughout the study. Median follow-up period was 32 months (minimum of 24 months in nonconverters, n = 37). Repeated-measures analysis of covariance was employed to analyze the MMN recorded at frontocentral electrodes; additional comparisons with healthy controls (HC, n = 67) and first-episode schizophrenia patients (FES, n = 33) were performed. Predictive value was evaluated by a Cox regression model. RESULTS: Compared with nonconverters, duration MMN in converters (n = 25) showed significantly reduced amplitudes across the six frontocentral electrodes; the same applied in comparison with HC, but not FES, whereas the duration MMN in in nonconverters was comparable to HC and larger than in FES. A prognostic score was calculated based on a Cox regression model and stratified into two risk classes, which showed significantly different survival curves. CONCLUSIONS: Our findings demonstrate the duration MMN is significantly reduced in at-risk subjects converting to first-episode psychosis compared with nonconverters and may contribute not only to the prediction of conversion but also to a more individualized risk estimation and thus risk-adapted prevention.

Influence of reported study design characteristics on intervention effect estimates from randomized, controlled trials

Published evidence suggests that aspects of trial design lead to biased intervention effect estimates, but findings from different studies are inconsistent. This study combined data from 7 meta-epidemiologic studies and removed overlaps to derive a final data set of 234 unique meta-analyses containing 1973 trials. Outcome measures were classified as "mortality," "other objective," "or subjective," and Bayesian hierarchical models were used to estimate associations of trial characteristics with average bias and between-trial heterogeneity. Intervention effect estimates seemed to be exaggerated in trials with inadequate or unclear (vs. adequate) random-sequence generation (ratio of odds ratios, 0.89 [95% credible interval {CrI}, 0.82 to 0.96]) and with inadequate or unclear (vs. adequate) allocation concealment (ratio of odds ratios, 0.93 [CrI, 0.87 to 0.99]). Lack of or unclear double-blinding (vs. double-blinding) was associated with an average of 13% exaggeration of intervention effects (ratio of odds ratios, 0.87 [CrI, 0.79 to 0.96]), and between-trial heterogeneity was increased for such studies (SD increase in heterogeneity, 0.14 [CrI, 0.02 to 0.30]). For each characteristic, average bias and increases in between-trial heterogeneity were driven primarily by trials with subjective outcomes, with little evidence of bias in trials with objective and mortality outcomes. This study is limited by incomplete trial reporting, and findings may be confounded by other study design characteristics. Bias associated with study design characteristics may lead to exaggeration of intervention effect estimates and increases in between-trial heterogeneity in trials reporting subjectively assessed outcomes.

A multi-level decomposition of variance in somatic symptom reporting in families with adolescent children

OBJECTIVES: This paper examines four different levels of possible variation in symptom reporting: occasion, day, person and family. DESIGN: In order to rule out effects of retrospection, concurrent symptom reporting was assessed prospectively using a computer-assisted self-report method. METHODS: A decomposition of variance in symptom reporting was conducted using diary data from families with adolescent children. We used palmtop computers to assess concurrent somatic complaints from parents and children six times a day for seven consecutive days. In two separate studies, 314 and 254 participants from 96 and 77 families, respectively, participated. A generalized multilevel linear models approach was used to analyze the data. Symptom reports were modelled using a logistic response function, and random effects were allowed at the family, person and day level, with extra-binomial variation allowed for on the occasion level. RESULTS: Substantial variability was observed at the person, day and occasion level but not at the family level. CONCLUSIONS: To explain symptom reporting in normally healthy individuals, situational as well as person characteristics should be taken into account. Family characteristics, however, would not help to clarify symptom reporting in all family members.

Primary care physician supply and other key determinants of health care utilisation: The case of Switzerland

Background The Swiss government decided to freeze new accreditations for physicians in private practice in Switzerland based on the assumption that demand-induced health care spending may be cut by limiting care offers. This legislation initiated an ongoing controversial public debate in Switzerland. The aim of this study is therefore the determination of socio-demographic and health system-related factors of per capita consultation rates with primary care physicians in the multicultural population of Switzerland. Methods The data were derived from the complete claims data of Swiss health insurers for 2004 and included 21.4 million consultations provided by 6564 Swiss primary care physicians on a fee-for-service basis. Socio-demographic data were obtained from the Swiss Federal Statistical Office. Utilisation-based health service areas were created and were used as observational units for statistical procedures. Multivariate and hierarchical models were applied to analyze the data. Results Models within the study allowed the definition of 1018 primary care service areas with a median population of 3754 and an average per capita consultation rate of 2.95 per year. Statistical models yielded significant effects for various geographical, socio-demographic and cultural factors. The regional density of physicians in independent practice was also significantly associated with annual consultation rates and indicated an associated increase 0.10 for each additional primary care physician in a population of 10,000 inhabitants. Considerable differences across Swiss language regions were observed with reference to the supply of ambulatory health resources provided either by primary care physicians, specialists, or hospital-based ambulatory care. Conclusion The study documents a large small-area variation in utilisation and provision of health care resources in Switzerland. Effects of physician density appeared to be strongly related to Swiss language regions and may be rooted in the different cultural backgrounds of the served populations.

Chronic NSAID use and long-term decline of renal function in a prospective rheumatoid arthritis cohort study

OBJECTIVES Non-steroidal anti-inflammatory drugs (NSAIDs) may cause kidney damage. This study assessed the impact of prolonged NSAID exposure on renal function in a large rheumatoid arthritis (RA) patient cohort. METHODS Renal function was prospectively followed between 1996 and 2007 in 4101 RA patients with multilevel mixed models for longitudinal data over a mean period of 3.2 years. Among the 2739 'NSAID users' were 1290 patients treated with cyclooxygenase type 2 selective NSAIDs, while 1362 subjects were 'NSAID naive'. Primary outcome was the estimated glomerular filtration rate according to the Cockroft-Gault formula (eGFRCG), and secondary the Modification of Diet in Renal Disease and Chronic Kidney Disease Epidemiology Collaboration formula equations and serum creatinine concentrations. In sensitivity analyses, NSAID dosing effects were compared for patients with NSAID registration in ≤/>50%, ≤/>80% or ≤/>90% of assessments. FINDINGS In patients with baseline eGFRCG >30 mL/min, eGFRCG evolved without significant differences over time between 'NSAID users' (mean change in eGFRCG -0.87 mL/min/year, 95% CI -1.15 to -0.59) and 'NSAID naive' (-0.67 mL/min/year, 95% CI -1.26 to -0.09, p=0.63). In a multivariate Cox regression analysis adjusted for significant confounders age, sex, body mass index, arterial hypertension, heart disease and for other insignificant factors, NSAIDs were an independent predictor for accelerated renal function decline only in patients with advanced baseline renal impairment (eGFRCG <30 mL/min). Analyses with secondary outcomes and sensitivity analyses confirmed these results. CONCLUSIONS NSAIDs had no negative impact on renal function estimates but in patients with advanced renal impairment.

Determination of Pelvic Orientation from Ultrasound Images Using Patch-SSMs and a Hierarchical Speed of Sound Compensation Strategy

In the field of computer assisted orthopedic surgery (CAOS) the anterior pelvic plane (APP) is a common concept to determine the pelvic orientation by digitizing distinct pelvic landmarks. As percutaneous palpation is - especially for obese patients - known to be error-prone, B-mode ultrasound (US) imaging could provide an alternative means. Several concepts of using ultrasound imaging to determine the APP landmarks have been introduced. In this paper we present a novel technique, which uses local patch statistical shape models (SSMs) and a hierarchical speed of sound compensation strategy for an accurate determination of the APP. These patches are independently matched and instantiated with respect to associated point clouds derived from the acquired ultrasound images. Potential inaccuracies due to the assumption of a constant speed of sound are compensated by an extended reconstruction scheme. We validated our method with in-vitro studies using a plastic bone covered with a soft-tissue simulation phantom and with a preliminary cadaver trial.