The MicroArray Quality Control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models.

Gene expression data from microarrays are being applied to predict preclinical and clinical endpoints, but the reliability of these predictions has not been established. In the MAQC-II project, 36 independent teams analyzed six microarray data sets to generate predictive models for classifying a sample with respect to one of 13 endpoints indicative of lung or liver toxicity in rodents, or of breast cancer, multiple myeloma or neuroblastoma in humans. In total, >30,000 models were built using many combinations of analytical methods. The teams generated predictive models without knowing the biological meaning of some of the endpoints and, to mimic clinical reality, tested the models on data that had not been used for training. We found that model performance depended largely on the endpoint and team proficiency and that different approaches generated models of similar performance. The conclusions and recommendations from MAQC-II should be useful for regulatory agencies, study committees and independent investigators that evaluate methods for global gene expression analysis.

A clinical prognostic model for the identification of low-risk patients with acute symptomatic pulmonary embolism and active cancer.

BACKGROUND: Physicians need a specific risk-stratification tool to facilitate safe and cost-effective approaches to the management of patients with cancer and acute pulmonary embolism (PE). The objective of this study was to develop a simple risk score for predicting 30-day mortality in patients with PE and cancer by using measures readily obtained at the time of PE diagnosis. METHODS: Investigators randomly allocated 1,556 consecutive patients with cancer and acute PE from the international multicenter Registro Informatizado de la Enfermedad TromboEmbólica to derivation (67%) and internal validation (33%) samples. The external validation cohort for this study consisted of 261 patients with cancer and acute PE. Investigators compared 30-day all-cause mortality and nonfatal adverse medical outcomes across the derivation and two validation samples. RESULTS: In the derivation sample, multivariable analyses produced the risk score, which contained six variables: age > 80 years, heart rate ≥ 110/min, systolic BP < 100 mm Hg, body weight < 60 kg, recent immobility, and presence of metastases. In the internal validation cohort (n = 508), the 22.2% of patients (113 of 508) classified as low risk by the prognostic model had a 30-day mortality of 4.4% (95% CI, 0.6%-8.2%) compared with 29.9% (95% CI, 25.4%-34.4%) in the high-risk group. In the external validation cohort, the 18% of patients (47 of 261) classified as low risk by the prognostic model had a 30-day mortality of 0%, compared with 19.6% (95% CI, 14.3%-25.0%) in the high-risk group. CONCLUSIONS: The developed clinical prediction rule accurately identifies low-risk patients with cancer and acute PE.

Age above 60 years is not a negative predictive factor for combined antiviral therapy with pegylated interferon alpha and ribavirin in hepatitis C patients

Background: Age is frequently discussed as negative host factor to achieve a sustained virological response (SVR) to antiviral hepatitis C therapy. However, elderly patients often show relevant fibrosis or cirrhosis which is a known negative predictive factor, making it difficult to interpret age as an independent predictive factor. Methods: From the framework of the Swiss hepatitis C cohort (SCCS), we collected data from 545 antiviral hepatitis C therapies, including data from 67 hepatitis C patients ≥ 60 y who had been treated with PEG-interferon and ribavirin. We analyzed host factors (age, gender, fibrosis, haemoglobin, depression, earlier hepatitis C treatment), viral factors (genotype, viral load) and treatment course (early virological response, end of treatment response, SVR). Generalised estimating equations (GEE) regression modelling was used for the primary end point (SVR), with age ≥ 60 y and < 60 y as independent variable and gender, presence of cirrhosis, genotype, earlier treatment and viral load as confounders. SVR was analysed in young and elderly patients after matching for these confounders. Additionally, classification tree analysis was done in elderly patients using these confounders. Results: SVR analyzed in 545 patients was 55%. In genotype 1/4, SVR was 42.9% in 259 patients < 60 y and 26.1% in 46 patients ≥ 60 y. In genotype 2/3, SVR was 74.4% in 215 patients < 60 y and 84% in 25 patients ≥ 60 y. However, GEE model showed that age had no influence on achieving SVR (Odds ratio 0.91). Confounders influenced SVR as known from previous studies (cirrhosis, genotype 1/4, previous treatment and viral load >600'000 IE/ml as negative predictive factors). When young and elderly patients were matched (analysis in 59 elderly patients), SVR was not different in these patient groups (54.2% and 55.9%, resp.; p=0.795 in binomial test). The classification tree-derived best criterion for SVR in elderly patients was genotype, with no further criteria relevant for predicting SVR in genotype 2/3. In patients with genotype 1/4, further criteria were presence of cirrhosis and low viral load <600'000 IE/ml in non-cirrhotic patients. Conclusions: Age is not a relevant predictive factor for achieving SVR, when confounders were taken into account. In terms of effectiveness of antiviral therapy, age does not play a major role and should not be regarded as relevant negative predictive factor. Since life expectancy in Switzerland at age 60 is more than 22 y, hepatitis C therapy is reasonable in elderly patients with known relevant fibrosis or cirrhosis, because interferon-based hepatitis C therapy improves survival and reduces carcinogenesis.

Predictive factors of adrenal insufficiency in patients admitted to acute medical wards: a case control study.

BACKGROUND: Adrenal insufficiency is a rare and potentially lethal disease if untreated. Several clinical signs and biological markers are associated with glucocorticoid failure but the importance of these factors for diagnosing adrenal insufficiency is not known. In this study, we aimed to assess the prevalence of and the factors associated with adrenal insufficiency among patients admitted to an acute internal medicine ward. METHODS: Retrospective, case-control study including all patients with high-dose (250 μg) ACTH-stimulation tests for suspected adrenal insufficiency performed between 2008 and 2010 in an acute internal medicine ward (n = 281). Cortisol values <550 nmol/l upon ACTH-stimulation test were considered diagnostic for adrenal insufficiency. Area under the ROC curve (AROC), sensitivity, specificity, negative and positive predictive values for adrenal insufficiency were assessed for thirteen symptoms, signs and biological variables. RESULTS: 32 patients (11.4%) presented adrenal insufficiency; the others served as controls. Among all clinical and biological parameters studied, history of glucocorticoid withdrawal was the only independent factor significantly associated with patients with adrenal insufficiency (Odds Ratio: 6.71, 95% CI: 3.08 -14.62). Using a logistic regression, a model with four significant and independent variable was obtained, regrouping history of glucocorticoid withdrawal (OR 7.38, 95% CI [3.18 ; 17.11], p-value <0.001), nausea (OR 3.37, 95% CI [1.03 ; 11.00], p-value 0.044), eosinophilia (OR 17.6, 95% CI [1.02; 302.3], p-value 0.048) and hyperkalemia (OR 2.41, 95% CI [0.87; 6.69], p-value 0.092). The AROC (95% CI) was 0.75 (0.70; 0.80) for this model, with 6.3 (0.8 - 20.8) for sensitivity and 99.2 (97.1 - 99.9) for specificity. CONCLUSIONS: 11.4% of patients with suspected adrenal insufficient admitted to acute medical ward actually do present with adrenal insufficiency, defined by an abnormal response to high-dose (250 μg) ACTH-stimulation test. A history of glucocorticoid withdrawal was the strongest factor predicting the potential adrenal failure. The combination of a history of glucocorticoid withdrawal, nausea, eosinophilia and hyperkaliemia might be of interest to suspect adrenal insufficiency.

Computational fluid dynamics of the right ventricular outflow tract and of the pulmonary artery: a bench model of flow dynamics.

OBJECTIVES: The reconstruction of the right ventricular outflow tract (RVOT) with valved conduits remains a challenge. The reoperation rate at 5 years can be as high as 25% and depends on age, type of conduit, conduit diameter and principal heart malformation. The aim of this study is to provide a bench model with computer fluid dynamics to analyse the haemodynamics of the RVOT, pulmonary artery, its bifurcation, and left and right pulmonary arteries that in the future may serve as a tool for analysis and prediction of outcome following RVOT reconstruction. METHODS: Pressure, flow and diameter at the RVOT, pulmonary artery, bifurcation of the pulmonary artery, and left and right pulmonary arteries were measured in five normal pigs with a mean weight of 24.6 ± 0.89 kg. Data obtained were used for a 3D computer fluid-dynamics simulation of flow conditions, focusing on the pressure, flow and shear stress profile of the pulmonary trunk to the level of the left and right pulmonary arteries. RESULTS: Three inlet steady flow profiles were obtained at 0.2, 0.29 and 0.36 m/s that correspond to the flow rates of 1.5, 2.0 and 2.5 l/min flow at the RVOT. The flow velocity profile was constant at the RVOT down to the bifurcation and decreased at the left and right pulmonary arteries. In all three inlet velocity profiles, low sheer stress and low-velocity areas were detected along the left wall of the pulmonary artery, at the pulmonary artery bifurcation and at the ostia of both pulmonary arteries. CONCLUSIONS: This computed fluid real-time model provides us with a realistic picture of fluid dynamics in the pulmonary tract area. Deep shear stress areas correspond to a turbulent flow profile that is a predictive factor for the development of vessel wall arteriosclerosis. We believe that this bench model may be a useful tool for further evaluation of RVOT pathology following surgical reconstructions.

Gene expression profiling of human glioblastomas for the identification of predictive factors and characterisation of molecular mechanism implicated in response to therapy and outcome

ABSTRACT Poor outcome for glioblastoma patients is largely due to resistance to chemoradiation therapy. While epigenetic inactivation of MGMT mediated DNA repair is highly predictive for benefit from the alkylating agent therapy Temozolomide, additional mechanisms for resistance associated with molecular alterations exist. Furthermore, new concepts in cancer suggest that resistance to treatment may be linked to cancer stem cells that escape therapy and act as source for tumour recurrence. We determined gene expression signatures associated with outcome in glioblastoma patients enrolled in a phase II and phase III clinical trial establishing the new combination therapy of radiation plus concomitant and adjuvant Temozolomide. Correlating stable gene clusters emerging from unsupervised analysis with survival of 42 treated patients identified a number of biological processes associated with outcome. Most prominent, a gene cluster dominated by HOX genes and comprising PROM1, was associated with resistance. PROM1 encodes CD133, a marker for a subpopulation of tumour cells enriched for glioblastoma stem- like cells. The core of this correlated HOX cluster was comprised in the top genes of a "self-renewal signature" defined in a mouse model for MLL-AF9 initiated leukaemia. The association of the HOX gene cluster with tumour resistance was confirmed in two external data sets of 146 malignant glioma As additional resistance factors we identified over-expression of the epidermal growth factor receptor gene, EGFR, while increased gene expression related to biological features of tumour host interaction, including markers for tumour vascular and cell adhesion, and innate immune response, were associated with better outcome. The "self-renewal" signature associated with resistance to the new combination chemoradiation therapy provides first clinical evidence that glioma stem like cells may implicated in resistance in a uniformly treated cohort of glioblastoma patients. This study underlines the need to target the tumour stem cell compartment, and provides some testable hypothesis for biological mechanisms relevant for malignant behaviour of glioblastoma that may be targeted in new treatment approaches. Résumé Le glioblastome, tumeur cérébrale primaire maligne la plus fréquente, est connue pour son mauvais pronostique. Des avancées chimiothérapeutiques récentes avec des agents alkylants comme le témozolomide (TMZ), ont permis une amélioration notable dans la survie de certains patients. Les bénéficiaires ont la caractéristique commune de présenter une particularité génétique, la methylation du MGMT (methylguanine methyltransferase). Néanmoins, d'autres mécanismes de résistance en fonction des aberrations moléculaires existent. Nous avons établi les profils d'expressions génétiques des patients traités par irradiation et TMZ dans des études cliniques de phase II et III. En combinant des méthodes non-supervisées et supervisées, de l'étude de la cohorte des patients traités nous avons découvert des groupes de gènes associés à la survie. Un ensemble de gènes contenant les gènes Hox semble lié au mécanisme de résistance au traitement. Récemment, les gènes Hox ont été décrits comme faisant partie d"une signature d'autorenouvellement (self-renewal) des cellules souches cancéreuses de la leucémie. L'autorenouvellement est un processus grâce auquel les cellules souches se maintiennent tout au long de la vie. Cette association à la résistance est confirmée dans deux autres études indépendantes. Un autre facteur de résistance au traitement est la surexpression du gène EGFR. D'autre part, deux groupes de gènes associés à la relation entre hôte-tumeur tels que les marqueurs des vaisseaux tumoraux et de la réponse immunitaire innée s'avèrent avoir un effet positif sur la survie des patients traités. La découverte de la signature d'autorenouvellement comme facteur de résistance à la nouvelle chimio-radiothérapie offre une preuve clinique que les cellules souches cancéreuses sont impliquées dans la résistance au traitement. If est donc logique de penser que le traitement ciblé contre des cellules souches cancéreuses va dans l'avenir permettre des thérapies anticancéreuses plus performantes.

Testing for convergence clubs in income per-capita: A predictive density approach

The paper proposes a technique to jointly test for groupings of unknown size in the cross sectional dimension of a panel and estimates the parameters of each group, and applies it to identifying convergence clubs in income per-capita. The approach uses the predictive density of the data, conditional on the parameters of the model. The steady state distribution of European regional data clusters around four poles of attraction with different economic features. The distribution of incomeper-capita of OECD countries has two poles of attraction and each grouphas clearly identifiable economic characteristics.

Combining multivariate density forecasts using predictive criteria

This paper combines multivariate density forecasts of output growth, inflationand interest rates from a suite of models. An out-of-sample weighting scheme based onthe predictive likelihood as proposed by Eklund and Karlsson (2005) and Andersson andKarlsson (2007) is used to combine the models. Three classes of models are considered: aBayesian vector autoregression (BVAR), a factor-augmented vector autoregression (FAVAR)and a medium-scale dynamic stochastic general equilibrium (DSGE) model. Using Australiandata, we find that, at short forecast horizons, the Bayesian VAR model is assignedthe most weight, while at intermediate and longer horizons the factor model is preferred.The DSGE model is assigned little weight at all horizons, a result that can be attributedto the DSGE model producing density forecasts that are very wide when compared withthe actual distribution of observations. While a density forecast evaluation exercise revealslittle formal evidence that the optimally combined densities are superior to those from thebest-performing individual model, or a simple equal-weighting scheme, this may be a resultof the short sample available.

A test of the predictive validity of non-linear QALY models using time trade-off utilities

This paper presents a test of the predictive validity of various classes ofQALY models (i.e., linear, power and exponential models). We first estimatedTTO utilities for 43 EQ-5D chronic health states and next these states wereembedded in health profiles. The chronic TTO utilities were then used topredict the responses to TTO questions with health profiles. We find that thepower QALY model clearly outperforms linear and exponential QALY models.Optimal power coefficient is 0.65. Our results suggest that TTO-based QALYcalculations may be biased. This bias can be avoided using a power QALY model.

The predictive value of trabecular bone score (TBS) on whole lumbar vertebrae mechanics: an ex vivo study.

We investigated the association of trabecular bone score (TBS) with microarchitecture and mechanical behavior of human lumbar vertebrae. We found that TBS reflects vertebral trabecular microarchitecture and is an independent predictor of vertebral mechanics. However, the addition of TBS to areal BMD (aBMD) did not significantly improve prediction of vertebral strength. INTRODUCTION: The trabecular bone score (TBS) is a gray-level measure of texture using a modified experimental variogram which can be extracted from dual-energy X-ray absorptiometry (DXA) images. The current study aimed to confirm whether TBS is associated with trabecular microarchitecture and mechanics of human lumbar vertebrae, and if its combination with BMD improves prediction of fracture risk. METHODS: Lumbar vertebrae (L3) were harvested fresh from 16 donors. The anteroposterior and lateral bone mineral content (BMC) and areal BMD (aBMD) of the vertebral body were measured using DXA; then, the TBS was extracted using TBS iNsight software (Medimaps SA, France). The trabecular bone volume (Tb.BV/tissue volume, TV), trabecular thickness (Tb.Th), degree of anisotropy, and structure model index (SMI) were measured using microcomputed tomography. Quasi-static uniaxial compressive testing was performed on L3 vertebral bodies to assess failure load and stiffness. RESULTS: The TBS was significantly correlated to Tb.BV/TV and SMI (râeuro0/00=âeuro0/000.58 and -0.62; pâeuro0/00=âeuro0/000.02, 0.01), but not related to BMC and BMD. TBS was significantly correlated with stiffness (râeuro0/00=âeuro0/000.64; pâeuro0/00=âeuro0/000.007), independently of bone mass. Using stepwise multiple regression models, we failed to demonstrate that the combination of BMD and TBS was better at explaining mechanical behavior than either variable alone. However, the combination TBS, Tb.Th, and BMC did perform better than each parameter alone, explaining 79 % of the variability in stiffness. CONCLUSIONS: In our study, TBS was associated with microarchitecture parameters and with vertebral mechanical behavior, but TBS did not improve prediction of vertebral biomechanical properties in addition to aBMD.

Early multimodal outcome prediction after cardiac arrest in patients treated with hypothermia.

OBJECTIVES: Therapeutic hypothermia and pharmacological sedation may influence outcome prediction after cardiac arrest. The use of a multimodal approach, including clinical examination, electroencephalography, somatosensory-evoked potentials, and serum neuron-specific enolase, is recommended; however, no study examined the comparative performance of these predictors or addressed their optimal combination. DESIGN: Prospective cohort study. SETTING: Adult ICU of an academic hospital. PATIENTS: One hundred thirty-four consecutive adults treated with therapeutic hypothermia after cardiac arrest. MEASUREMENTS AND MAIN RESULTS: Variables related to the cardiac arrest (cardiac rhythm, time to return of spontaneous circulation), clinical examination (brainstem reflexes and myoclonus), electroencephalography reactivity during therapeutic hypothermia, somatosensory-evoked potentials, and serum neuron-specific enolase. Models to predict clinical outcome at 3 months (assessed using the Cerebral Performance Categories: 5 = death; 3-5 = poor recovery) were evaluated using ordinal logistic regressions and receiving operator characteristic curves. Seventy-two patients (54%) had a poor outcome (of whom, 62 died), and 62 had a good outcome. Multivariable ordinal logistic regression identified absence of electroencephalography reactivity (p < 0.001), incomplete recovery of brainstem reflexes in normothermia (p = 0.013), and neuron-specific enolase higher than 33 μg/L (p = 0.029), but not somatosensory-evoked potentials, as independent predictors of poor outcome. The combination of clinical examination, electroencephalography reactivity, and neuron-specific enolase yielded the best predictive performance (receiving operator characteristic areas: 0.89 for mortality and 0.88 for poor outcome), with 100% positive predictive value. Addition of somatosensory-evoked potentials to this model did not improve prognostic accuracy. CONCLUSIONS: Combination of clinical examination, electroencephalography reactivity, and serum neuron-specific enolase offers the best outcome predictive performance for prognostication of early postanoxic coma, whereas somatosensory-evoked potentials do not add any complementary information. Although prognostication of poor outcome seems excellent, future studies are needed to further improve prediction of good prognosis, which still remains inaccurate.

Prediction of 18-month survival in patients with primary myelodysplastic syndrome. A regression model and scoring system based on the combination of chromosome findings and the Bournemouth score.

The predictive potential of six selected factors was assessed in 72 patients with primary myelodysplastic syndrome using univariate and multivariate logistic regression analysis of survival at 18 months. Factors were age (above median of 69 years), dysplastic features in the three myeloid bone marrow cell lineages, presence of chromosome defects, all metaphases abnormal, double or complex chromosome defects (C23), and a Bournemouth score of 2, 3, or 4 (B234). In the multivariate approach, B234 and C23 proved to be significantly associated with a reduction in the survival probability. The similarity of the regression coefficients associated with these two factors means that they have about the same weight. Consequently, the model was simplified by counting the number of factors (0, 1, or 2) present in each patient, thus generating a scoring system called the Lausanne-Bournemouth score (LB score). The LB score combines the well-recognized and easy-to-use Bournemouth score (B score) with the chromosome defect complexity, C23 constituting an additional indicator of patient outcome. The predicted risk of death within 18 months calculated from the model is as follows: 7.1% (confidence interval: 1.7-24.8) for patients with an LB score of 0, 60.1% (44.7-73.8) for an LB score of 1, and 96.8% (84.5-99.4) for an LB score of 2. The scoring system presented here has several interesting features. The LB score may improve the predictive value of the B score, as it is able to recognize two prognostic groups in the intermediate risk category of patients with B scores of 2 or 3. It has also the ability to identify two distinct prognostic subclasses among RAEB and possibly CMML patients. In addition to its above-described usefulness in the prognostic evaluation, the LB score may bring new insights into the understanding of evolution patterns in MDS. We used the combination of the B score and chromosome complexity to define four classes which may be considered four possible states of myelodysplasia and which describe two distinct evolutional pathways.

Predictive ability of severe rainfall events over Catalonia for the year 2008

This paper analyses the predictive ability of quantitative precipitation forecasts (QPF) and the so-called "poor-man" rainfall probabilistic forecasts (RPF). With this aim, the full set of warnings issued by the Meteorological Service of Catalonia (SMC) for potentially-dangerous events due to severe precipitation has been analysed for the year 2008. For each of the 37 warnings, the QPFs obtained from the limited-area model MM5 have been verified against hourly precipitation data provided by the rain gauge network covering Catalonia (NE of Spain), managed by SMC. For a group of five selected case studies, a QPF comparison has been undertaken between the MM5 and COSMO-I7 limited-area models. Although MM5's predictive ability has been examined for these five cases by making use of satellite data, this paper only shows in detail the heavy precipitation event on the 9¿10 May 2008. Finally, the "poor-man" rainfall probabilistic forecasts (RPF) issued by SMC at regional scale have also been tested against hourly precipitation observations. Verification results show that for long events (>24 h) MM5 tends to overestimate total precipitation, whereas for short events (¿24 h) the model tends instead to underestimate precipitation. The analysis of the five case studies concludes that most of MM5's QPF errors are mainly triggered by very poor representation of some of its cloud microphysical species, particularly the cloud liquid water and, to a lesser degree, the water vapor. The models' performance comparison demonstrates that MM5 and COSMO-I7 are on the same level of QPF skill, at least for the intense-rainfall events dealt with in the five case studies, whilst the warnings based on RPF issued by SMC have proven fairly correct when tested against hourly observed precipitation for 6-h intervals and at a small region scale. Throughout this study, we have only dealt with (SMC-issued) warning episodes in order to analyse deterministic (MM5 and COSMO-I7) and probabilistic (SMC) rainfall forecasts; therefore we have not taken into account those episodes that might (or might not) have been missed by the official SMC warnings. Therefore, whenever we talk about "misses", it is always in relation to the deterministic LAMs' QPFs.

Higher-order colored-noise effects in multivariable systems

We extend the partial resummation technique of Fokker-Planck terms for multivariable stochastic differential equations with colored noise. As an example, a model system of a Brownian particle with colored noise is studied. We prove that the asymmetric behavior found in analog simulations is due to higher-order terms which are left out in that technique. On the contrary, the systematic ¿-expansion approach can explain the analog results.