Validation of the Asthma Predictive Index and comparison with simpler clinical prediction rules

Background The loose and stringent Asthma Predictive Indices (API), developed in Tucson, are popular rules to predict asthma in preschool children. To be clinically useful, they require validation in different settings. Objective To assess the predictive performance of the API in an independent population and compare it with simpler rules based only on preschool wheeze. Methods We studied 1954 children of the population-based Leicester Respiratory Cohort, followed up from age 1 to 10 years. The API and frequency of wheeze were assessed at age 3 years, and we determined their association with asthma at ages 7 and 10 years by using logistic regression. We computed test characteristics and measures of predictive performance to validate the API and compare it with simpler rules. Results The ability of the API to predict asthma in Leicester was comparable to Tucson: for the loose API, odds ratios for asthma at age 7 years were 5.2 in Leicester (5.5 in Tucson), and positive predictive values were 26% (26%). For the stringent API, these values were 8.2 (9.8) and 40% (48%). For the simpler rule early wheeze, corresponding values were 5.4 and 21%; for early frequent wheeze, 6.7 and 36%. The discriminative ability of all prediction rules was moderate (c statistic ≤ 0.7) and overall predictive performance low (scaled Brier score < 20%). Conclusion Predictive performance of the API in Leicester, although comparable to the original study, was modest and similar to prediction based only on preschool wheeze. This highlights the need for better prediction rules.

Prognostic clinical prediction rules to identify a low-risk pulmonary embolism: a systematic review and meta-analysis

Prognostic assessment is important for the management of patients with a pulmonary embolism (PE). A number of clinical prediction rules (CPRs) have been proposed for stratifying PE mortality risk. The aim of this systematic review was to assess the performance of prognostic CPRs in identifying a low-risk PE.

Improving the clinical prediction of psychosis by combining ultra-high risk criteria and cognitive basic symptoms

OBJECTIVE Cognitive impairments are regarded as a core component of schizophrenia. However, the cognitive dimension of psychosis is hardly considered by ultra-high risk (UHR) criteria. Therefore, we studied whether the combination of symptomatic UHR criteria and the basic symptom criterion "cognitive disturbances" (COGDIS) is superior in predicting first-episode psychosis. METHOD In a naturalistic 48-month follow-up study, the conversion rate to first-episode psychosis was studied in 246 outpatients of an early detection of psychosis service (FETZ); thereby, the association between conversion, and the combined and singular use of UHR criteria and COGDIS was compared. RESULTS Patients that met UHR criteria and COGDIS (n=127) at baseline had a significantly higher risk of conversion (hr=0.66 at month 48) and a shorter time to conversion than patients that met only UHR criteria (n=37; hr=0.28) or only COGDIS (n=30; hr=0.23). Furthermore, the risk of conversion was higher for the combined criteria than for UHR criteria (n=164; hr=0.56 at month 48) and COGDIS (n=158; hr=0.56 at month 48) when considered irrespective of each other. CONCLUSIONS Our findings support the merits of considering both COGDIS and UHR criteria in the early detection of persons who are at high risk of developing a first psychotic episode within 48months. Applying both sets of criteria improves sensitivity and individual risk estimation, and may thereby support the development of stage-targeted interventions. Moreover, since the combined approach enables the identification of considerably more homogeneous at-risk samples, it should support both preventive and basic research.

A clinical prediction model to identify patients at high risk of death in the emergency department.

PURPOSE Rapid assessment and intervention is important for the prognosis of acutely ill patients admitted to the emergency department (ED). The aim of this study was to prospectively develop and validate a model predicting the risk of in-hospital death based on all available information available at the time of ED admission and to compare its discriminative performance with a non-systematic risk estimate by the triaging first health-care provider. METHODS Prospective cohort analysis based on a multivariable logistic regression for the probability of death. RESULTS A total of 8,607 consecutive admissions of 7,680 patients admitted to the ED of a tertiary care hospital were analysed. Most frequent APACHE II diagnostic categories at the time of admission were neurological (2,052, 24 %), trauma (1,522, 18 %), infection categories [1,328, 15 %; including sepsis (357, 4.1 %), severe sepsis (249, 2.9 %), septic shock (27, 0.3 %)], cardiovascular (1,022, 12 %), gastrointestinal (848, 10 %) and respiratory (449, 5 %). The predictors of the final model were age, prolonged capillary refill time, blood pressure, mechanical ventilation, oxygen saturation index, Glasgow coma score and APACHE II diagnostic category. The model showed good discriminative ability, with an area under the receiver operating characteristic curve of 0.92 and good internal validity. The model performed significantly better than non-systematic triaging of the patient. CONCLUSIONS The use of the prediction model can facilitate the identification of ED patients with higher mortality risk. The model performs better than a non-systematic assessment and may facilitate more rapid identification and commencement of treatment of patients at risk of an unfavourable outcome.

Clinical prediction of large vessel occlusion in anterior circulation stroke: mission impossible?

Simple clinical scores to predict large vessel occlusion (LVO) in acute ischemic stroke would be helpful to triage patients in the prehospital phase. We assessed the ability of various combinations of National Institutes of Health Stroke Scale (NIHSS) subitems and published stroke scales (i.e., RACE scale, 3I-SS, sNIHSS-8, sNIHSS-5, sNIHSS-1, mNIHSS, a-NIHSS items profiles A-E, CPSS1, CPSS2, and CPSSS) to predict LVO on CT or MR arteriography in 1085 consecutive patients (39.4 % women, mean age 67.7 years) with anterior circulation strokes within 6 h of symptom onset. 657 patients (61 %) had an occlusion of the internal carotid artery or the M1/M2 segment of the middle cerebral artery. Best cut-off value of the total NIHSS score to predict LVO was 7 (PPV 84.2 %, sensitivity 81.0 %, specificity 76.6 %, NPV 72.4 %, ACC 79.3 %). Receiver operating characteristic curves of various combinations of NIHSS subitems and published scores were equally or less predictive to show LVO than the total NIHSS score. At intersection of sensitivity and specificity curves in all scores, at least 1/5 of patients with LVO were missed. Best odds ratios for LVO among NIHSS subitems were best gaze (9.6, 95 %-CI 6.765-13.632), visual fields (7.0, 95 %-CI 3.981-12.370), motor arms (7.6, 95 %-CI 5.589-10.204), and aphasia/neglect (7.1, 95 %-CI 5.352-9.492). There is a significant correlation between clinical scores based on the NIHSS score and LVO on arteriography. However, if clinically relevant thresholds are applied to the scores, a sizable number of LVOs are missed. Therefore, clinical scores cannot replace vessel imaging.

Clinical decision rules and D-Dimer in venous thromboembolism: current controversies and future research priorities

Venous thromboembolism (VTE) is a potentially lethal clinical condition that is suspected in patients with common clinical complaints, in many and varied, clinical care settings. Once VTE is diagnosed, optimal therapeutic management (thrombolysis, IVC filters, type and duration of anticoagulants) and ideal therapeutic management settings (outpatient, critical care) are also controversial. Clinical prediction tools, including clinical decision rules and D-Dimer, have been developed, and some validated, to assist clinical decision making along the diagnostic and therapeutic management paths for VTE. Despite these developments, practice variation is high and there remain many controversies in the use of the clinical prediction tools. In this narrative review, we highlight challenges and controversies in VTE diagnostic and therapeutic management with a focus on clinical decision rules and D-Dimer.

Scores to predict major bleeding risk during oral anticoagulation therapy: a prospective validation study

Clinical scores may help physicians to better assess the individual risk/benefit of oral anticoagulant therapy. We aimed to externally validate and compare the prognostic performance of 7 clinical prediction scores for major bleeding events during oral anticoagulation therapy.

Individual patient data meta-analysis of diagnostic and prognostic studies in obstetrics, gynaecology and reproductive medicine

BACKGROUND: In clinical practice a diagnosis is based on a combination of clinical history, physical examination and additional diagnostic tests. At present, studies on diagnostic research often report the accuracy of tests without taking into account the information already known from history and examination. Due to this lack of information, together with variations in design and quality of studies, conventional meta-analyses based on these studies will not show the accuracy of the tests in real practice. By using individual patient data (IPD) to perform meta-analyses, the accuracy of tests can be assessed in relation to other patient characteristics and allows the development or evaluation of diagnostic algorithms for individual patients. In this study we will examine these potential benefits in four clinical diagnostic problems in the field of gynaecology, obstetrics and reproductive medicine. METHODS/DESIGN: Based on earlier systematic reviews for each of the four clinical problems, studies are considered for inclusion. The first authors of the included studies will be invited to participate and share their original data. After assessment of validity and completeness the acquired datasets are merged. Based on these data, a series of analyses will be performed, including a systematic comparison of the results of the IPD meta-analysis with those of a conventional meta-analysis, development of multivariable models for clinical history alone and for the combination of history, physical examination and relevant diagnostic tests and development of clinical prediction rules for the individual patients. These will be made accessible for clinicians. DISCUSSION: The use of IPD meta-analysis will allow evaluating accuracy of diagnostic tests in relation to other relevant information. Ultimately, this could increase the efficiency of the diagnostic work-up, e.g. by reducing the need for invasive tests and/or improving the accuracy of the diagnostic workup. This study will assess whether these benefits of IPD meta-analysis over conventional meta-analysis can be exploited and will provide a framework for future IPD meta-analyses in diagnostic and prognostic research.

Low statin use in adults hospitalized with acute coronary syndrome.

OBJECTIVE To assess recommended and actual use of statins in primary prevention of cardiovascular disease (CVD) based on clinical prediction scores in adults who develop their first acute coronary syndrome (ACS). METHOD Cross-sectional study of 3172 adults without previous CVD hospitalized with ACS at 4 university centers in Switzerland. The number of participants eligible for statins before hospitalization was estimated based on the European Society of Cardiology (ESC) guidelines and compared to the observed number of participants on statins at hospital entry. RESULTS Overall, 1171 (37%) participants were classified as high-risk (10-year risk of cardiovascular mortality ≥5% or diabetes); 1025 (32%) as intermediate risk (10-year risk <5% but ≥1%); and 976 (31%) as low risk (10-year risk <1%). Before hospitalization, 516 (16%) were on statins; among high-risk participants, only 236 of 1171 (20%) were on statins. If ESC primary prevention guidelines had been fully implemented, an additional 845 high-risk adults (27% of the whole sample) would have been eligible for statins before hospitalization. CONCLUSION Although statins are recommended for primary prevention in high-risk adults, only one-fifth of them are on statins when hospitalized for a first ACS.

PICADAR: a diagnostic predictive tool for primary ciliary dyskinesia.

Symptoms of primary ciliary dyskinesia (PCD) are nonspecific and guidance on whom to refer for testing is limited. Diagnostic tests for PCD are highly specialised, requiring expensive equipment and experienced PCD scientists. This study aims to develop a practical clinical diagnostic tool to identify patients requiring testing.Patients consecutively referred for testing were studied. Information readily obtained from patient history was correlated with diagnostic outcome. Using logistic regression, the predictive performance of the best model was tested by receiver operating characteristic curve analyses. The model was simplified into a practical tool (PICADAR) and externally validated in a second diagnostic centre.Of 641 referrals with a definitive diagnostic outcome, 75 (12%) were positive. PICADAR applies to patients with persistent wet cough and has seven predictive parameters: full-term gestation, neonatal chest symptoms, neonatal intensive care admittance, chronic rhinitis, ear symptoms, situs inversus and congenital cardiac defect. Sensitivity and specificity of the tool were 0.90 and 0.75 for a cut-off score of 5 points. Area under the curve for the internally and externally validated tool was 0.91 and 0.87, respectively.PICADAR represents a simple diagnostic clinical prediction rule with good accuracy and validity, ready for testing in respiratory centres referring to PCD centres.

Prediction of psychosis in clinical high-risk patients by the Schizotypal Personality Questionnaire. Results of the EPOS project

OBJECTIVE: Schizotypal features indicate proneness to psychosis in the general population. It is also possible that they increase transition to psychosis (TTP) among clinical high-risk patients (CHR). Our aim was to investigate whether schizotypal features predict TTP in CHR patients. METHODS: In the EPOS (European Prediction of Psychosis Study) project, 245 young help-seeking CHR patients were prospectively followed for 18 months and their TTP was identified. At baseline, subjects were assessed with the Schizotypal Personality Questionnaire (SPQ). Associations between SPQ items and its subscales with the TTP were analysed in Cox regression analysis. RESULTS: The SPQ subscales and items describing ideas of reference and lack of close interpersonal relationships were found to correlate significantly with TTP. The co-occurrence of these features doubled the risk of TTP. CONCLUSIONS: Presence of ideas of reference and lack of close interpersonal relations increase the risk of full-blown psychosis among CHR patients. This co-occurrence makes the risk of psychosis very high.

Prediction of 1-year mortality in patients with acute coronary syndromes undergoing percutaneous coronary intervention: validation of the logistic clinical SYNTAX (Synergy Between Percutaneous Coronary Interventions With Taxus and Cardiac Surgery) score

OBJECTIVES This study sought to validate the Logistic Clinical SYNTAX (Synergy Between Percutaneous Coronary Intervention With Taxus and Cardiac Surgery) score in patients with non-ST-segment elevation acute coronary syndromes (ACS), in order to further legitimize its clinical application. BACKGROUND The Logistic Clinical SYNTAX score allows for an individualized prediction of 1-year mortality in patients undergoing contemporary percutaneous coronary intervention. It is composed of a "Core" Model (anatomical SYNTAX score, age, creatinine clearance, and left ventricular ejection fraction), and "Extended" Model (composed of an additional 6 clinical variables), and has previously been cross validated in 7 contemporary stent trials (>6,000 patients). METHODS One-year all-cause death was analyzed in 2,627 patients undergoing percutaneous coronary intervention from the ACUITY (Acute Catheterization and Urgent Intervention Triage Strategy) trial. Mortality predictions from the Core and Extended Models were studied with respect to discrimination, that is, separation of those with and without 1-year all-cause death (assessed by the concordance [C] statistic), and calibration, that is, agreement between observed and predicted outcomes (assessed with validation plots). Decision curve analyses, which weight the harms (false positives) against benefits (true positives) of using a risk score to make mortality predictions, were undertaken to assess clinical usefulness. RESULTS In the ACUITY trial, the median SYNTAX score was 9.0 (interquartile range 5.0 to 16.0); approximately 40% of patients had 3-vessel disease, 29% diabetes, and 85% underwent drug-eluting stent implantation. Validation plots confirmed agreement between observed and predicted mortality. The Core and Extended Models demonstrated substantial improvements in the discriminative ability for 1-year all-cause death compared with the anatomical SYNTAX score in isolation (C-statistics: SYNTAX score: 0.64, 95% confidence interval [CI]: 0.56 to 0.71; Core Model: 0.74, 95% CI: 0.66 to 0.79; Extended Model: 0.77, 95% CI: 0.70 to 0.83). Decision curve analyses confirmed the increasing ability to correctly identify patients who would die at 1 year with the Extended Model versus the Core Model versus the anatomical SYNTAX score, over a wide range of thresholds for mortality risk predictions. CONCLUSIONS Compared to the anatomical SYNTAX score alone, the Core and Extended Models of the Logistic Clinical SYNTAX score more accurately predicted individual 1-year mortality in patients presenting with non-ST-segment elevation acute coronary syndromes undergoing percutaneous coronary intervention. These findings support the clinical application of the Logistic Clinical SYNTAX score.

A Stratified Model for Psychosis Prediction in Clinical Practice

Objective: Impaired cognition is an important dimension in psychosis and its at-risk states. Research on the value of impaired cognition for psychosis prediction in at-risk samples, however, mainly relies on study-specific sample means of neurocognitive tests, which unlike widely available general test norms are difficult to translate into clinical practice. The aim of this study was to explore the combined predictive value of at-risk criteria and neurocognitive deficits according to test norms with a risk stratification approach. Method: Potential predictors of psychosis (neurocognitive deficits and at-risk criteria) over 24 months were investigated in 97 at-risk patients. Results: The final prediction model included (1) at-risk criteria (attenuated psychotic symptoms plus subjective cognitive disturbances) and (2) a processing speed deficit (digit symbol test). The model was stratified into 4 risk classes with hazard rates between 0.0 (both predictors absent) and 1.29 (both predictors present). Conclusions: The combination of a processing speed deficit and at-risk criteria provides an optimized stratified risk assessment. Based on neurocognitive test norms, the validity of our proposed 3 risk classes could easily be examined in independent at-risk samples and, pending positive validation results, our approach could easily be applied in clinical practice in the future.

A novel clinical scoring system for outcome prediction in dogs with acute kidney injury managed by hemodialysis.

BACKGROUND No reliable tool to predict outcome of acute kidney injury (AKI) exists. HYPOTHESIS A statistically derived scoring system can accurately predict outcome in dogs with AKI managed with hemodialysis. ANIMALS One hundred and eighty-two client-owned dogs with AKI. METHODS Logistic regression analyses were performed initially on clinical variables available on the 1st day of hospitalization for relevance to outcome. Variables with P< or = .1 were considered for further analyses. Continuous variables outside the reference range were divided into quartiles to yield quartile-specific odds ratios (ORs) for survival. Models were developed by incorporating weighting factors assigned to each quartile based on the OR, using either the integer value of the OR (Model A) or the exact OR (Models B or C, when the etiology was known). A predictive score for each model was calculated for each dog by summing all weighting factors. In Model D, actual values for continuous variables were used in a logistic regression model. Receiver-operating curve analyses were performed to assess sensitivities, specificities, and optimal cutoff points for all models. RESULTS Higher scores were associated with decreased probability of survival (P < .001). Models A, B, C, and D correctly classified outcomes in 81, 83, 87, and 76% of cases, respectively, and optimal sensitivities/specificities were 77/85, 81/85, 83/90 and 92/61%, respectively. CONCLUSIONS AND CLINICAL RELEVANCE The models allowed outcome prediction that corresponded with actual outcome in our cohort. However, each model should be validated further in independent cohorts. The models may also be useful to assess AKI severity.