Validation and reclassification of MGAP and GAP in hospital settings using data from the Trauma Audit and Research Network.

BACKGROUND Recently, two simple clinical scores were published to predict survival in trauma patients. Both scores may successfully guide major trauma triage, but neither has been independently validated in a hospital setting. METHODS This is a cohort study with 30-day mortality as the primary outcome to validate two new trauma scores-Mechanism, Glasgow Coma Scale (GCS), Age, and Pressure (MGAP) score and GCS, Age and Pressure (GAP) score-using data from the UK Trauma Audit and Research Network. First, an assessment of discrimination, using the area under the receiver operating characteristic (ROC) curve, and calibration, comparing mortality rates with those originally published, were performed. Second, we calculated sensitivity, specificity, predictive values, and likelihood ratios for prognostic score performance. Third, we propose new cutoffs for the risk categories. RESULTS A total of 79,807 adult (≥16 years) major trauma patients (2000-2010) were included; 5,474 (6.9%) died. Mean (SD) age was 51.5 (22.4) years, median GCS score was 15 (interquartile range, 15-15), and median Injury Severity Score (ISS) was 9 (interquartile range, 9-16). More than 50% of the patients had a low-risk GAP or MGAP score (1% mortality). With regard to discrimination, areas under the ROC curve were 87.2% for GAP score (95% confidence interval, 86.7-87.7) and 86.8% for MGAP score (95% confidence interval, 86.2-87.3). With regard to calibration, 2,390 (3.3%), 1,900 (28.5%), and 1,184 (72.2%) patients died in the low, medium, and high GAP risk categories, respectively. In the low- and medium-risk groups, these were almost double the previously published rates. For MGAP, 1,861 (2.8%), 1,455 (15.2%), and 2,158 (58.6%) patients died in the low-, medium-, and high-risk categories, consonant with results originally published. Reclassifying score point cutoffs improved likelihood ratios, sensitivity and specificity, as well as areas under the ROC curve. CONCLUSION We found both scores to be valid triage tools to stratify emergency department patients, according to their risk of death. MGAP calibrated better, but GAP slightly improved discrimination. The newly proposed cutoffs better differentiate risk classification and may therefore facilitate hospital resource allocation. LEVEL OF EVIDENCE Prognostic study, level II.

Cardiac biomarkers and clinical scores for risk stratification in elderly patients with non-high-risk pulmonary embolism.

OBJECTIVE To determine the prognostic accuracy of cardiac biomarkers alone and in combination with clinical scores in elderly patients with non-high-risk pulmonary embolism (PE). DESIGN Ancillary analysis of a Swiss multicentre prospective cohort study. SUBJECTS A total of 230 patients aged ≥65 years with non-high-risk PE. MAIN OUTCOME MEASURES The study end-point was a composite of PE-related complications, defined as PE-related death, recurrent venous thromboembolism or major bleeding during a follow-up of 30 days. The prognostic accuracy of the Pulmonary Embolism Severity Index (PESI), the Geneva Prognostic Score (GPS), the precursor of brain natriuretic peptide (NT-proBNP) and high-sensitivity cardiac troponin T (hs-cTnT) was determined using sensitivity, specificity, predictive values, receiver operating characteristic (ROC) curve analysis, logistic regression and reclassification statistics. RESULTS The overall complication rate during follow-up was 8.7%. hs-cTnT achieved the highest prognostic accuracy [area under the ROC curve: 0.75, 95% confidence interval (CI): 0.63-0.86, P < 0.001). At the predefined cut-off values, the negative predictive values of the biomarkers were above 95%. For levels above the cut-off, the risk of complications increased fivefold for hs-cTnT [odds ratio (OR): 5.22, 95% CI: 1.49-18.25] and 14-fold for NT-proBNP (OR: 14.21, 95% CI: 1.73-116.93) after adjustment for both clinical scores and renal function. Reclassification statistics indicated that adding hs-cTnT to the GPS or the PESI significantly improved the prognostic accuracy of both clinical scores. CONCLUSION In elderly patients with nonmassive PE, NT-proBNP or hs-cTnT could be an adequate alternative to clinical scores for identifying low-risk individuals suitable for outpatient management.

Comparative assessment of ELISAs using recombinant saposin-like protein 2 and recombinant cathepsin L-1 from Fasciola hepatica for the serodiagnosis of human Fasciolosis.

Two recombinant Fasciola hepatica antigens, saposin-like protein-2 (recSAP2) and cathepsin L-1 (recCL1), were assessed individually and in combination in enzyme-linked immunosorbent assays (ELISA) for the specific serodiagnosis of human fasciolosis in areas of low endemicity as encountered in Central Europe. Antibody detection was conducted using ProteinA/ProteinG (PAG) conjugated to alkaline phosphatase. Test characteristics as well as agreement with results from an ELISA using excretory-secretory products (FhES) from adult stage liver flukes was assessed by receiver operator characteristic (ROC) analysis, specificity, sensitivity, Youdens J and overall accuracy. Cross-reactivity was assessed using three different groups of serum samples from healthy individuals (n=20), patients with other parasitic infections (n=87) and patients with malignancies (n=121). The best combined diagnostic results for recombinant antigens were obtained using the recSAP2-ELISA (87% sensitivity, 99% specificity and 97% overall accuracy) employing the threshold (cut-off) to discriminate between positive and negative reactions that maximized Youdens J. The findings showed that recSAP2-ELISA can be used for the routine serodiagnosis of chronic fasciolosis in clinical laboratories; the use of the PAG-conjugate offers the opportunity to employ, for example, rabbit hyperimmune serum for the standardization of positive controls.

Diagnostic validity of clinical signs associated with a large exophoria at near

Purpose. To analyze the diagnostic validity of accommodative and binocular tests in a sample of patients with a large near exophoria with moderate to severe symptoms. Methods. Two groups of patients between 19 and 35 years were recruited from a university clinic: 33 subjects with large exophoria at near vision and moderate or high visual discomfort and 33 patients with normal heterophoria and low visual discomfort. Visual discomfort was defined using the Conlon survey. A refractive exam and an exhaustive evaluation of accommodation and vergence were assessed. Diagnostic validity by means of receiver operator characteristic (ROC) curves, sensitivity (S), specificity (Sp), and positive and negative likelihood ratios (LR+, LR−) were assessed. This analysis was also carried out considering multiple tests as serial testing strategy. Results. ROC analysis showed the best diagnostic accuracy for receded near point of convergence (NPC) recovery (area = 0.929) and binocular accommodative facility (BAF) (area = 0.886). Using the cut-offs obtained with ROC analysis, the best diagnostic validity was obtained for the combination of NPC recovery and BAF (S  =  0.77, Sp = 1, LR+ = value tending to infinity, LR− = 0.23) and the combination of NPC break and recovery with BAF (S  =  0.73, Sp = 1, LR+ = tending to infinity, LR− = 0.27). Conclusions. NPC and BAF tests were the tests with the best diagnostic accuracy for subjects with large near exophoria and moderate to severe symptoms.

Correlation Between Sonographic and In Vivo Measurement of A1 Pulleys in Trigger Fingers

The thickness of 210 A1 pulleys of 21 male and female healthy volunteers in two different age groups (20-35 y and 50-70 y) were measured by ultrasound. In a second group, the thickness of 15 diseased A1 pulleys and 15 A1 pulleys of the corresponding other hand of 10 patients with the clinical diagnosis of trigger finger were measured by ultrasound. During open trigger finger release, a strip of A1 pulley was excised and immediately measured using an electronic caliper. The average pulley thickness of healthy volunteers was 0.43-0.47 mm, compared to 0.77-0.79 mm in patients with trigger finger. Based on the receiver operating characteristic (ROC) curve, a diagnostic cut-off value of the pulley thickness at 0.62 mm was defined in order to differ a trigger finger from a healthy finger (sensitivity and specificity of 85%). The correlation between sonographic and effective intra-operative measurements of pulley thickness was linear and very strong (Pearson coefficient 0.86-0.90). In order to distinguish between healthy and diseased A1 pulleys, 0.62 mm is a simple value to use, which can be applied regardless of age, sex, body mass index (BMI) and height in adults.

Mean arterial pressure and vasopressor load after out-of-hospital cardiac arrest: Associations with one-year neurologic outcome

THE AIM OF THE STUDY There are limited data on blood pressure targets and vasopressor use following cardiac arrest. We hypothesized that hypotension and high vasopressor load are associated with poor neurological outcome following out-of-hospital cardiac arrest (OHCA). METHODS We included 412 patients with OHCA included in FINNRESUSCI study conducted between 2010 and 2011. Hemodynamic data and vasopressor doses were collected electronically in one, two or five minute intervals. We evaluated thresholds for time-weighted (TW) mean arterial pressure (MAP) and outcome by receiver operating characteristic (ROC) curve analysis, and used multivariable analysis adjusting for co-morbidities, factors at resuscitation, an illness severity score, TW MAP and total vasopressor load (VL) to test associations with one-year neurologic outcome, dichotomized into either good (1-2) or poor (3-5) according to the cerebral performance category scale. RESULTS Of 412 patients, 169 patients had good and 243 patients had poor one-year outcomes. The lowest MAP during the first six hours was 58 (inter-quartile range [IQR] 56-61) mmHg in those with a poor outcome and 61 (59-63) mmHg in those with a good outcome (p<0.01), and lowest MAP was independently associated with poor outcome (OR 1.02 per mmHg, 95% CI 1.00-1.04, p=0.03). During the first 48h the median (IQR) of the TW mean MAP was 80 (78-82) mmHg in patients with poor, and 82 (81-83) mmHg in those with good outcomes (p=0.03) but in multivariable analysis TWA MAP was not associated with outcome. Vasopressor load did not predict one-year neurologic outcome. CONCLUSIONS Hypotension occurring during the first six hours after cardiac arrest is an independent predictor of poor one-year neurologic outcome. High vasopressor load was not associated with poor outcome and further randomized trials are needed to define optimal MAP targets in OHCA patients.

Free mycophenolic acid should be monitored in renal transplant recipients with hypoalbuminemia

The current approach for therapeutic drug monitoring in renal transplant recipients receiving mycophenolate mofetil (MMF) is measurement of total mycophenolic acid (MPA) concentration. Because MPA is highly bound, during hypoalbuminemia the total concentration no longer reflects the free (pharmacologically active) concentration. The authors investigated what degree of hypoalbuminemia causes a significant change in protein binding and thus percentage free MPA. Forty-two renal transplant recipients were recruited for the study. Free and total concentrations of MPA (predose, and 1, 3, and 6 hours post-MMF dose samples) and plasma albumin concentrations were determined on day 5 posttransplantation. Six-hour area under the concentration-time curve (AUC(0-6)) values were calculated for free and total MPA, and percentage free MPA was determined for each patient. The authors found a significant relationship between low albumin concentrations and increased percentage free MPA (Spearman correlation = -0.54, P < 0.0001). Receiver operating characteristic (ROC) curve analysis was performed on the albumin versus percentage free MPA data. The cutoff value of albumin determined from the ROC analysis that differentiated normal from elevated percentage free MPA (defined as greater than or equal to3%) in this patient population was 31 g/L. At this cutoff value albumin was found to be a good predictor of altered free MPA percentage, with a sensitivity and specificity of 0.75 and 0.80, respectively, and an area under the ROC curve of 0.79. To rationalize MMF dosing regimens in hypoalbuminemic patients (plasma albumin less than or equal to 31 g/L), clinicians should consider monitoring the free MPA concentration.

A Test of Performance of Breast MRI Interpretation in a Multicentre Screening Study

Objectives: The aim of this study was to assess the consistency and performance of radiologists interpreting breast magnetic resonance imaging (MRI) examinations. Materials and Methods: Two test sets of eight cases comprising cancers, benign disease, technical problems and parenchymal enhancement were prepared from two manufacturers' equipment (X and Y) and reported by 15 radiologists using the recording form and scoring system of the UK MRI breast screening study [(MAgnetic Resonance Imaging in Breast Screening (MARIBS)]. Variations in assessments of morphology, kinetic scores and diagnosis were measured by assessing intraobserver and interobserver variability and agreement. The sensitivity and specificity of reporting performances was determined using receiver operating characteristic (ROC) curve analysis. Results: Intraobserver variation was seen in 13 (27.7%) of 47 of the radiologists' conclusions (four technical and seven pathological differences). Substantial interobserver variation was observed in the scores recorded for morphology, pattern of enhancement, quantification of enhancement and washout pattern. The overall sensitivity of breast MRI was high [88.6%, 95% confidence interval (CI) 77.4-94.7%], combined with a specificity of 69.2% (95% CI 60.5-76.7%). The sensitivities were similar for the two test sets (P=.3), but the specificity was significantly higher for the Manufacturer X dataset (P

Application and evaluation of classification trees for screening unwanted plants

Risk assessment systems for introduced species are being developed and applied globally, but methods for rigorously evaluating them are still in their infancy. We explore classification and regression tree models as an alternative to the current Australian Weed Risk Assessment system, and demonstrate how the performance of screening tests for unwanted alien species may be quantitatively compared using receiver operating characteristic (ROC) curve analysis. The optimal classification tree model for predicting weediness included just four out of a possible 44 attributes of introduced plants examined, namely: (i) intentional human dispersal of propagules; (ii) evidence of naturalization beyond native range; (iii) evidence of being a weed elsewhere; and (iv) a high level of domestication. Intentional human dispersal of propagules in combination with evidence of naturalization beyond a plants native range led to the strongest prediction of weediness. A high level of domestication in combination with no evidence of naturalization mitigated the likelihood of an introduced plant becoming a weed resulting from intentional human dispersal of propagules. Unlikely intentional human dispersal of propagules combined with no evidence of being a weed elsewhere led to the lowest predicted probability of weediness. The failure to include intrinsic plant attributes in the model suggests that either these attributes are not useful general predictors of weediness, or data and analysis were inadequate to elucidate the underlying relationship(s). This concurs with the historical pessimism that we will ever be able to accurately predict invasive plants. Given the apparent importance of propagule pressure (the number of individuals of an species released), future attempts at evaluating screening model performance for identifying unwanted plants need to account for propagule pressure when collating and/or analysing datasets. The classification tree had a cross-validated sensitivity of 93.6% and specificity of 36.7%. Based on the area under the ROC curve, the performance of the classification tree in correctly classifying plants as weeds or non-weeds was slightly inferior (Area under ROC curve = 0.83 +/- 0.021 (+/- SE)) to that of the current risk assessment system in use (Area under ROC curve = 0.89 +/- 0.018 (+/- SE)), although requires many fewer questions to be answered.

Predictive validity of three ActiGraph energy expenditure equations for children

Purpose: This Study evaluated the predictive validity of three previously published ActiGraph energy expenditure (EE) prediction equations developed for children and adolescents. Methods: A total of 45 healthy children and adolescents (mean age: 13.7 +/- 2.6 yr) completed four 5-min activity trials (normal walking. brisk walking, easy running, and fast running) in ail indoor exercise facility. During each trial, participants were all ActiGraph accelerometer oil the right hip. EE was monitored breath by breath using the Cosmed K4b(2) portable indirect calorimetry system. Differences and associations between measured and predicted EE were assessed using dependent t-tests and Pearson correlations, respectively. Classification accuracy was assessed using percent agreement, sensitivity, specificity, and area under the receiver operating characteristic (ROC) curve, Results: None of the equations accurately predicted mean energy expenditure during each of the four activity trials. Each equation, however, accurately predicted mean EE in at least one activity trial. The Puyau equation accurately predicted EE during slow walking. The Trost equation accurately predicted EE during slow running. The Freedson equation accurately predicted EE during fast running. None of the three equations accurately predicted EE during brisk walking. The equations exhibited fair to excellent classification accuracy with respect to activity intensity. with the Trost equation exhibiting the highest classification accuracy and the Puyau equation exhibiting the lowest. Conclusions: These data suggest that the three accelerometer prediction equations do not accurately predict EE on a minute-by-minute basis in children and adolescents during overground walking and running. The equations maybe, however, for estimating participation in moderate and vigorous activity.

Prediction of HLA-DQ3.2 beta ligands: evidence of multiple registers in class II binding peptides

Motivation: While processing of MHC class II antigens for presentation to helper T-cells is essential for normal immune response, it is also implicated in the pathogenesis of autoimmune disorders and hypersensitivity reactions. Sequence-based computational techniques for predicting HLA-DQ binding peptides have encountered limited success, with few prediction techniques developed using three-dimensional models. Methods: We describe a structure-based prediction model for modeling peptide-DQ3.2 beta complexes. We have developed a rapid and accurate protocol for docking candidate peptides into the DQ3.2 beta receptor and a scoring function to discriminate binders from the background. The scoring function was rigorously trained, tested and validated using experimentally verified DQ3.2 beta binding and non-binding peptides obtained from biochemical and functional studies. Results: Our model predicts DQ3.2 beta binding peptides with high accuracy [area under the receiver operating characteristic (ROC) curve A(ROC) > 0.90], compared with experimental data. We investigated the binding patterns of DQ3.2 beta peptides and illustrate that several registers exist within a candidate binding peptide. Further analysis reveals that peptides with multiple registers occur predominantly for high-affinity binders.

Development of a questionnaire to assess the relative subjective benefits of presbyopia correction

Purpose To develop a standardized questionnaire of near visual function and satisfaction to complement visual function evaluations of presbyopic corrections. Setting Eye Clinic, School of Life and Health Sciences, Aston University, Midland Eye Institute and Solihull Hospital, Birmingham, United Kingdom. Design Questionnaire development. Methods A preliminary 26-item questionnaire of previously used near visual function items was completed by patients with monofocal intraocular lenses (IOLs), multifocal IOLs, accommodating IOLs, multifocal contact lenses, or varifocal spectacles. Rasch analysis was used for item reduction, after which internal and test–retest reliabilities were determined. Construct validity was determined by correlating the resulting Near Activity Visual Questionnaire (NAVQ) scores with near visual acuity and critical print size (CPS), which was measured using the Minnesota Low Vision Reading Test chart. Discrimination ability was assessed through receiver-operating characteristic (ROC) curve analysis. Results One hundred fifty patients completed the questionnaire. Item reduction resulted in a 10-item NAVQ with excellent separation (2.92), internal consistency (Cronbach a = 0.95), and test–retest reliability (intraclass correlation coefficient = 0.72). Correlations of questionnaire scores with near visual acuity (r = 0.32) and CPS (r = 0.27) provided evidence of validity, and discrimination ability was excellent (area under ROC curve = 0.91). Conclusion Results show the NAVQ is a reliable, valid instrument that can be incorporated into the evaluation of presbyopic corrections.

Development of a near activity visual questionnaire to assess accommodating intraocular lenses

Purpose: To develop a questionnaire that subjectively assesses near visual function in patients with 'accommodating' intraocular lenses (IOLs). Methods: A literature search of existing vision-related quality-of-life instruments identified all questions relating to near visual tasks. Questions were combined if repeated in multiple instruments. Further relevant questions were added and item interpretation confirmed through multidisciplinary consultation and focus groups. A preliminary 19-item questionnaire was presented to 22 subjects at their 4-week visit post first eye phacoemulsification with 'accommodative' IOL implantation, and again 6 and 12 weeks post-operatively. Rasch Analysis, Frequency of Endorsement, and tests of normality (skew and kurtosis) were used to reduce the instrument. Cronbach's alpha and test-retest reliability (intraclass correlation coefficient, ICC) were determined for the final questionnaire. Construct validity was obtained by Pearson's product moment correlation (PPMC) of questionnaire scores to reading acuity (RA) and to Critical Print Size (CPS) reading speed. Criterion validity was obtained by receiver operating characteristic (ROC) curve analysis and dimensionality of the questionnaire was assessed by factor analysis. Results: Rasch Analysis eliminated nine items due to poor fit statistics. The final items have good separation (2.55), internal consistency (Cronbach's α = 0.97) and test-retest reliability (ICC = 0.66). PPMC of questionnaire scores with RA was 0.33, and with CPS reading speed was 0.08. Area under the ROC curve was 0.88 and Factor Analysis revealed one principal factor. Conclusion: The pilot data indicates the questionnaire to be internally consistent, reliable and a valid instrument that could be useful for assessing near visual function in patients with 'accommodating' IOLS. The questionnaire will now be expanded to include other types of presbyopic correction. © 2007 British Contact Lens Association.

Optimising the diagnostic performance of the Geriatric Depression Scale

The aim of this work is to empirically generate a shortened version of the Geriatric Depression Scale (GDS), with the intention of maximising the diagnostic performance in the detection of depression compared with previously GDS validated versions, while optimizing the size of the instrument. A total of 233 individuals (128 from a Day Hospital, 105 randomly selected from the community) aged 60 or over completed the GDS and other measures. The 30 GDS items were entered in the Day Hospital sample as independent variables in a stepwise logistic regression analysis predicting diagnosis of Major Depression. A final solution of 10 items was retained, which correctly classified 97.4% of cases. The diagnostic performance of these 10 GDS items was analysed in the random sample with a receiver operating characteristic (ROC) curve. Sensitivity (100%), specificity (97.2%), positive (81.8%) and negative (100%) predictive power, and the area under the curve (0.994) were comparable with values for GDS-30 and higher compared with GDS-15, GDS-10 and GDS-5. In addition, the new scale proposed had excellent fit when testing its unidimensionality with CFA for categorical outcomes (e.g., CFI=0.99). The 10-item version of the GDS proposed here, the GDS-R, seems to retain the diagnostic performance for detecting depression in older adults of the GDS-30 items, while increasing the sensitivity and predictive values relative to other shortened versions.

A digital signal processing approach for affective sensing of a computer user through pupil diameter monitoring

Recent research has indicated that the pupil diameter (PD) in humans varies with their affective states. However, this signal has not been fully investigated for affective sensing purposes in human-computer interaction systems. This may be due to the dominant separate effect of the pupillary light reflex (PLR), which shrinks the pupil when light intensity increases. In this dissertation, an adaptive interference canceller (AIC) system using the H∞ time-varying (HITV) adaptive algorithm was developed to minimize the impact of the PLR on the measured pupil diameter signal. The modified pupil diameter (MPD) signal, obtained from the AIC was expected to reflect primarily the pupillary affective responses (PAR) of the subject. Additional manipulations of the AIC output resulted in a processed MPD (PMPD) signal, from which a classification feature, PMPDmean, was extracted. This feature was used to train and test a support vector machine (SVM), for the identification of stress states in the subject from whom the pupil diameter signal was recorded, achieving an accuracy rate of 77.78%. The advantages of affective recognition through the PD signal were verified by comparatively investigating the classification of stress and relaxation states through features derived from the simultaneously recorded galvanic skin response (GSR) and blood volume pulse (BVP) signals, with and without the PD feature. The discriminating potential of each individual feature extracted from GSR, BVP and PD was studied by analysis of its receiver operating characteristic (ROC) curve. The ROC curve found for the PMPDmean feature encompassed the largest area (0.8546) of all the single-feature ROCs investigated. The encouraging results seen in affective sensing based on pupil diameter monitoring were obtained in spite of intermittent illumination increases purposely introduced during the experiments. Therefore, these results confirmed the benefits of using the AIC implementation with the HITV adaptive algorithm to isolate the PAR and the potential of using PD monitoring to sense the evolving affective states of a computer user.