A nonparametric method of comparing the partial areas under two correlated receiver operating characteristic curves

A non-parametric method was developed and tested to compare the partial areas under two correlated Receiver Operating Characteristic curves. Based on the theory of generalized U-statistics the mathematical formulas have been derived for computing ROC area, and the variance and covariance between the portions of two ROC curves. A practical SAS application also has been developed to facilitate the calculations. The accuracy of the non-parametric method was evaluated by comparing it to other methods. By applying our method to the data from a published ROC analysis of CT image, our results are very close to theirs. A hypothetical example was used to demonstrate the effects of two crossed ROC curves. The two ROC areas are the same. However each portion of the area between two ROC curves were found to be significantly different by the partial ROC curve analysis. For computation of ROC curves with large scales, such as a logistic regression model, we applied our method to the breast cancer study with Medicare claims data. It yielded the same ROC area computation as the SAS Logistic procedure. Our method also provides an alternative to the global summary of ROC area comparison by directly comparing the true-positive rates for two regression models and by determining the range of false-positive values where the models differ. ^

Evaluation of non-contact sampling and detection of explosives using receiver operating characteristic curves

The growing need for fast sampling of explosives in high throughput areas has increased the demand for improved technology for the trace detection of illicit compounds. Detection of the volatiles associated with the presence of the illicit compounds offer a different approach for sensitive trace detection of these compounds without increasing the false positive alarm rate. This study evaluated the performance of non-contact sampling and detection systems using statistical analysis through the construction of Receiver Operating Characteristic (ROC) curves in real-world scenarios for the detection of volatiles in the headspace of smokeless powder, used as the model system for generalizing explosives detection. A novel sorbent coated disk coined planar solid phase microextraction (PSPME) was previously used for rapid, non-contact sampling of the headspace containers. The limits of detection for the PSPME coupled to IMS detection was determined to be 0.5-24 ng for vapor sampling of volatile chemical compounds associated with illicit compounds and demonstrated an extraction efficiency of three times greater than other commercially available substrates, retaining >50% of the analyte after 30 minutes sampling of an analyte spike in comparison to a non-detect for the unmodified filters. Both static and dynamic PSPME sampling was used coupled with two ion mobility spectrometer (IMS) detection systems in which 10-500 mg quantities of smokeless powders were detected within 5-10 minutes of static sampling and 1 minute of dynamic sampling time in 1-45 L closed systems, resulting in faster sampling and analysis times in comparison to conventional solid phase microextraction-gas chromatography-mass spectrometry (SPME-GC-MS) analysis. Similar real-world scenarios were sampled in low and high clutter environments with zero false positive rates. Excellent PSPME-IMS detection of the volatile analytes were visualized from the ROC curves, resulting with areas under the curves (AUC) of 0.85-1.0 and 0.81-1.0 for portable and bench-top IMS systems, respectively. Construction of ROC curves were also developed for SPME-GC-MS resulting with AUC of 0.95-1.0, comparable with PSPME-IMS detection. The PSPME-IMS technique provides less false positive results for non-contact vapor sampling, cutting the cost and providing an effective sampling and detection needed in high-throughput scenarios, resulting in similar performance in comparison to well-established techniques with the added advantage of fast detection in the field.

Association Rule Sharing Model for Privacy Preservation and Collaborative Data Mining Efficiency

The disclosure of information and its misuse in Privacy Preserving Data Mining (PPDM) systems is a concern to the parties involved. In PPDM systems data is available amongst multiple parties collaborating to achieve cumulative mining accuracy. The vertically partitioned data available with the parties involved cannot provide accurate mining results when compared to the collaborative mining results. To overcome the privacy issue in data disclosure this paper describes a Key Distribution-Less Privacy Preserving Data Mining (KDLPPDM) system in which the publication of local association rules generated by the parties is published. The association rules are securely combined to form the combined rule set using the Commutative RSA algorithm. The combined rule sets established are used to classify or mine the data. The results discussed in this paper compare the accuracy of the rules generated using the C4. 5 based KDLPPDM system and the CS. 0 based KDLPPDM system using receiver operating characteristics curves (ROC).

Classification of masses in mammographic image using wavelet domain features and polynomial classifier

Breast cancer is the most common cancer among women. In CAD systems, several studies have investigated the use of wavelet transform as a multiresolution analysis tool for texture analysis and could be interpreted as inputs to a classifier. In classification, polynomial classifier has been used due to the advantages of providing only one model for optimal separation of classes and to consider this as the solution of the problem. In this paper, a system is proposed for texture analysis and classification of lesions in mammographic images. Multiresolution analysis features were extracted from the region of interest of a given image. These features were computed based on three different wavelet functions, Daubechies 8, Symlet 8 and bi-orthogonal 3.7. For classification, we used the polynomial classification algorithm to define the mammogram images as normal or abnormal. We also made a comparison with other artificial intelligence algorithms (Decision Tree, SVM, K-NN). A Receiver Operating Characteristics (ROC) curve is used to evaluate the performance of the proposed system. Our system is evaluated using 360 digitized mammograms from DDSM database and the result shows that the algorithm has an area under the ROC curve Az of 0.98 ± 0.03. The performance of the polynomial classifier has proved to be better in comparison to other classification algorithms. © 2013 Elsevier Ltd. All rights reserved.

Accuracy of Timed Up and Go Test for screening risk of falls among community-dwelling elderly

Objective: To determine the accuracy of the Timed Up and Go Test (TUGT) for screening the risk of falls among community-dwelling elderly individuals. Method: This is a prospective cohort study with a randomly by lots without reposition sample stratified by proportional partition in relation to gender involving 63 community-dwelling elderly individuals. Elderly individuals who reported having Parkinson's disease, a history of transitory ischemic attack, stroke and with a Mini Mental State Exam lower than the expected for the education level, were on a wheelchair and that reported a single fall in the previous six months were excluded. The TUGT, a mobility test, was the measure of interested and the occurrence of falls was the outcome. The performance of basic activities of daily living (ADL) and instrumental activities of daily living (IADL) was determined through the Older American Resources and Services, and the socio-demographic and clinical data were determined through the use of additional questionnaires. Receiver Operating Characteristic Curves were used to analyze the sensitivity and specificity of the TUGT. Results: Elderly individuals who fell had greater difficulties in ADL and IADL (p<0.01) and a slower performance on the TUGT (p=0.02). No differences were found in socio-demographic and clinical characteristics between fallers and non- fallers. Considering the different sensitivity and specificity, the best predictive value for discriminating elderly individuals who fell was 12.47 seconds [(RR= 3.2) 95% CI: 1.3- 7.7]. Conclusions: The TUGT proved to be an accurate measure for screening the risk of falls among elderly individuals. Although different from that reported in the international literature, the 12.47 second cutoff point seems to be a better predictive value for Brazilian elderly individuals.

Triceps and subscapular skinfold thicknesses percentiles and cut-offs for overweight and obesity in a population-based sample of schoolchildren in Bogota, Colombia

OBJECTIVES: The aims of this study were to establish a Colombian smoothed centile charts and LMS tables for tríceps, subscapular and sum tríceps+subscapular skinfolds; appropriate cut-offs were selected using receiver operating characteristic analysis based in a populationbased sample of schoolchildren in Bogota, Colombia and to compare them with international studies. METHODS: A total of 9 618 children and adolescents attending public schools in Bogota, Colombia (55.7% girls; age range of 9–17.9 years). Height, weight, body mass index (BMI), waist circumference, triceps and subscapular skinfold measurements were obtained using standardized methods. We have calculated tríceps+subscapular skinfold (T+SS) sum. Smoothed percentile curves for triceps and subscapular skinfold thickness were derived by the LMS method. Receiver operating characteristics curve (ROC) analyses were used to evaluate the optimal cut-off point of tríceps, subscapular and sum tríceps+subscapular skinfolds for overweight and obesity based on the International Obesity Task Force (IOTF) definitions. Data were compared with international studies. RESULTS: Subscapular, triceps skinfolds and T+SS were significantly higher in girls than in boys (P <0.001). The median values for triceps, subscapular as well as T+SS skinfold thickness increased in a sex-specific pattern with age. The ROC analysis showed that subscapular, triceps skinfolds and T+SS have a high discrimination power in the identification of overweight and obesity in the sample population in this study. Based on the raw non-adjusted data, we found that Colombian boys and girls had high triceps and subscapular skinfolds values than their counterparts from Spain, UK, German and US. CONCLUSIONS: Our results provide sex- and age-specific normative reference standards for the triceps and subscapular skinfold thickness values in a large, population-based sample of 3 schoolchildren and adolescents from an Latin-American population. By providing LMS tables for Latin-American people based on Colombian reference data, we hope to provide quantitative tools for the study of obesity and its complications.

Patient-Generated Subjective Global Assessment Short Form (PG-SGA SF) is a valid screening tool in chemotherapy outpatients

Purpose In the oncology population where malnutrition prevalence is high, more descriptive screening tools can provide further information to assist triaging and capture acute change. The Patient-Generated Subjective Global Assessment Short Form (PG-SGA SF) is a component of a nutritional assessment tool which could be used for descriptive nutrition screening. The purpose of this study was to conduct a secondary analysis of nutrition screening and assessment data to identify the most relevant information contributing to the PG-SGA SF to identify malnutrition risk with high sensitivity and specificity. Methods This was an observational, cross-sectional study of 300 consecutive adult patients receiving ambulatory anti-cancer treatment at an Australian tertiary hospital. Anthropometric and patient descriptive data were collected. The scored PG-SGA generated a score for nutritional risk (PG-SGA SF) and a global rating for nutrition status. Receiver operating characteristic curves (ROC) were generated to determine optimal cut-off scores for combinations of the PG-SGA SF boxes with the greatest sensitivity and specificity for predicting malnutrition according to scored PG-SGA global rating. Results The additive scores of boxes 1–3 had the highest sensitivity (90.2 %) while maintaining satisfactory specificity (67.5 %) and demonstrating high diagnostic value (AUC = 0.85, 95 % CI = 0.81–0.89). The inclusion of box 4 (PG-SGA SF) did not add further value as a screening tool (AUC = 0.85, 95 % CI = 0.80–0.89; sensitivity 80.4 %; specificity 72.3 %). Conclusions The validity of the PG-SGA SF in chemotherapy outpatients was confirmed. The present study however demonstrated that the functional capacity question (box 4) does not improve the overall discriminatory value of the PG-SGA SF.

Prediction and probability of neonatal outcome in isolated congenital diaphragmatic hernia using multiple ultrasound parameters

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Prediction and probability of neonatal outcome in isolated congenital diaphragmatic hernia using multiple ultrasound parameters

Objectives To evaluate the accuracy and probabilities of different fetal ultrasound parameters to predict neonatal outcome in isolated congenital diaphragmatic hernia (CDH). Methods Between January 2004 and December 2010, we evaluated prospectively 108 fetuses with isolated CDH (82 left-sided and 26 right-sided). The following parameters were evaluated: gestational age at diagnosis, side of the diaphragmatic defect, presence of polyhydramnios, presence of liver herniated into the fetal thorax (liver-up), lung-to-head ratio (LHR) and observed/expected LHR (o/e-LHR), observed/expected contralateral and total fetal lung volume (o/e-ContFLV and o/e-TotFLV) ratios, ultrasonographic fetal lung volume/fetal weight ratio (US-FLW), observed/expected contralateral and main pulmonary artery diameter (o/e-ContPA and o/eMPA) ratios and the contralateral vascularization index (Cont-VI). The outcomes were neonatal death and severe postnatal pulmonary arterial hypertension (PAH). Results Neonatal mortality was 64.8% (70/108). Severe PAH was diagnosed in 68 (63.0%) cases, of which 63 died neonatally (92.6%) (P < 0.001). Gestational age at diagnosis, side of the defect and polyhydramnios were not associated with poor outcome (P > 0.05). LHR, o/eLHR, liver-up, o/e-ContFLV, o/e-TotFLV, US-FLW, o/eContPA, o/e-MPA and Cont-VI were associated with both neonatal death and severe postnatal PAH (P < 0.001). Receiver-operating characteristics curves indicated that measuring total lung volumes (o/e-TotFLV and US-FLW) was more accurate than was considering only the contralateral lung sizes (LHR, o/e-LHR and o/e-ContFLV; P < 0.05), and Cont-VI was the most accurate ultrasound parameter to predict neonatal death and severe PAH (P < 0.001). Conclusions Evaluating total lung volumes is more accurate than is measuring only the contralateral lung size. Evaluating pulmonary vascularization (Cont-VI) is the most accurate predictor of neonatal outcome. Estimating the probability of survival and severe PAH allows classification of cases according to prognosis. Copyright (C) 2011 ISUOG. Published by John Wiley & Sons, Ltd.

A simple presurgical necrotizing enterocolitis-mortality scoring system

OBJECTIVE: To assess the relationship between early laboratory parameters, disease severity, type of management (surgical or conservative) and outcome in necrotizing enterocolitis (NEC). STUDY DESIGN: Retrospective collection and analysis of data from infants treated in a single tertiary care center (1980 to 2002). Data were collected on disease severity (Bell stage), birth weight (BW), gestational age (GA) and pre-intervention laboratory parameters (leukocyte and platelet counts, hemoglobin, lactate, C-reactive protein). RESULTS: Data from 128 infants were sufficient for analysis. Factors significantly associated with survival were Bell stage (P<0.05), lactate (P<0.05), BW and GA (P<0.01, P<0.001, respectively). From receiver operating characteristics curves, the highest predictive value resulted from a score with 0 to 8 points combining BW, Bell stage, lactate and platelet count (P<0.001). At a cutoff level of 4.5 sensitivity and specificity for predicting survival were 0.71 and 0.72, respectively. CONCLUSION: Some single parameters were associated with poor outcome in NEC. Optimal risk stratification was achieved by combining several parameters in a score.

Effects of dose reduction on the detectability of standardized radiolucent lesions in digital panoramic radiography

Dose reduction in digital panoramic radiography was studied. Intentional underexposure was performed with the Orthophos DS while six different human mandibles were radiographed. Exposure settings were 69 kV/15 mA (standard), 64 kV/16 mA, and 60 kV/16 mA. Standardized spherical defects, each either 1 or 1.25 mm in diameter, were simulated in 288 of 432 images, and seven observers decided whether defects were present or not. Areas under the receiver operating characteristics curves were calculated. They showed no significant differences in the detectability of the 1-mm defect at 69, 64, or 60 kV. For the 1.25-mm defect, no difference was found between the 69 and 60 kV images, but a statistically significant different detectability was found for 64 kV images in comparison with both 69 and 60 kV images. A dose reduction of up to 43% was ascertained with a Pedo-RT-Humanoid phantom when panoramic radiography was performed at 60 kV/16 mA. The conclusion is that with the Orthophos DS, it seems possible to reduce the dose rate of x-rays without loss of diagnostic quality in the case of radiolucent changes.

Added value of dual-energy computed tomography versus single-energy computed tomography in assessing ferromagnetic properties of ballistic projectiles: implications for magnetic resonance imaging of gunshot victims.

OBJECTIVE The objective of this study was to assess the discriminative power of dual-energy computed tomography (DECT) versus single-energy CT (SECT) to distinguish between ferromagnetic and non-ferromagnetic ballistic projectiles to improve safety regarding magnetic resonance (MR) imaging studies in patients with retained projectiles. MATERIALS AND METHODS Twenty-seven ballistic projectiles including 25 bullets (diameter, 3-15 mm) and 2 shotgun pellets (2 mm each) were examined in an anthropomorphic chest phantom using 128-section dual-source CT. Data acquisition was performed with tube voltages set at 80, 100, 120, and 140 kV(p). Two readers independently assessed CT numbers of the projectile's core on images reconstructed with an extended CT scale. Dual-energy indices (DEIs) were calculated from both 80-/140-kV(p) and 100-/140-kV(p) pairs; receiver operating characteristics curves were fitted to assess ferromagnetic properties by means of CT numbers and DEI. RESULTS Nine (33%) of the projectiles were ferromagnetic; 18 were nonferromagnetic (67%). Interreader and intrareader correlations of CT number measurements were excellent (intraclass correlation coefficients, >0.906; P<0.001). The DEI calculated from both 80/140 and 100/140 kV(p) were significantly (P<0.05) different between the ferromagnetic and non-ferromagnetic projectiles. The area under the curve (AUC) was 0.75 and 0.8 for the tube voltage pairs of 80/140 and 100/140 kV(p) (P<0.05; 95% confidence interval, 0.57-0.94 and 0.62-0.97, respectively) to differentiate between the ferromagnetic and non-ferromagnetic ballistic projectiles; which increased to 0.83 and 0.85 when shotgun pellets were excluded from the analysis. The AUC for SECT was 0.69 and 0.73 (80 and 100 kV[p], respectively). CONCLUSIONS Measurements of DECT combined with an extended CT scale allow for the discrimination of projectiles with non-ferromagnetic from those with ferromagnetic properties in an anthropomorphic chest phantom with a higher AUC compared with SECT. This study indicates that DECT may have the potential to contribute to MR safety and allow for MR imaging of patients with retained projectiles. However, further studies are necessary before this concept may be used to triage clinical patients before MR.

External validation study of a clinical prediction rule for ambulation outcomes after traumatic spinal cord injury

The main objective of this study was to determine the external validity of a clinical prediction rule developed by the European Multicenter Study on Human Spinal Cord Injury (EM-SCI) to predict the ambulation outcomes 12 months after traumatic spinal cord injury. Data from the North American Clinical Trials Network (NACTN) data registry with approximately 500 SCI cases were used for this validity study. The predictive accuracy of the EM-SCI prognostic model was evaluated using calibration and discrimination based on 231 NACTN cases. The area under the receiver-operating-characteristics curve (ROC) curve was 0.927 (95% CI 0.894 – 0.959) for the EM-SCI model when applied to NACTN population. This is lower than the AUC of 0.956 (95% CI 0.936 – 0.976) reported for the EM-SCI population, but suggests that the EM-SCI clinical prediction rule distinguished well between those patients in the NACTN population who were able to achieve independent ambulation and those who did not achieve independent ambulation. The calibration curve suggests that higher the prediction score is, the better the probability of walking with the best prediction for AIS D patients. In conclusion, the EM-SCI clinical prediction rule was determined to be generalizable to the adult NACTN SCI population.^

Threshold values of sagittal abdominal diameter for the detection of cardio-metabolic risk factors in Northeastern Mexico: a cross-sectional study

Background: The use of sagittal abdominal diameter (SAD) has been proposed for screening cardio-metabolic risk factors; however, its accuracy can be influenced by the choice of thresholds values. Aim: To determine the SAD threshold values for cardio-metabolic risk factors in Mexican adults; to assess whether parallel and serial SAD testing can improve waist circumference (WC) sensitivity and specificity; and to analyze the effect of considering SAD along with WC and body mass index (BMI) in detecting cardio-metabolic risk. Methods: This cross-sectional study was conducted during 2012-2014 in Northeast Mexico (n = 269). Data on anthropometric, clinical, and biochemical measurements were collected. Sex-adjusted receiver-operating characteristic curves (ROC) were obtained using hypertension, dysglycemia, dyslipidemia and insulin resistance as individual outcomes and metabolic syndrome as a composite outcome. Age-adjusted odds ratios and 95% confidence intervals (CI) were estimated using logistic regression. Results: The threshold value for SAD with acceptable combination of sensitivity and specificity was 24.6 cm in men and 22.5 cm in women. Parallel SAD testing improved WC sensitivity and serial testing improved WC specificity. The co-occurrence of high WC/high SAD increased the risk for insulin resistance by 2.4-fold (95% CI: 1.1-5.3), high BMI/high SAD by 4.3-fold (95% CI: 1.7-11.9) and SAD alone by 2.2-fold (95% CI: 1.2.-4.2). Conclusions: The use of SAD together with traditional obesity indices such as WC and BMI has advantages over using either of these indices alone. SAD may be a powerful screening tool for interventions for high-risk individuals.