Transferability of Regional Permafrost Disturbance Susceptibility Modelling Using Generalized Linear and Generalized Additive Models

To effectively assess and mitigate risk of permafrost disturbance, disturbance-p rone areas can be predicted through the application of susceptibility models. In this study we developed regional susceptibility models for permafrost disturbances using a field disturbance inventory to test the transferability of the model to a broader region in the Canadian High Arctic. Resulting maps of susceptibility were then used to explore the effect of terrain variables on the occurrence of disturbances within this region. To account for a large range of landscape charac- teristics, the model was calibrated using two locations: Sabine Peninsula, Melville Island, NU, and Fosheim Pen- insula, Ellesmere Island, NU. Spatial patterns of disturbance were predicted with a generalized linear model (GLM) and generalized additive model (GAM), each calibrated using disturbed and randomized undisturbed lo- cations from both locations and GIS-derived terrain predictor variables including slope, potential incoming solar radiation, wetness index, topographic position index, elevation, and distance to water. Each model was validated for the Sabine and Fosheim Peninsulas using independent data sets while the transferability of the model to an independent site was assessed at Cape Bounty, Melville Island, NU. The regional GLM and GAM validated well for both calibration sites (Sabine and Fosheim) with the area under the receiver operating curves (AUROC) N 0.79. Both models were applied directly to Cape Bounty without calibration and validated equally with AUROC's of 0.76; however, each model predicted disturbed and undisturbed samples differently. Addition- ally, the sensitivity of the transferred model was assessed using data sets with different sample sizes. Results in- dicated that models based on larger sample sizes transferred more consistently and captured the variability within the terrain attributes in the respective study areas. Terrain attributes associated with the initiation of dis- turbances were similar regardless of the location. Disturbances commonly occurred on slopes between 4 and 15°, below Holocene marine limit, and in areas with low potential incoming solar radiation

Responsiveness and clinical utility of the geriatric self-efficacy index for urinary incontinence

OBJECTIVES: To report on the responsiveness testing and clinical utility of the 12-item Geriatric Self-Efficacy Index for Urinary Incontinence (GSE-UI). DESIGN: Prospective cohort study. SETTING: Six urinary incontinence (UI) outpatient clinics in Quebec, Canada. PARTICIPANTS: Community-dwelling incontinent adults aged 65 and older. MEASUREMENTS: The abridged 12-item GSE-UI, measuring older adults' level of confidence for preventing urine loss, was administered to all new consecutive incontinent patients 1 week before their initial clinic visit, at baseline, and 3 months posttreatment. At follow-up, a positive rating of improvement in UI was ascertained from patients and their physicians using the Patient's and Clinician's Global Impression of Improvement scales, respectively. Responsiveness of the GSE-UI was calculated using Guyatt's change index. Its clinical utility was determined using receiver operating curves. RESULTS: Eighty-nine of 228 eligible patients (39.0%) participated (mean age 72.6+5.8, range 65–90). At 3-month follow-up, 22.5% of patients were very much better, and 41.6% were a little or much better. Guyatt's change index was 2.6 for patients who changed by a clinically meaningful amount and 1.5 for patients having experienced any level of improvement. An improvement of 14 points on the 12-item GSE-UI had a sensitivity of 75.1% and a specificity of 78.2% for detecting clinically meaningful changes in UI status. Mean GSE-UI scores varied according to improvement status (P<.001) and correlated with changes in quality-of-life scores (r=0.7, P<.001) and reductions in UI episodes (r=0.4, P=.004). CONCLUSION: The GSE-UI is responsive and clinically useful.

Responsiveness and clinical utility of the geriatric self-efficacy index for urinary incontinence

OBJECTIVES: To report on the responsiveness testing and clinical utility of the 12-item Geriatric Self-Efficacy Index for Urinary Incontinence (GSE-UI). DESIGN: Prospective cohort study. SETTING: Six urinary incontinence (UI) outpatient clinics in Quebec, Canada. PARTICIPANTS: Community-dwelling incontinent adults aged 65 and older. MEASUREMENTS: The abridged 12-item GSE-UI, measuring older adults' level of confidence for preventing urine loss, was administered to all new consecutive incontinent patients 1 week before their initial clinic visit, at baseline, and 3 months posttreatment. At follow-up, a positive rating of improvement in UI was ascertained from patients and their physicians using the Patient's and Clinician's Global Impression of Improvement scales, respectively. Responsiveness of the GSE-UI was calculated using Guyatt's change index. Its clinical utility was determined using receiver operating curves. RESULTS: Eighty-nine of 228 eligible patients (39.0%) participated (mean age 72.6+5.8, range 65–90). At 3-month follow-up, 22.5% of patients were very much better, and 41.6% were a little or much better. Guyatt's change index was 2.6 for patients who changed by a clinically meaningful amount and 1.5 for patients having experienced any level of improvement. An improvement of 14 points on the 12-item GSE-UI had a sensitivity of 75.1% and a specificity of 78.2% for detecting clinically meaningful changes in UI status. Mean GSE-UI scores varied according to improvement status (P<.001) and correlated with changes in quality-of-life scores (r=0.7, P<.001) and reductions in UI episodes (r=0.4, P=.004). CONCLUSION: The GSE-UI is responsive and clinically useful.

Transferability of Regional Permafrost Disturbance Susceptibility Modelling Using Generalized Linear and Generalized Additive Models

To effectively assess and mitigate risk of permafrost disturbance, disturbance-p rone areas can be predicted through the application of susceptibility models. In this study we developed regional susceptibility models for permafrost disturbances using a field disturbance inventory to test the transferability of the model to a broader region in the Canadian High Arctic. Resulting maps of susceptibility were then used to explore the effect of terrain variables on the occurrence of disturbances within this region. To account for a large range of landscape charac- teristics, the model was calibrated using two locations: Sabine Peninsula, Melville Island, NU, and Fosheim Pen- insula, Ellesmere Island, NU. Spatial patterns of disturbance were predicted with a generalized linear model (GLM) and generalized additive model (GAM), each calibrated using disturbed and randomized undisturbed lo- cations from both locations and GIS-derived terrain predictor variables including slope, potential incoming solar radiation, wetness index, topographic position index, elevation, and distance to water. Each model was validated for the Sabine and Fosheim Peninsulas using independent data sets while the transferability of the model to an independent site was assessed at Cape Bounty, Melville Island, NU. The regional GLM and GAM validated well for both calibration sites (Sabine and Fosheim) with the area under the receiver operating curves (AUROC) N 0.79. Both models were applied directly to Cape Bounty without calibration and validated equally with AUROC's of 0.76; however, each model predicted disturbed and undisturbed samples differently. Addition- ally, the sensitivity of the transferred model was assessed using data sets with different sample sizes. Results in- dicated that models based on larger sample sizes transferred more consistently and captured the variability within the terrain attributes in the respective study areas. Terrain attributes associated with the initiation of dis- turbances were similar regardless of the location. Disturbances commonly occurred on slopes between 4 and 15°, below Holocene marine limit, and in areas with low potential incoming solar radiation

Identifying and enhancing risk thresholds in the detection of elder financial abuse: A signal detection analysis of professionals' decision making

Background: Financial abuse of elders is an under acknowledged problem and professionals' judgements contribute to both the prevalence of abuse and the ability to prevent and intervene. In the absence of a definitive "gold standard" for the judgement, it is desirable to try and bring novice professionals' judgemental risk thresholds to the level of competent professionals as quickly and effectively as possible. This study aimed to test if a training intervention was able to bring novices' risk thresholds for financial abuse in line with expert opinion. Methods: A signal detection analysis, within a randomised controlled trial of an educational intervention, was undertaken to examine the effect on the ability of novices to efficiently detect financial abuse. Novices (n = 154) and experts (n = 33) judged "certainty of risk" across 43 scenarios; whether a scenario constituted a case of financial abuse or not was a function of expert opinion. Novices (n = 154) were randomised to receive either an on-line educational intervention to improve financial abuse detection (n = 78) or a control group (no on-line educational intervention, n = 76). Both groups examined 28 scenarios of abuse (11 "signal" scenarios of risk and 17 "noise" scenarios of no risk). After the intervention group had received the on-line training, both groups then examined 15 further scenarios (5 "signal" and 10 "noise" scenarios). Results: Experts were more certain than the novices, pre (Mean 70.61 vs. 58.04) and post intervention (Mean 70.84 vs. 63.04); and more consistent. The intervention group (mean 64.64) were more certain of abuse post-intervention than the control group (mean 61.41, p = 0.02). Signal detection analysis of sensitivity (Á) and bias (C) revealed that this was due to the intervention shifting the novices' tendency towards saying "at risk" (C post intervention -.34) and away from their pre intervention levels of bias (C-.12). Receiver operating curves revealed more efficient judgments in the intervention group. Conclusion: An educational intervention can improve judgements of financial abuse amongst novice professionals.

Precision-recall operating characteristic (P-ROC) curves in imprecise environments

Traditionally, machine learning algorithms have been evaluated in applications where assumptions can be reliably made about class priors and/or misclassification costs. In this paper, we consider the case of imprecise environments, where little may be known about these factors and they may well vary significantly when the system is applied. Specifically, the use of precision-recall analysis is investigated and compared to the more well known performance measures such as error-rate and the receiver operating characteristic (ROC). We argue that while ROC analysis is invariant to variations in class priors, this invariance in fact hides an important factor of the evaluation in imprecise environments. Therefore, we develop a generalised precision-recall analysis methodology in which variation due to prior class probabilities is incorporated into a multi-way analysis of variance (ANOVA). The increased sensitivity and reliability of this approach is demonstrated in a remote sensing application.

Nonparametric estimation of time-dependent ROC curves conditional on a continuous covariate

The receiver-operating characteristic (ROC) curve is the most widely used measure for evaluating the performance of a diagnostic biomarker when predicting a binary disease outcome. The ROC curve displays the true positive rate (or sensitivity) and the false positive rate (or 1-specificity) for different cut-off values used to classify an individual as healthy or diseased. In time-to-event studies, however, the disease status (e.g. death or alive) of an individual is not a fixed characteristic, and it varies along the study. In such cases, when evaluating the performance of the biomarker, several issues should be taken into account: first, the time-dependent nature of the disease status; and second, the presence of incomplete data (e.g. censored data typically present in survival studies). Accordingly, to assess the discrimination power of continuous biomarkers for time-dependent disease outcomes, time-dependent extensions of true positive rate, false positive rate, and ROC curve have been recently proposed. In this work, we present new nonparametric estimators of the cumulative/dynamic time-dependent ROC curve that allow accounting for the possible modifying effect of current or past covariate measures on the discriminatory power of the biomarker. The proposed estimators can accommodate right-censored data, as well as covariate-dependent censoring. The behavior of the estimators proposed in this study will be explored through simulations and illustrated using data from a cohort of patients who suffered from acute coronary syndrome.

ROC Curves within the Framework of Neural Network Assembly Memory Model: Some Analytic Results

On the basis of convolutional (Hamming) version of recent Neural Network Assembly Memory Model (NNAMM) for intact two-layer autoassociative Hopfield network optimal receiver operating characteristics (ROCs) have been derived analytically. A method of taking into account explicitly a priori probabilities of alternative hypotheses on the structure of information initiating memory trace retrieval and modified ROCs (mROCs, a posteriori probabilities of correct recall vs. false alarm probability) are introduced. The comparison of empirical and calculated ROCs (or mROCs) demonstrates that they coincide quantitatively and in this way intensities of cues used in appropriate experiments may be estimated. It has been found that basic ROC properties which are one of experimental findings underpinning dual-process models of recognition memory can be explained within our one-factor NNAMM.

ROC curves of obesity indicators have a predictive value for children hypertension aged 7-17 years

Objective: The aim of the study is to examine the distribution of integrated covariate and its association with blood pressure (BP) among children in Anhui province, China, and assess the predictive value of integrated covariate to children hypertension. Methods: A total of 2,828 subjects (1,588 male and 1,240 female) aged 7-17 years participated in this study. Height, weight, waistline, hipline and BP of all subjects were measured, obesity and overweight were defined by an international standard, specifying the measurement, the reference population, and the age and sex specific cut off points. High BP status was defined as systolic blood pressure (SBP) and/or diastolic blood pressure (DBP) > 95th percentile for age and gender. Results: Our results revealed that the prevalence of children hypertension was 11.03%, the SBP and DBP of obesity group were significantly higher than that of normal group. Anthropometric obesity indices such as body mass index (BMI) were positively correlated with SBP and DBP. Integrated covariate had a better performance than the single covariate in the receiver-operating characteristic (ROC) curve, the cut-off value; the sensitivity and the specificity of the integrated covariate were 0.112, 0.577, 0.683, respectively. Conclusion: Integrated covariate is a simple and effective anthropometric index to identify childhood hypertension.

Sensitivity and specificity of machine learning classifiers for glaucoma diagnosis using Spectral Domain OCT and standard automated perimetry

PURPOSE: To evaluate the sensitivity and specificity of machine learning classifiers (MLCs) for glaucoma diagnosis using Spectral Domain OCT (SD-OCT) and standard automated perimetry (SAP). METHODS: Observational cross-sectional study. Sixty two glaucoma patients and 48 healthy individuals were included. All patients underwent a complete ophthalmologic examination, achromatic standard automated perimetry (SAP) and retinal nerve fiber layer (RNFL) imaging with SD-OCT (Cirrus HD-OCT; Carl Zeiss Meditec Inc., Dublin, California). Receiver operating characteristic (ROC) curves were obtained for all SD-OCT parameters and global indices of SAP. Subsequently, the following MLCs were tested using parameters from the SD-OCT and SAP: Bagging (BAG), Naive-Bayes (NB), Multilayer Perceptron (MLP), Radial Basis Function (RBF), Random Forest (RAN), Ensemble Selection (ENS), Classification Tree (CTREE), Ada Boost M1(ADA),Support Vector Machine Linear (SVML) and Support Vector Machine Gaussian (SVMG). Areas under the receiver operating characteristic curves (aROC) obtained for isolated SAP and OCT parameters were compared with MLCs using OCT+SAP data. RESULTS: Combining OCT and SAP data, MLCs' aROCs varied from 0.777(CTREE) to 0.946 (RAN).The best OCT+SAP aROC obtained with RAN (0.946) was significantly larger the best single OCT parameter (p<0.05), but was not significantly different from the aROC obtained with the best single SAP parameter (p=0.19). CONCLUSION: Machine learning classifiers trained on OCT and SAP data can successfully discriminate between healthy and glaucomatous eyes. The combination of OCT and SAP measurements improved the diagnostic accuracy compared with OCT data alone.

Validity and reliability of the Structured Clinical Interview for Mood Spectrum: Brazilian version (SCIMOODS-VB)

OBJECTIVE: The aim of this study was to translate the Structured Clinical Interview for Mood Spectrum into Brazilian Portuguese, measuring its reliability, validity, and defining scores for bipolar disorders. METHOD: Questionnaire was translated (into Brazilian Portuguese) and back-translated into English. Sample consisted of 47 subjects with bipolar disorder, 47 with major depressive disorder, 18 with schizophrenia and 22 controls. Inter-rater reliability was tested in 20 subjects with bipolar disorder and MDD. Internal consistency was measured using the Kuder Richardson formula. Forward stepwise discriminant analysis was performed. Scores were compared between groups; manic (M), depressive (D) and total (T) threshold scores were calculated through receiver operating characteristic (ROC) curves. RESULTS: Kuder Richardson coefficients were between 0.86 and 0.94. Intraclass correlation coefficient was 0.96 (CI 95 % 0.93-0.97). Subjects with bipolar disorder had higher M and T, and similar D scores, when compared to major depressive disorder (ANOVA, p < 0.001). The sub-domains that best discriminated unipolar and bipolar subjects were manic energy and manic mood. M had the best area under the curve (0.909), and values of M equal to or greater than 30 yielded 91.5% sensitivity and 74.5% specificity. CONCLUSION: Structured Clinical Interview for Mood Spectrum has good reliability and validity. Cut-off of 30 best differentiates subjects with bipolar disorder vs. unipolar depression. A cutoff score of 30 or higher in the mania sub-domain is appropriate to help make a distinction between subjects with bipolar disorder and those with unipolar depression.

Predictive Validity of Waterlow Scale for Pressure Ulcer Development Risk in Hospitalized Patients

AIM: We sought to evaluate the predictive validity of the Waterlow Scale in hospitalized patients. SUBJECTS AND SETTING: The study was conducted at a general private hospital with 220 beds and a mean time of hospitalization of 7.4 days and a mean occupation rate of approximately 80%. Adult patients with a Braden Scale score of 18 or less and a Waterlow Scale score of 16 or more were studied. The sample consisted of 98 patients with a mean age of 71.1 +/- 15.5 years. METHODS: Skin assessment and scoring by using the Waterlow and Braden scales were completed on alternate days. Patients were examined at least 3 times to be considered for analysis. The data were submitted to sensitivity and specificity analysis by using receiver operating characteristic (ROC) curves and positive (+LR) and negative (-LR) likelihood ratios. RESULTS: The cutoff scores were 17, 20, and 20 in the first, second, and third assessment, respectively. Sensitivity was 71.4%, 85.7%, and 85.7% and specificity was 67.0%, 40.7%, and 32.9%, respectively. Analysis of the area under the ROC curve revealed good accuracy (0.64, 95% confidence interval [CI]: 0.35-0.93) only for the cutoff score 17 in the first assessment. The results also showed probabilities of 14%, 10%, and 9% for the development of pressure ulcer when the test results were positive (+LR) and of 3% (-LR) when the test results were negative for the cutoff scores in the first, second, and third assessment, respectively. CONCLUSION: The Waterlow Scale achieved good predictive validity in predicting pressure ulcer in hospitalized patients when a cutoff score of 17 was used in the first assessment.

Comparison of calcaneal ultrasound and DXA in young women

Purpose: The purpose of the study was to assess quantitative ultrasound (QUS) parameters in collegiate female gymnasts, a population whose training incorporates high-impact loading, which is particularly osteogenic, and to determine the discriminative capacity of this relatively new radiation-free technique compared with bone densitometry in a young healthy population. Methods: We studied 19 collegiate gymnasts and 23 healthy controls undergoing regular weight-bearing activity, matched for age (gymnasts 19.2 +/- 1.2, controls 19.9 +/- 1.6 yr) and body weight (gymnasts 56.7 +/- 3.7, controls 57.7 +/- 7.8 kg). QUS parameters of the calcaneus (broadband ultrasound attenuation (BUA), bone velocity (BV), and speed of sound (SOS)) were measured by a Walker Sonix UBA 575+. Bone mineral density (BMD; g.cm(-2)) of the lumbar spine, hip (Femoral neck, trochanter. Ward's triangle) and whole body was assessed by dual energy x-ray absorptiometry (DXA, Hologic QDR 1000/W). Data analysis included unpaired two-tailed Student's t-tests, analysis of variance, Pearson product-moment, and Spearman rank-order correlations. Results: Regional and whole body BMD of gymnasts was greater than controls (P < 0.001), with the difference being 7-28%. Average QUS parameters of the right and left calcaneus were also higher (P < 0.001) in the gymnasts. BUA, BV, and SOS were significantly (P < 0.001) correlated to each bone site with r = 0.54-0.79. Analysis of receiver operating characteristic (ROC) curves indicated no significant difference in sensitivity and specificity for QUS and DXA measures. Conclusions: These results indicate that QUS parameters of the calcaneus are higher in young women gymnasts compared to individuals who undergo regular weight-bearing activity and that QUS parameters are able to discriminate between these two groups in a similar manner as does regional and whole body BMD.

Coronary Artery Stenoses: Accuracy of 64-Detector Row CT Angiography in Segments with Mild, Moderate, or Severe Calcification-A Subanalysis of the CORE-64 Trial

Purpose: To evaluate the influence of cross-sectional arc calcification on the diagnostic accuracy of computed tomography (CT) angiography compared with conventional coronary angiography for the detection of obstructive coronary artery disease (CAD). Materials and Methods: Institutional Review Board approval and written informed consent were obtained from all centers and participants for this HIPAA-compliant study. Overall, 4511 segments from 371 symptomatic patients (279 men, 92 women; median age, 61 years [interquartile range, 53-67 years]) with clinical suspicion of CAD from the CORE-64 multi-center study were included in the analysis. Two independent blinded observers evaluated the percentage of diameter stenosis and the circumferential extent of calcium (arc calcium). The accuracy of quantitative multidetector CT angiography to depict substantial (>50%) stenoses was assessed by using quantitative coronary angiography (QCA). Cross-sectional arc calcium was rated on a segment level as follows: noncalcified or mild (<90 degrees), moderate (90 degrees-180 degrees), or severe (>180 degrees) calcification. Univariable and multivariable logistic regression, receiver operation characteristic curve, and clustering methods were used for statistical analyses. Results: A total of 1099 segments had mild calcification, 503 had moderate calcification, 338 had severe calcification, and 2571 segments were noncalcified. Calcified segments were highly associated (P < .001) with disagreement between CTA and QCA in multivariable analysis after controlling for sex, age, heart rate, and image quality. The prevalence of CAD was 5.4% in noncalcified segments, 15.0% in mildly calcified segments, 27.0% in moderately calcified segments, and 43.0% in severely calcified segments. A significant difference was found in area under the receiver operating characteristic curves (noncalcified: 0.86, mildly calcified: 0.85, moderately calcified: 0.82, severely calcified: 0.81; P < .05). Conclusion: In a symptomatic patient population, segment-based coronary artery calcification significantly decreased agreement between multidetector CT angiography and QCA to detect a coronary stenosis of at least 50%.

Anthropometric measures of increased central and overall adiposity in association with echocardiographic left ventricular hypertrophy

Left ventricular hypertrophy is an important predictor of cardiovascular risk and sudden death. This study explored the ability of four obesity indexes (body mass index, waist circumference, waist-hip ratio and waist-stature ratio) to identify left ventricular hypertrophy. A sample of the general population (n=682; 43.5% men) was surveyed to assess cardiovascular risk factors. Biochemical, anthropometric and blood pressure values were obtained in a clinic visit according to standard methods. Left ventricular mass was obtained from transthoracic echocardiogram. Left ventricular hypertrophy was defined using population-specific cutoff values for left ventricular mass indexed to height(2.7). The waist-stature ratio showed the strongest positive association with left ventricular mass. This correlation was stronger in women, even after controlling for age and systolic blood pressure. By multivariate analysis, the main predictors of left ventricular hypertrophy were waist-stature ratio (23%), systolic blood pressure (9%) and age (2%) in men, and waist-stature ratio (40%), age (6%) and systolic blood pressure (2%) in women. Receiver-operating characteristic curves showed the optimal cutoff values of the different anthropometric indexes associated with left ventricular hypertrophy. The waist-stature ratio was a significantly better predictor than the other indexes (except for the waist-hip ratio), independent of gender. It is noteworthy that a waist-stature ratio cutoff of 0.56 showed the highest combined sensitivity and specificity to detect left ventricular hypertrophy. Abdominal obesity identified by waist-stature ratio instead of overall obesity identified by body mass index is the simplest and best obesity index for assessing the risk of left ventricular hypertrophy, is a better predictor in women and has an optimal cutoff ratio of 0.56. Hypertension Research (2010) 33, 83-87; doi: 10.1038/hr.2009.188; published online 13 November 2009