229 resultados para ROC curve
Resumo:
We propose expected attainable discrimination (EAD) as a measure to select discrete valued features for reliable discrimination between two classes of data. EAD is an average of the area under the ROC curves obtained when a simple histogram probability density model is trained and tested on many random partitions of a data set. EAD can be incorporated into various stepwise search methods to determine promising subsets of features, particularly when misclassification costs are difficult or impossible to specify. Experimental application to the problem of risk prediction in pregnancy is described.
Resumo:
Objective To examine the clinical utility of the Cornell Scale for Depression in Dementia (CSDD) in nursing homes. Setting 14 nursing homes in Sydney and Brisbane, Australia. Participants 92 residents with a mean age of 85 years. Measurements Consenting residents were assessed by care staff for depression using the CSDD as part of their routine assessment. Specialist clinicians conducted assessment of depression using the Semi-structured Clinical Diagnostic Interview for DSM-IV-TR Axis I Disorders for residents without dementia or the Provisional Diagnostic Criteria for Depression in Alzheimer Disease for residents with dementia to establish expert clinical diagnoses of depression. The diagnostic performance of the staff completed CSDD was analyzed against expert diagnosis using receiver operating characteristic (ROC) curves. Results The CSDD showed low diagnostic accuracy, with areas under the ROC curve being 0.69, 0.68 and 0.70 for the total sample, residents with dementia and residents without dementia, respectively. At the standard CSDD cutoff score, the sensitivity and specificity were 71% and 59% for the total sample, 69% and 57% for residents with dementia, and 75% and 61% for residents without dementia. The Youden index (for optimizing cut-points) suggested different depression cutoff scores for residents with and without dementia. Conclusion When administered by nursing home staff the clinical utility of the CSDD is highly questionable in identifying depression. The complexity of the scale, the time required for collecting relevant information, and staff skills and knowledge of assessing depression in older people must be considered when using the CSDD in nursing homes.
Resumo:
Strategic searching for invasive pests presents a formidable challenge for conservation managers. Limited funding can necessitate choosing between surveying many sites cursorily, or focussing intensively on fewer sites. While existing knowledge may help to target more likely sites, e.g. with species distribution models (maps), this knowledge is not flawless and improving it also requires management investment. 2.In a rare example of trading-off action against knowledge gain, we combine search coverage and accuracy, and its future improvement, within a single optimisation framework. More specifically we examine under which circumstances managers should adopt one of two search-and-control strategies (cursory or focussed), and when they should divert funding to improving knowledge, making better predictive maps that benefit future searches. 3.We use a family of Receiver Operating Characteristic curves to reflect the quality of maps that direct search efforts. We demonstrate our framework by linking these to a logistic model of invasive spread such as that for the red imported fire ant Solenopsis invicta in south-east Queensland, Australia. 4.Cursory widespread searching is only optimal if the pest is already widespread or knowledge is poor, otherwise focussed searching exploiting the map is preferable. For longer management timeframes, eradication is more likely if funds are initially devoted to improving knowledge, even if this results in a short-term explosion of the pest population. 5.Synthesis and applications. By combining trade-offs between knowledge acquisition and utilization, managers can better focus - and justify - their spending to achieve optimal results in invasive control efforts. This framework can improve the efficiency of any ecological management that relies on predicting occurrence. © 2010 The Authors. Journal of Applied Ecology © 2010 British Ecological Society.
Resumo:
Background Pollens of the Panicoideae subfamily of grasses including Bahia (Paspalum notatum) are important allergen sources in subtropical regions of the world. An assay for specific IgE to the major molecular allergenic component, Pas n 1, of Bahia grass pollen (BaGP) would have immunodiagnostic utility for patients with pollen allergy in these regions. Methods Biotinylated Pas n 1 purified from BaGP was coated onto streptavidin ImmunoCAPs. Subjects were assessed by clinical history of allergic rhinitis and skin prick test (SPT) to aeroallergens. Serum total, BaGP-specific and Pas n 1-specific IgE were measured. Results: Pas n 1 IgE concentrations were highly correlated with BaGP SPT (r = 0.795, p < 0.0001) and BaGP IgE (r = 0.915, p < 0.0001). At 0.23 kU/l Pas n 1 IgE, the diagnostic sensitivity (92.4%) and specificity (93.1%) for the detection of BaGP allergy was high (area under receiver operator curve 0.960, p < 0.0001). The median concentrations of Pas n 1 IgE in non-Atopic subjects (0.01 kU/l, n = 67) and those with other allergies (0.02 kU/l, n = 59) showed no inter-group difference, whilst grass pollen-Allergic patients with allergic rhinitis showed elevated Pas n 1 IgE (6.71 kU/l, n = 182, p < 0.0001). The inter-Assay coefficient of variation for the BaGP-Allergic serum pool was 6.92%. Conclusions Pas n 1 IgE appears to account for most of the BaGP-specific IgE. This molecular component immunoassay for Pas n 1 IgE has potential utility to improve the sensitivity and accuracy of diagnosis of BaGP allergy for patients in subtropical regions.
Resumo:
OBJECTIVE This study determined if deficits in corneal nerve fiber length (CNFL) assessed using corneal confocal microscopy (CCM) can predict future onset of diabetic peripheral neuropathy (DPN). RESEARCH DESIGN AND METHODS CNFL and a range of other baseline measures were compared between 90 nonneuropathic patients with type 1 diabetes who did or did not develop DPN after 4 years. The receiver operator characteristic (ROC) curve was used to determine the capability of single and combined measures of neuropathy to predict DPN. RESULTS DPN developed in 16 participants (18%) after 4 years. Factors predictive of 4-year incident DPN were lower CNFL (P = 0.041); longer duration of diabetes (P = 0.002); higher triglycerides (P = 0.023); retinopathy (higher on the Early Treatment of Diabetic Retinopathy Study scale) (P = 0.008); nephropathy (higher albumin-to-creatinine ratio) (P = 0.001); higher neuropathy disability score (P = 0.037); lower cold sensation (P = 0.001) and cold pain (P = 0.027) thresholds; higher warm sensation (P = 0.008), warm pain (P = 0.024), and vibration (P = 0.003) thresholds; impaired monofilament response (P = 0.003); and slower peroneal (P = 0.013) and sural (P = 0.002) nerve conduction velocity. CCM could predict the 4-year incident DPN with 63% sensitivity and 74% specificity for a CNFL threshold cutoff of 14.1 mm/mm2 (area under ROC curve = 0.66, P = 0.041). Combining neuropathy measures did not improve predictive capability. CONCLUSIONS DPN can be predicted by various demographic, metabolic, and conventional neuropathy measures. The ability of CCM to predict DPN broadens the already impressive diagnostic capabilities of this novel ophthalmic marker.
Resumo:
OBJECTIVE Public health organizations recommend that preschool-aged children accumulate at least 3h of physical activity (PA) daily. Objective monitoring using pedometers offers an opportunity to measure preschooler's PA and assess compliance with this recommendation. The purpose of this study was to derive step-based recommendations consistent with the 3h PA recommendation for preschool-aged children. METHOD The study sample comprised 916 preschool-aged children, aged 3 to 6years (mean age=5.0+/-0.8years). Children were recruited from kindergartens located in Portugal, between 2009 and 2013. Children wore an ActiGraph GT1M accelerometer that measured PA intensity and steps per day simultaneously over a 7-day monitoring period. Receiver operating characteristic (ROC) curve analysis was used to identify the daily step count threshold associated with meeting the daily 3hour PA recommendation. RESULTS A significant correlation was observed between minutes of total PA and steps per day (r=0.76, p<0.001). The optimal step count for >/=3h of total PA was 9099 steps per day (sensitivity (90%) and specificity (66%)) with area under the ROC curve=0.86 (95% CI: 0.84 to 0.88). CONCLUSION Preschool-aged children who accumulate less than 9000 steps per day may be considered Insufficiently Active.
Resumo:
- Background Expressed emotion (EE) captures the affective quality of the relationship between family caregivers and their care recipients and is known to increase the risk of poor health outcomes for caregiving dyads. Little is known about expressed emotion in the context of caregiving for persons with dementia, especially in non-Western cultures. The Family Attitude Scale (FAS) is a psychometrically sound self-reporting measure for EE. Its use in the examination of caregiving for patients with dementia has not yet been explored. - Objectives This study was performed to examine the psychometric properties of the Chinese version of the FAS (FAS-C) in Chinese caregivers of relatives with dementia, and its validity in predicting severe depressive symptoms among the caregivers. - Methods The FAS was translated into Chinese using Brislin's model. Two expert panels evaluated the semantic equivalence and content validity of this Chinese version (FAS-C), respectively. A total of 123 Chinese primary caregivers of relatives with dementia were recruited from three elderly community care centers in Hong Kong. The FAS-C was administered with the Chinese versions of the 5-item Mental Health Inventory (MHI-5), the Zarit Burden Interview (ZBI) and the Revised Memory and Behavioral Problem Checklist (RMBPC). - Results The FAS-C had excellent semantic equivalence with the original version and a content validity index of 0.92. Exploratory factor analysis identified a three-factor structure for the FAS-C (hostile acts, criticism and distancing). Cronbach's alpha of the FAS-C was 0.92. Pearson's correlation indicated that there were significant associations between a higher score on the FAS-C and greater caregiver burden (r = 0.66, p < 0.001), poorer mental health of the caregivers (r = −0.65, p < 0.001) and a higher level of dementia-related symptoms (frequency of symptoms: r = 0.45, p < 0.001; symptom disturbance: r = 0.51, p < 0.001), which serves to suggest its construct validity. For detecting severe depressive symptoms of the family caregivers, the receiving operating characteristics (ROC) curve had an area under curve of 0.78 (95% confidence interval (CI) = 0.69–0.87, p < 0.0001). The optimal cut-off score was >47 with a sensitivity of 0.720 (95% CI = 0.506–0.879) and specificity of 0.742 (95% CI = 0.643–0.826). - Conclusions The FAS-C is a reliable and valid measure to assess the affective quality of the relationship between Chinese caregivers and their relatives with dementia. It also has acceptable predictability in identifying family caregivers with severe depressive symptoms.
Resumo:
- Background Sonography is an important diagnostic tool in children with suspected appendicitis. Reported accuracy and appendiceal visualisation rates vary significantly, as does the management of equivocal ultrasound findings. The aim of this study was to audit appendiceal sonography at a tertiary children's hospital, and provide baseline data for a future prospective study. - Summary of work Records of children who underwent ultrasound studies for possible appendicitis between January 2008 and December 2010 were reviewed. Variables included patient demographics, sonographic appendix characteristics, and secondary signs. Descriptive statistics and analysis using ANOVA, Mann-Whitney U test, and ROC curves were performed. Mater Human Research Ethic Committee approval was granted. - Summary of results There were 457 eligible children. Using a dichotomous diagnostic model (including equivocal results), sensitivity was 89.6%, specificity 91.6%, and diagnostic yield of 40.7%. ROC curve analysis of a 6mm diameter cut-off was 0.88 AUC (95% CI 0.80 to 0.95). - Discussion and conclusions Sonography is an accurate test for acute appendicitis in children, with a high sensitivity and negative predictive value. A diameter of 6mm as an absolute cut-off in a binary model can lead to false findings. Results were compared with available literature. Recent publications propose categorising diameter1 and integrating secondary signs2 to improve accuracy and provide more meaningful results to clinicians. This study will be a benchmark for future studies with multiple diagnostic categorisation.