37 resultados para Roc curves
em BORIS: Bern Open Repository and Information System - Berna - Suiça
Resumo:
The original 'Örebro Musculoskeletal Pain Questionnaire' (original-ÖMPQ) has been shown to have limitations in practicality, factor structure, face and content validity. This study addressed these concerns by modifying its content producing the 'Örebro Musculoskeletal Screening Questionnaire' (ÖMSQ). The ÖMSQ and original-ÖMPQ were tested concurrently in acute/subacute low back pain working populations (pilot n = 44, main n = 106). The ÖMSQ showed improved face and content validity, which broadened potential application, and improved practicality with two-thirds less missing responses. High reliability (0.975, p < 0.05, ICC: 2.1), criterion validity (Spearman's r = 0.97) and internal consistency (α = 0.84) were achieved, as were predictive ability cut-off scores from ROC curves (112-120 ÖMSQ-points), statistically different ÖMSQ scores (p < 0.001) for each outcome trait, and a strong correlation with recovery time (Spearman's, r = 0.71). The six-component factor structure reflected the constructs originally proposed. The ÖMSQ can be substituted for the original-ÖMPQ in this population. Further research will assess its applicability in broader populations.
Resumo:
Rationale Mannitol dry powder (MDP) challenge is an indirect bronchial provocation test, which is well studied in adults but not established for children. Objective We compared feasibility, validity, and clinical significance of MDP challenge with exercise testing in children in a clinical setting. Methods Children aged 6–16 years, referred to two respiratory outpatient clinics for possible asthma diagnosis, underwent standardized exercise testing followed within a week by an MDP challenge (Aridol™, Pharmaxis, Australia). Agreement between the two challenge tests using Cohen's kappa and receiving operating characteristic (ROC) curves was compared. Results One hundred eleven children performed both challenge tests. Twelve children were excluded due to exhaustion or insufficient cooperation (11 at the exercise test, 1 at the MDP challenge), leaving 99 children (mean ± SD age 11.5 ± 2.7 years) for analysis. MDP tests were well accepted, with minor side effects and a shorter duration than exercise tests. The MDP challenge was positive in 29 children (29%), the exercise test in 21 (21%). Both tests were concordant in 83 children (84%), with moderate agreement (κ = 0.58, 95% CI 0.39–0.76). Positive and negative predictive values of the MDP challenge for exercise-induced bronchoconstriction were 68% and 89%. The overall ability of MDP challenge to separate children with or without positive exercise tests was good (area under the ROC curve 0.83). Conclusions MDP challenge test is feasible in children and is a suitable alternative for bronchial challenge testing in childhood. Pediatr. Pulmonol. 2011; 46:842–848. © 2011 Wiley-Liss, Inc.
Resumo:
Background: The Geneva Prognostic Score (GPS), the Pulmonary Embolism Severity Index (PESI), and its simplified version (sPESI) are well known clinical prognostic scores for pulmonary embolism (PE).Objectives: To compare the prognostic performance of these scores in elderly patients with PE. Patients/Methods: In a multicenter Swiss cohort of elderly patients with venous thromboembolism, we prospectively studied 449 patients aged ≥65 years with symptomatic PE. The outcome was 30-day overall mortality. We dichotomized patients as low- vs. higher-risk in all three scores using the following thresholds: GPS scores ≤2 vs. >2, PESI risk classes I-II vs. III-V, and sPESI scores 0 vs. ≥1. We compared 30-day mortality in low- vs. higher-risk patients and the areas under the receiver operating characteristic curve (ROC). Results: Overall, 3.8% of patients (17/449) died within 30 days. The GPS classified a greater proportion of patients as low risk (92% [413/449]) than the PESI (36.3% [163/449]) and the sPESI (39.6% [178/449]) (P<0.001 for each comparison). Low-risk patients based on the sPESI had a mortality of 0% (95% confidence interval [CI] 0-2.1%) compared to 0.6% (95% CI 0-3.4%) for low-risk patients based on the PESI and 3.4% (95% CI 1.9-5.6%) for low-risk patients based on the GPS. The areas under the ROC curves were 0.77 (95%CI 0.72-0.81), 0.76 (95% CI 0.72-0.80), and 0.71 (95% CI 0.66-0.75), respectively (P=0.47). Conclusions: In this cohort of elderly patients with PE, the GPS identified a higher proportion of patients as low-risk but the PESI and sPESI were more accurate in predicting mortality.
Resumo:
Background: In most patients with chronic heart failure (CHF), endurance training improves exercise capacity. However, some patients do not respond favourably. The purpose of this study was to explore the reasons of non-response and to determine their predictive value.Methods: We studied a cohort of 120 consecutive CHF patients with sinus rhythm (mean age 57 ± 12 years, ejection fraction 29.3 ± 9.9%, peak VO2 17.3 ± 5.1 ml/min/kg), participating in a 3-month outpatient cardiac rehabilitation programme. Responders were defined as subjects who improved peak VO2 by more than 5%, work load by more than 10%, or VE/VCO2 slope by more than 5%. Subjects who did not fulfil at least one of the above criteria were characterized as non-responders. Multivariate regression analyses were performed to identify parameters that were predictive for a response. Receiver operating characteristic (ROC) analyses were performed for predictive parameters to identify thresholds for response or non-response.Results: Multivariate regression analyses revealed heart rate (HR) reserve, HR recovery at 1 min, and peak HR as significant predictors for a positive training response. ROC curves revealed the optimal thresholds separating responders from non-responders at less than 30 bpm for HR reserve, less than 6 bpm for HR recovery and less than 101 bpm for peak HR.Conclusions: The presence of impaired chronotropic competence is a major predictor of poor training response in CHF patients with sinus rhythm.
Resumo:
BACKGROUND: Congestive heart failure (CHF) is a major public health problem. The use of B-type natriuretic peptide (BNP) tests shows promising diagnostic accuracy. Herein, we summarize the evidence on the accuracy of BNP tests in the diagnosis of CHF and compare the performance of rapid enzyme-linked immunosorbent assay (ELISA) and standard radioimmunosorbent assay (RIA) tests. METHODS: We searched electronic databases and the reference lists of included studies, and we contacted experts. Data were extracted on the study population, the type of test used, and methods. Receiver operating characteristic (ROC) plots and summary ROC curves were produced and negative likelihood ratios pooled. Random-effect meta-analysis and metaregression were used to combine data and explore sources of between-study heterogeneity. RESULTS: Nineteen studies describing 22 patient populations (9 ELISA and 13 RIA) and 9093 patients were included. The diagnosis of CHF was verified by echocardiography, radionuclide scan, or echocardiography combined with clinical criteria. The pooled negative likelihood ratio overall from random-effect meta-analysis was 0.18 (95% confidence interval [CI], 0.13-0.23). It was lower for the ELISA test (0.12; 95% CI, 0.09-0.16) than for the RIA test (0.23; 95% CI, 0.16-0.32). For a pretest probability of 20%, which is typical for patients with suspected CHF in primary care, a negative result of the ELISA test would produce a posttest probability of 2.9%; a negative RIA test, a posttest probability of 5.4%. CONCLUSIONS: The use of BNP tests to rule out CHF in primary care settings could reduce demand for echocardiography. The advantages of rapid ELISA tests need to be balanced against their higher cost.
Resumo:
To compare the prediction of hip fracture risk of several bone ultrasounds (QUS), 7062 Swiss women > or =70 years of age were measured with three QUSs (two of the heel, one of the phalanges). Heel QUSs were both predictive of hip fracture risk, whereas the phalanges QUS was not. INTRODUCTION: As the number of hip fracture is expected to increase during these next decades, it is important to develop strategies to detect subjects at risk. Quantitative bone ultrasound (QUS), an ionizing radiation-free method, which is transportable, could be interesting for this purpose. MATERIALS AND METHODS: The Swiss Evaluation of the Methods of Measurement of Osteoporotic Fracture Risk (SEMOF) study is a multicenter cohort study, which compared three QUSs for the assessment of hip fracture risk in a sample of 7609 elderly ambulatory women > or =70 years of age. Two QUSs measured the heel (Achilles+; GE-Lunar and Sahara; Hologic), and one measured the heel (DBM Sonic 1200; IGEA). The Cox proportional hazards regression was used to estimate the hazard of the first hip fracture, adjusted for age, BMI, and center, and the area under the ROC curves were calculated to compare the devices and their parameters. RESULTS: From the 7609 women who were included in the study, 7062 women 75.2 +/- 3.1 (SD) years of age were prospectively followed for 2.9 +/- 0.8 years. Eighty women reported a hip fracture. A decrease by 1 SD of the QUS variables corresponded to an increase of the hip fracture risk from 2.3 (95% CI, 1.7, 3.1) to 2.6 (95% CI, 1.9, 3.4) for the three variables of Achilles+ and from 2.2 (95% CI, 1.7, 3.0) to 2.4 (95% CI, 1.8, 3.2) for the three variables of Sahara. Risk gradients did not differ significantly among the variables of the two heel QUS devices. On the other hand, the phalanges QUS (DBM Sonic 1200) was not predictive of hip fracture risk, with an adjusted hazard risk of 1.2 (95% CI, 0.9, 1.5), even after reanalysis of the digitalized data and using different cut-off levels (1700 or 1570 m/s). CONCLUSIONS: In this elderly women population, heel QUS devices were both predictive of hip fracture risk, whereas the phalanges QUS device was not.
Resumo:
Studies of diagnostic accuracy require more sophisticated methods for their meta-analysis than studies of therapeutic interventions. A number of different, and apparently divergent, methods for meta-analysis of diagnostic studies have been proposed, including two alternative approaches that are statistically rigorous and allow for between-study variability: the hierarchical summary receiver operating characteristic (ROC) model (Rutter and Gatsonis, 2001) and bivariate random-effects meta-analysis (van Houwelingen and others, 1993), (van Houwelingen and others, 2002), (Reitsma and others, 2005). We show that these two models are very closely related, and define the circumstances in which they are identical. We discuss the different forms of summary model output suggested by the two approaches, including summary ROC curves, summary points, confidence regions, and prediction regions.
Resumo:
BACKGROUND: Several conversion tables and formulas have been suggested to correct applanation intraocular pressure (IOP) for central corneal thickness (CCT). CCT is also thought to represent an independent glaucoma risk factor. In an attempt to integrate IOP and CCT into a unified risk factor and avoid uncertain correction for tonometric inaccuracy, a new pressure-to-cornea index (PCI) is proposed. METHODS: PCI (IOP/CCT(3)) was defined as the ratio between untreated IOP and CCT(3) in mm (ultrasound pachymetry). PCI distribution in 220 normal controls, 53 patients with normal-tension glaucoma (NTG), 76 with ocular hypertension (OHT), and 89 with primary open-angle glaucoma (POAG) was investigated. PCI's ability to discriminate between glaucoma (NTG+POAG) and non-glaucoma (controls+OHT) was compared with that of three published formulae for correcting IOP for CCT. Receiver operating characteristic (ROC) curves were built. RESULTS: Mean PCI values were: Controls 92.0 (SD 24.8), NTG 129.1 (SD 25.8), OHT 134.0 (SD 26.5), POAG 173.6 (SD 40.9). To minimise IOP bias, eyes within the same 2 mm Hg range between 16 and 29 mm Hg (16-17, 18-19, etc) were separately compared: control and NTG eyes as well as OHT and POAG eyes differed significantly. PCI demonstrated a larger area under the ROC curve (AUC) and significantly higher sensitivity at fixed 80% and 90% specificities compared with each of the correction formulas; optimum PCI cut-off value 133.8. CONCLUSIONS: A PCI range of 120-140 is proposed as the upper limit of "normality", 120 being the cut-off value for eyes with untreated pressures
Resumo:
Mass screening for osteoporosis using DXA measurements at the spine and hip is presently not recommended by health authorities. Instead, risk factor questionnaires and peripheral bone measurements may facilitate the selection of women eligible for axial bone densitometry. The aim of this study was to validate a case finding strategy for postmenopausal women who would benefit most from subsequent DXA measurement by using phalangeal radiographic absorptiometry (RA) alone or in combination with risk factors in a general practice setting. The sensitivity and specificity of this strategy in detecting osteoporosis (T-score < or =2.5 SD at the spine and/or the hip) were compared with those of the current reimbursement criteria for DXA measurements in Switzerland. Four hundred and twenty-three postmenopausal women with one or more risk factors for osteoporosis were recruited by 90 primary care physicians who also performed the phalangeal RA measurements. All women underwent subsequent DXA measurement of the spine and the hip at the Osteoporosis Policlinic of the University Hospital of Berne. They were allocated to one of two groups depending on whether they matched with the Swiss reimbursement conditions for DXA measurement or not. Logistic regression models were used to predict the likelihood of osteoporosis versus "no osteoporosis" and to derive ROC curves for the various strategies. Differences in the areas under the ROC curves (AUC) were tested for significance. In women lacking reimbursement criteria, RA achieved a significantly larger AUC (0.81; 95% CI 0.72-0.89) than the risk factors associated with patients' age, height and weight (0.71; 95% C.I. 0.62-0.80). Furthermore, in this study, RA provided a better sensitivity and specificity in identifying women with underlying osteoporosis than the currently accepted criteria for reimbursement of DXA measurement. In the Swiss environment, RA is a valid case finding tool for patients with risk factors for osteoporosis, especially for those who do not qualify for DXA reimbursement.
Resumo:
OBJECTIVE: Meta-analysis of studies of the accuracy of diagnostic tests currently uses a variety of methods. Statistically rigorous hierarchical models require expertise and sophisticated software. We assessed whether any of the simpler methods can in practice give adequately accurate and reliable results. STUDY DESIGN AND SETTING: We reviewed six methods for meta-analysis of diagnostic accuracy: four simple commonly used methods (simple pooling, separate random-effects meta-analyses of sensitivity and specificity, separate meta-analyses of positive and negative likelihood ratios, and the Littenberg-Moses summary receiver operating characteristic [ROC] curve) and two more statistically rigorous approaches using hierarchical models (bivariate random-effects meta-analysis and hierarchical summary ROC curve analysis). We applied the methods to data from a sample of eight systematic reviews chosen to illustrate a variety of patterns of results. RESULTS: In each meta-analysis, there was substantial heterogeneity between the results of different studies. Simple pooling of results gave misleading summary estimates of sensitivity and specificity in some meta-analyses, and the Littenberg-Moses method produced summary ROC curves that diverged from those produced by more rigorous methods in some situations. CONCLUSION: The closely related hierarchical summary ROC curve or bivariate models should be used as the standard method for meta-analysis of diagnostic accuracy.
Resumo:
OBJECTIVE: The aim of this study was to determine the influence of polyvinyl chloride (PVC) wrapping on the performance of two laser fluorescence devices (LF and LFpen) by assessing tooth occlusal surfaces. BACKGROUND DATA: Protection of their tips may influence LF measurements. To date there are no studies evaluating the influence of this protection on the performance of the LFpen on permanent teeth, or comparing it to the original LF device. MATERIALS AND METHODS: One hundred nineteen permanent molars were assessed by two experienced dentists using the LF and the LFpen devices, both with and without PVC wrapping. The teeth were histologically prepared and assessed for caries extension. RESULTS: The LF values with and without PVC wrapping were significantly different. For both LF devices, the sensitivity and accuracy were lower when the PVC wrapping was used. The specificity was statistically significantly higher for the LFpen with PVC. No difference was found between the areas under the ROC curves with and without PVC wrapping. The ICC showed excellent interexaminer agreement. The Bland and Altman method showed a range between the upper and the lower limits of agreement of 63.4 and 57.8 units for the LF device, and 49.4 and 74.2 for the LFpen device, with and without PVC wrapping, respectively. CONCLUSIONS: We found an influence of the PVC wrapping on the performance of the LF and LFpen devices. However, since its influence on detection of occlusal caries lesions is considered for, the use of one PVC layer is suggested to avoid cross-contamination in clinical practice.
Resumo:
Aim of this paper is to evaluate the diagnostic contribution of various types of texture features in discrimination of hepatic tissue in abdominal non-enhanced Computed Tomography (CT) images. Regions of Interest (ROIs) corresponding to the classes: normal liver, cyst, hemangioma, and hepatocellular carcinoma were drawn by an experienced radiologist. For each ROI, five distinct sets of texture features are extracted using First Order Statistics (FOS), Spatial Gray Level Dependence Matrix (SGLDM), Gray Level Difference Method (GLDM), Laws' Texture Energy Measures (TEM), and Fractal Dimension Measurements (FDM). In order to evaluate the ability of the texture features to discriminate the various types of hepatic tissue, each set of texture features, or its reduced version after genetic algorithm based feature selection, was fed to a feed-forward Neural Network (NN) classifier. For each NN, the area under Receiver Operating Characteristic (ROC) curves (Az) was calculated for all one-vs-all discriminations of hepatic tissue. Additionally, the total Az for the multi-class discrimination task was estimated. The results show that features derived from FOS perform better than other texture features (total Az: 0.802+/-0.083) in the discrimination of hepatic tissue.
Resumo:
Dual energy X-ray absorptiometry (DXA) is widely accepted as the reference method for diagnosis and monitoring of osteoporosis and for assessment of fracture risk, especially at hip. However, axial-DXA is not suitable for mass screening, because it is usually confined to specialized centers. We propose a two-step diagnostic approach to postmenopausal osteoporosis: the first step, using an inexpensive, widely available screening technique, aims at risk stratification in postmenopausal women; the second step, DXA of spine and hip is applied only to potentially osteoporotic women preselected on the basis of the screening measurement. In a group of 110 healthy postmenopausal woman, the capability of various peripheral bone measurement techniques to predict osteoporosis at spine and/or hip (T-score < -2.5SD using DXA) was tested using receiver operating characteristic (ROC) curves: radiographic absorptiometry of phalanges (RA), ultrasonometry at calcaneus (QUS. CALC), tibia (SOS.TIB), and phalanges (SOS.PHAL). Thirty-three women had osteoporosis at spine and/or hip with DXA. Areas under the ROC curves were 0.84 for RA, 0.83 for QUS.CALC, 0.77 for SOS.PHAL (p < 0.04 vs RA) and 0.74 for SOS.TIB (p < 0.02 vs RA and p = 0.05 vs QUS.CALC). For levels of sensitivity of 90%, the respective specificities were 67% (RA), 64% (QUS.CALC), 48% (SOS.PHAL), and 39% (SOS.TIB). In a cost-effective two-step, the price of the first step should not exceed 54% (RA), 51% (QUS.CALC), 42% (SOS.PHAL), and 25% (SOS.TIB). In conclusion, RA, QUS.CALC, SOS.PHAL, and SOS.TIB may be useful to preselect postmenopausal women in whom axial DXA is indicated to confirm/exclude osteoporosis at spine or hip.
Resumo:
BACKGROUND Because computed tomography (CT) has advantages for visualizing the manifestation of necrosis and local complications, a series of scoring systems based on CT manifestations have been developed for assessing the clinical outcomes of acute pancreatitis (AP), including the CT severity index (CTSI), modified CTSI, etc. Despite the internationally accepted CTSI having been successfully used to predict the overall mortality and disease severity of AP, recent literature has revealed the limitations of the CTSI. Using the Delphi method, we establish a new scoring system based on retrocrural space involvement (RCSI), and compared its effectiveness at evaluating the mortality and severity of AP with that of the CTSI. METHODS We reviewed CT images of 257 patients with AP taken within 3-5 days of admission in 2012. The RCSI scoring system, which includes assessment of infectious conditions involving the retrocrural space and the adjacent pleural cavity, was established using the Delphi method. Two radiologists independently assessed the RCSI and CTSI scores. The predictive points of the RCSI and CTSI scoring systems in evaluating the mortality and severity of AP were estimated using receiver operating characteristic (ROC) curves. PRINCIPAL FINDINGS The RCSI score can accurately predict the mortality and disease severity. The area under the ROC curve for the RCSI versus CTSI score was 0.962±0.011 versus 0.900±0.021 for predicting the mortality, and 0.888±0.025 versus 0.904±0.020 for predicting the severity of AP. Applying ROC analysis to our data showed that a RCSI score of 4 was the best cutoff value, above which mortality could be identified. CONCLUSION The Delphi method was innovatively adopted to establish a scoring system to predict the clinical outcome of AP. The RCSI scoring system can predict the mortality of AP better than the CTSI system, and the severity of AP equally as well.
An Increased Iliocapsularis-to-rectus-femoris Ratio Is Suggestive for Instability in Borderline Hips
Resumo:
BACKGROUND The iliocapsularis muscle is an anterior hip structure that appears to function as a stabilizer in normal hips. Previous studies have shown that the iliocapsularis is hypertrophied in developmental dysplasia of the hip (DDH). An easy MR-based measurement of the ratio of the size of the iliocapsularis to that of adjacent anatomical structures such as the rectus femoris muscle might be helpful in everyday clinical use. QUESTIONS/PURPOSES We asked (1) whether the iliocapsularis-to-rectus-femoris ratio for cross-sectional area, thickness, width, and circumference is increased in DDH when compared with hips with acetabular overcoverage or normal hips; and (2) what is the diagnostic performance of these ratios to distinguish dysplastic from pincer hips? METHODS We retrospectively compared the anatomy of the iliocapsularis muscle between two study groups with symptomatic hips with different acetabular coverage and a control group with asymptomatic hips. The study groups were selected from a series of patients seen at the outpatient clinic for DDH or femoroacetabular impingement. The allocation to a study group was based on conventional radiographs: the dysplasia group was defined by a lateral center-edge (LCE) angle of < 25° with a minimal acetabular index of 14° and consisted of 45 patients (45 hips); the pincer group was defined by an LCE angle exceeding 39° and consisted of 37 patients (40 hips). The control group consisted of 30 asymptomatic hips (26 patients) with MRIs performed for nonorthopaedic reasons. The anatomy of the iliocapsularis and rectus femoris muscle was evaluated using MR arthrography of the hip and the following parameters: cross-sectional area, thickness, width, and circumference. The iliocapsularis-to-rectus-femoris ratio of these four anatomical parameters was then compared between the two study groups and the control group. The diagnostic performance of these ratios to distinguish dysplasia from protrusio was evaluated by calculating receiver operating characteristic (ROC) curves and the positive predictive value (PPV) for a ratio > 1. Presence and absence of DDH (ground truth) were determined on plain radiographs using the previously mentioned radiographic parameters. Evaluation of radiographs and MRIs was performed in a blinded fashion. The PPV was chosen because it indicates how likely a hip is dysplastic if the iliocapsularis-to-rectus-femoris ratio was > 1. RESULTS The iliocapsularis-to-rectus-femoris ratio for cross-sectional area, thickness, width, and circumference was increased in hips with radiographic evidence of DDH (ratios ranging from 1.31 to 1.35) compared with pincer (ratios ranging from 0.71 to 0.90; p < 0.001) and compared with the control group, the ratio of cross-sectional area, thickness, width, and circumference was increased (ratios ranging from 1.10 to 1.15; p ranging from 0.002 to 0.039). The area under the ROC curve ranged from 0.781 to 0.852. For a one-to-one iliocapsularis-to-rectus-femoris ratio, the PPV was 89% (95% confidence interval [CI], 73%-96%) for cross-sectional area, 77% (95% CI, 61%-88%) for thickness, 83% (95% CI, 67%-92%) for width, and 82% (95% CI, 67%-91%) for circumference. CONCLUSIONS The iliocapsularis-to-rectus-femoris ratio seems to be a valuable secondary sign of DDH. This parameter can be used as an adjunct for clinical decision-making in hips with borderline hip dysplasia and a concomitant cam-type deformity to identify the predominant pathology. Future studies will need to prove this finding can help clinicians determine whether the borderline dysplasia accounts for the hip symptoms with which the patient presents. LEVEL OF EVIDENCE Level III, prognostic study.