5 resultados para K-Fold Accuracy
Resumo:
BACKGROUND Functional brain images such as Single-Photon Emission Computed Tomography (SPECT) and Positron Emission Tomography (PET) have been widely used to guide the clinicians in the Alzheimer's Disease (AD) diagnosis. However, the subjectivity involved in their evaluation has favoured the development of Computer Aided Diagnosis (CAD) Systems. METHODS It is proposed a novel combination of feature extraction techniques to improve the diagnosis of AD. Firstly, Regions of Interest (ROIs) are selected by means of a t-test carried out on 3D Normalised Mean Square Error (NMSE) features restricted to be located within a predefined brain activation mask. In order to address the small sample-size problem, the dimension of the feature space was further reduced by: Large Margin Nearest Neighbours using a rectangular matrix (LMNN-RECT), Principal Component Analysis (PCA) or Partial Least Squares (PLS) (the two latter also analysed with a LMNN transformation). Regarding the classifiers, kernel Support Vector Machines (SVMs) and LMNN using Euclidean, Mahalanobis and Energy-based metrics were compared. RESULTS Several experiments were conducted in order to evaluate the proposed LMNN-based feature extraction algorithms and its benefits as: i) linear transformation of the PLS or PCA reduced data, ii) feature reduction technique, and iii) classifier (with Euclidean, Mahalanobis or Energy-based methodology). The system was evaluated by means of k-fold cross-validation yielding accuracy, sensitivity and specificity values of 92.78%, 91.07% and 95.12% (for SPECT) and 90.67%, 88% and 93.33% (for PET), respectively, when a NMSE-PLS-LMNN feature extraction method was used in combination with a SVM classifier, thus outperforming recently reported baseline methods. CONCLUSIONS All the proposed methods turned out to be a valid solution for the presented problem. One of the advances is the robustness of the LMNN algorithm that not only provides higher separation rate between the classes but it also makes (in combination with NMSE and PLS) this rate variation more stable. In addition, their generalization ability is another advance since several experiments were performed on two image modalities (SPECT and PET).
Resumo:
BACKGROUND Illiteracy, a universal problem, limits the utilization of the most widely used short cognitive tests. Our objective was to assess and compare the effectiveness and cost for cognitive impairment (CI) and dementia (DEM) screening of three short cognitive tests applicable to illiterates. METHODS Phase III diagnostic test evaluation study was performed during one year in four Primary Care centers, prospectively including individuals with suspicion of CI or DEM. All underwent the Eurotest, Memory Alteration Test (M@T), and Phototest, applied in a balanced manner. Clinical, functional, and cognitive studies were independently performed in a blinded fashion in a Cognitive Behavioral Neurology Unit, and the gold standard diagnosis was established by consensus of expert neurologists on the basis of these results. Effectiveness of tests was assessed as the proportion of correct diagnoses (diagnostic accuracy [DA]) and the kappa index of concordance (k) with respect to gold standard diagnoses. Costs were based on public prices at the time and hospital accounts. RESULTS The study included 139 individuals: 47 with DEM, 36 with CI, and 56 without CI. No significant differences in effectiveness were found among the tests. For DEM screening: Eurotest (k = 0.71 [0.59-0.83], DA = 0.87 [0.80-0.92]), M@T (k = 0.72 [0.60-0.84], DA = 0.87 [0.80-0.92]), Phototest (k = 0.70 [0.57-0.82], DA = 0.86 [0.79-0.91]). For CI screening: Eurotest (k = 0.67 [0.55-0.79]; DA = 0.83 [0.76-0.89]), M@T (k = 0.52 [0.37-0.67]; DA = 0.80 [0.72-0.86]), Phototest (k = 0.59 [0.46-0.72]; DA = 0.79 [0.71-0.86]). There were no differences in the cost of DEM screening, but the cost of CI screening was significantly higher with M@T (330.7 ± 177.1 €, mean ± sd) than with Eurotest (294.1 ± 195.0 €) or Phototest (296.0 ± 196. 5 €). Application time was shorter with Phototest (2.8 ± 0.8 min) than with Eurotest (7.1 ± 1.8 min) or M@T (6.8 ± 2.2 min). CONCLUSIONS Eurotest, M@T, and Phototest are equally effective. Eurotest and Phototest are both less expensive options but Phototest is the most efficient, requiring the shortest application time.
Resumo:
BACKGROUND To assess and compare the effectiveness and costs of Phototest, Mini Mental State Examination (MMSE), and Memory Impairment Screen (MIS) to screen for dementia (DEM) and cognitive impairment (CI). METHODS A phase III study was conducted over one year in consecutive patients with suspicion of CI or DEM at four Primary Care (PC) centers. After undergoing all screening tests at the PC center, participants were extensively evaluated by researchers blinded to screening test results in a Cognitive-Behavioral Neurology Unit (CBNU). The gold standard diagnosis was established by consensus of expert neurologists. Effectiveness was assessed by the proportion of correct diagnoses (diagnostic accuracy [DA]) and by the kappa index of concordance between test results and gold standard diagnoses. Costs were based on public prices and hospital accounts. RESULTS The study included 140 subjects (48 with DEM, 37 with CI without DEM, and 55 without CI). The MIS could not be applied to 23 illiterate subjects (16.4%). For DEM, the maximum effectiveness of the MMSE was obtained with different cutoff points as a function of educational level [k = 0.31 (95% Confidence interval [95%CI], 0.19-0.43), DA = 0.60 (95%CI, 0.52-0.68)], and that of the MIS with a cutoff of 3/4 [k = 0.63 (95%CI, 0.48-0.78), DA = 0.83 (95%CI, 0.80-0.92)]. Effectiveness of the Phototest [k = 0.71 (95%CI, 0.59-0.83), DA = 0.87 (95%CI, 0.80-0.92)] was similar to that of the MIS and higher than that of the MMSE. Costs were higher with MMSE (275.9 ± 193.3€ [mean ± sd euros]) than with Phototest (208.2 ± 196.8€) or MIS (201.3 ± 193.4€), whose costs did not significantly differ. For CI, the effectiveness did not significantly differ between MIS [k = 0.59 (95%CI, 0.45-0.74), DA = 0.79 (95%CI, 0.64-0.97)] and Phototest [k = 0.58 (95%CI, 0.45-0.74), DA = 0.78 (95%CI, 0.64-0.95)] and was lowest for the MMSE [k = 0.27 (95%CI, 0.09-0.45), DA = 0.69 (95%CI, 0.56-0.84)]. Costs were higher for MMSE (393.4 ± 121.8€) than for Phototest (287.0 ± 197.4€) or MIS (300.1 ± 165.6€), whose costs did not significantly differ. CONCLUSION MMSE is not an effective instrument in our setting. For both DEM and CI, the Phototest and MIS are more effective and less costly, with no difference between them. However, MIS could not be applied to the appreciable percentage of our population who were illiterate.
Resumo:
BACKGROUND Available screening tests for dementia are of limited usefulness because they are influenced by the patient's culture and educational level. The Eurotest, an instrument based on the knowledge and handling of money, was designed to overcome these limitations. The objective of this study was to evaluate the diagnostic accuracy of the Eurotest in identifying dementia in customary clinical practice. METHODS A cross-sectional, multi-center, naturalistic phase II study was conducted. The Eurotest was administered to consecutive patients, older than 60 years, in general neurology clinics. The patients' condition was classified as dementia or no dementia according to DSM-IV diagnostic criteria. We calculated sensitivity (Sn), specificity (Sp) and area under the ROC curves (aROC) with 95% confidence intervals. The influence of social and educational factors on scores was evaluated with multiple linear regression analysis, and the influence of these factors on diagnostic accuracy was evaluated with logistic regression. RESULTS Sixteen neurologists recruited a total of 516 participants: 101 with dementia, 380 without dementia, and 35 who were excluded. Of the 481 participants who took the Eurotest, 38.7% were totally or functionally illiterate and 45.5% had received no formal education. Mean time needed to administer the test was 8.2+/-2.0 minutes. The best cut-off point was 20/21, with Sn = 0.91 (0.84-0.96), Sp = 0.82 (0.77-0.85), and aROC = 0.93 (0.91-0.95). Neither the scores on the Eurotest nor its diagnostic accuracy were influenced by social or educational factors. CONCLUSION This naturalistic and pragmatic study shows that the Eurotest is a rapid, simple and useful screening instrument, which is free from educational influences, and has appropriate internal and external validity.
Resumo:
BACKGROUND: The elderly population is particularly at risk for developing vitamin B12-deficiency. Serum cobalamin does not necessarily reflect a normal B12 status. The determination of methylmalonic acid is not available in all laboratories. Issues of sensitivity for holotranscobalamin and the low specificity of total homocysteine limit their utility. The aim of the present study is to establish a diagnostic algorithm by using a combination of these markers in place of a single measurement. METHODS: We compared the diagnostic efficiency of these markers for detection of vitamin B12 deficiency in a population (n = 218) of institutionalized elderly (median age 80 years). Biochemical, haematological and morphological data were used to categorize people with or without vitamin B12 deficiency. RESULTS: In receiver operating curves characteristics for detection on vitamin B12 deficiency using single measurements, serum folate has the greatest area under the curve (0.87) and homocysteine the lowest (0.67). The best specificity was observed for erythrocyte folate and methylmalonic acid (100% for both) but their sensitivity was very low (17% and 53%, respectively). The highest sensitivity was observed for homocysteine (81%) and serum folate (74%). When we combined these markers, starting with serum and erythrocyte folate, followed by holotranscobalamin and ending by methylmalonic acid measurements, the overall sensitivity and specificity of the algorithm were 100% and 90%, respectively. CONCLUSION: The proposed algorithm, which combines erythrocyte folate, serum folate, holotranscobalamin and methylmalonic acid, but eliminate B12 and tHcy measurements, is a useful alternative for vitamin B12 deficiency screening in an elderly institutionalized cohort.