Receiver operating characteristic (ROC) curve for classification of18F-NaF uptake on PET/CT

Abstract Objective: To assess the cutoff values established by ROC curves to classify18F-NaF uptake as normal or malignant. Materials and Methods: PET/CT images were acquired 1 hour after administration of 185 MBq of18F-NaF. Volumes of interest (VOIs) were drawn on three regions of the skeleton as follows: proximal right humerus diaphysis (HD), proximal right femoral diaphysis (FD) and first vertebral body (VB1), in a total of 254 patients, totalling 762 VOIs. The uptake in the VOIs was classified as normal or malignant on the basis of the radiopharmaceutical distribution pattern and of the CT images. A total of 675 volumes were classified as normal and 52 were classified as malignant. Thirty-five VOIs classified as indeterminate or nonmalignant lesions were excluded from analysis. The standardized uptake value (SUV) measured on the VOIs were plotted on an ROC curve for each one of the three regions. The area under the ROC (AUC) as well as the best cutoff SUVs to classify the VOIs were calculated. The best cutoff values were established as the ones with higher result of the sum of sensitivity and specificity. Results: The AUCs were 0.933, 0.889 and 0.975 for UD, FD and VB1, respectively. The best SUV cutoffs were 9.0 (sensitivity: 73%; specificity: 99%), 8.4 (sensitivity: 79%; specificity: 94%) and 21.0 (sensitivity: 93%; specificity: 95%) for UD, FD and VB1, respectively. Conclusion: The best cutoff value varies according to bone region of analysis and it is not possible to establish one value for the whole body.

Schizophrenia in males of cognitive performance: discriminative and diagnostic values

OBJECTIVE: To evaluate the discriminative and diagnostic values of neuropsychological tests for identifying schizophrenia patients. METHODS: A cross-sectional study with 36 male schizophrenia outpatients and 72 healthy matched volunteers was carried out. Participants underwent the following neuropsychological tests: Wisconsin Card Sorting test, Verbal Fluency, Stroop test, Mini Mental State Examination, and Spatial Recognition Span. Sensitivity and specificity estimated the diagnostic value of tests with cutoffs obtained using Receiver Operating Characteristic curves. The latent class model (diagnosis of schizophrenia) was used as gold standard. RESULTS: Although patients presented lower scores in most tests, the highest canonical function for the discriminant analysis was 0.57 (Verbal Fluency M). The best sensitivity and specificity were obtained in the Verbal Fluency M test (75 and 65, respectively). CONCLUSIONS: The neuropsychological tests showed moderate diagnostic value for the identification of schizophrenia patients. These findings suggested that the cognitive impairment measured by these tests might not be homogeneous among schizophrenia patients.

Diagnosing dementia and normal aging: clinical relevance of brain ratios and cognitive performance in a Brazilian sample

The main objective of the present study was to evaluate the diagnostic value (clinical application) of brain measures and cognitive function. Alzheimer and multiinfarct patients (N = 30) and normal subjects over the age of 50 (N = 40) were submitted to a medical, neurological and cognitive investigation. The cognitive tests applied were Mini-Mental, word span, digit span, logical memory, spatial recognition span, Boston naming test, praxis, and calculation tests. The brain ratios calculated were the ventricle-brain, bifrontal, bicaudate, third ventricle, and suprasellar cistern measures. These data were obtained from a brain computer tomography scan, and the cutoff values from receiver operating characteristic curves. We analyzed the diagnostic parameters provided by these ratios and compared them to those obtained by cognitive evaluation. The sensitivity and specificity of cognitive tests were higher than brain measures, although dementia patients presented higher ratios, showing poorer cognitive performances than normal individuals. Normal controls over the age of 70 presented higher measures than younger groups, but similar cognitive performance. We found diffuse losses of tissue from the central nervous system related to distribution of cerebrospinal fluid in dementia patients. The likelihood of case identification by functional impairment was higher than when changes of the structure of the central nervous system were used. Cognitive evaluation still seems to be the best method to screen individuals from the community, especially for developing countries, where the cost of brain imaging precludes its use for screening and initial assessment of dementia.

Selection of patients for myocardial perfusion scintigraphy based on fuzzy sets theory applied to clinical-epidemiological data and treadmill test results

Coronary artery disease (CAD) is a worldwide leading cause of death. The standard method for evaluating critical partial occlusions is coronary arteriography, a catheterization technique which is invasive, time consuming, and costly. There are noninvasive approaches for the early detection of CAD. The basis for the noninvasive diagnosis of CAD has been laid in a sequential analysis of the risk factors, and the results of the treadmill test and myocardial perfusion scintigraphy (MPS). Many investigators have demonstrated that the diagnostic applications of MPS are appropriate for patients who have an intermediate likelihood of disease. Although this information is useful, it is only partially utilized in clinical practice due to the difficulty to properly classify the patients. Since the seminal work of Lotfi Zadeh, fuzzy logic has been applied in numerous areas. In the present study, we proposed and tested a model to select patients for MPS based on fuzzy sets theory. A group of 1053 patients was used to develop the model and another group of 1045 patients was used to test it. Receiver operating characteristic curves were used to compare the performance of the fuzzy model against expert physician opinions, and showed that the performance of the fuzzy model was equal or superior to that of the physicians. Therefore, we conclude that the fuzzy model could be a useful tool to assist the general practitioner in the selection of patients for MPS.

Artificial neural network models for predicting 1-year mortality in elderly patients with intertrochanteric fractures in China

The mortality rate of older patients with intertrochanteric fractures has been increasing with the aging of populations in China. The purpose of this study was: 1) to develop an artificial neural network (ANN) using clinical information to predict the 1-year mortality of elderly patients with intertrochanteric fractures, and 2) to compare the ANN's predictive ability with that of logistic regression models. The ANN model was tested against actual outcomes of an intertrochanteric femoral fracture database in China. The ANN model was generated with eight clinical inputs and a single output. ANN's performance was compared with a logistic regression model created with the same inputs in terms of accuracy, sensitivity, specificity, and discriminability. The study population was composed of 2150 patients (679 males and 1471 females): 1432 in the training group and 718 new patients in the testing group. The ANN model that had eight neurons in the hidden layer had the highest accuracies among the four ANN models: 92.46 and 85.79% in both training and testing datasets, respectively. The areas under the receiver operating characteristic curves of the automatically selected ANN model for both datasets were 0.901 (95%CI=0.814-0.988) and 0.869 (95%CI=0.748-0.990), higher than the 0.745 (95%CI=0.612-0.879) and 0.728 (95%CI=0.595-0.862) of the logistic regression model. The ANN model can be used for predicting 1-year mortality in elderly patients with intertrochanteric fractures. It outperformed a logistic regression on multiple performance measures when given the same variables.

Prospective assessment of different indices of cardiac risk for patients undergoing noncardiac surgeries

OBJECTIVE: To compare the accuracy of 4 different indices of cardiac risk currently used for predicting perioperative cardiac complications. METHODS: We studied 119 patients at a university-affiliated hospital whose cardiac assessment had been required for noncardiac surgery. Predictive factors of high risk for perioperative cardiac complications were assessed through clinical history and physical examination, and the patients were followed up after surgery until the 4th postoperative day to assess the occurrence of cardiac events. All patients were classified according to 4 indices of cardiac risk: the Goldman risk-factor index, Detsky modified risk index, Larsen index, and the American Society of Anesthesiologists' physical status classification and their compared accuracies, examining the areas under their respective receiver operating characteristic (ROC) curves. RESULTS: Cardiac complications occurred in 16% of the patients. The areas under the ROC curves were equal for the Goldman risk-factor index, the Larsen index, and the American Society of Anesthesiologists' physical status classification: 0.48 (SEM ± 0.03). For the Detsky index, the value found was 0.38 (SEM ± 0.03). This difference in the values was not statistically significant. CONCLUSION: The cardiac risk indices currently used did not show a better accuracy than that obtained randomly. None of the indices proved to be significantly better than the others. Studies to improve our ability to predict such complications are still required.

Modelagem de probabilidade de churn

Clientes podem abandonar uma organização ainda que altos investimentos em prospecção e retenção sejam realizados, o que requer diagnóstico e compreensão. Este artigo objetiva modelar a probabilidade de clientes abandonarem o relacionamento com uma organização, fenômeno conhecido como churn, utilizando dados do histórico de relacionamento cliente/empresa, validar o modelo em uma segunda amostra e descrever as possíveis variáveis que influenciam o abandono/permanência do cliente. Utilizou-se o modelo de regressão logística em uma amostra de calibração de 70.000 clientes que possuíam cartão de crédito próprio de uma grande rede varejista. Dezesseis variáveis explicativas (14 características individuais e duas variáveis comportamentais) foram usadas e o modelo foi validado em uma amostra de 30.000 clientes, usando-se o teste de KS (Kolmogorov-Smirnov) e a curva ROC (Receiver Operating Characteristic), que demonstraram a boa adequação do modelo à amostra de validação. Implicações da pesquisa e sugestões para futuras investigações são discutidas à luz da gestão do relacionamento com o cliente.

Valor preditivo do "Clinical Risk Index for Babies" para o risco de mortalidade neonatal

OBJETIVO: Comparar o valor preditivo do CRIB (Clinical Risk Index for Babies) para o risco de mortalidade neonatal ao peso de nascimento (PN) e idade gestacional (IG). MÉTODO: Numa coorte prospectiva foram estudados, durante o ano de 1996, 71 recém-nascidos admitidos na unidade de terapia intensiva, com PN < 1.500 g e/ou IG < 31 semanas. RESULTADOS: A taxa de mortalidade foi de 29,6%; para PN < 1.000 g ou IG < 29 semanas foi de 60%, enquanto que para o escore de CRIB > 10 foi de 100%. CONCLUSÕES: O escore de CRIB > 10 correspondeu a maiores especificidade e valor preditivo positivo em relação aos demais parâmetros. A área determinada pela "receiver operating characteristic" relativa ao CRIB também foi superior. O CRIB mostrou-se um marcador mais acurado na previsão de risco de mortalidade quando comparado ao PN ou IG isoladamente.

Usefulness of corneal esthesiometry for screening diabetic retinopathy

OBJECTIVE: To assess the usefulness of corneal esthesiometry for screening diabetic retinopathy. METHODS: A cross-sectional study was carried out comprising 575 patients attending a diabetic retinopathy-screening program in the city of São Paulo. Corneal esthesiometry was assessed with the Cochet-Bonnet esthesiometer. The presence of diabetic retinopathy was detected with indirect fundoscopy. The validity of corneal esthesiometry in identifying diabetic retinopathy was evaluated by the Receiver Operating Characteristic (ROC) curve. RESULTS: Sensitivity and specificity analyses of the corneal esthesiometry for detecting the stages of diabetic retinopathy using different cut-offs showed values less than 80%. The best indices (72.2% sensitivity and 57.4% specificity) were obtained for the identification of patients with proliferative diabetic retinopathy. CONCLUSIONS: In the study series, corneal esthesiometry was not a good indicator of diabetic retinopathy.

Estimativa de validade de um novo método de isolamento de vírus rábico

OBJETIVOS: Nenhum estudo de base populacional foi realizado para mostrar o uso potencial de diagnóstico virológico do vírus rábico. O estudo realizado teve por objetivo estimar parâmetros de acurácia para o isolamento de vírus rábico em célula McCoy, como um método alternativo, e comparar com o uso da célula N2A, considerada método de referência. MÉTODOS: Foi realizado um inquérito em 120 morcegos coletados aleatoriamente, na Mata Atlântica, no Estado de São Paulo. Utilizou-se a reação de imunofluorescência para a detecção do vírus rábico isolado no cérebro desses morcegos, avaliado nos dois sistemas de cultivos celulares. Dois bancos de dados foram formados com os resultados. A análise foi feita com o programa Computer Methods for Diagnosis Tests (CMDT), utilizando a técnica de two-graph-receiver operating characteristic (TG-ROC) para obter os parâmetros de sensibilidade e especificidade, além de outros indicadores, tais como eficácia, valor preditivo positivo, valor preditivo negativo e razão de verossimilhança. RESULTADOS: A célula N2A apresentou 90% de sensibilidade e especificidade, enquanto que a célula McCoy obteve 95% para os mesmos parâmetros. Os valores foram baseados em pontos de cortes otimizados para cada uma das células. CONCLUSÕES: Observou-se que a célula McCoy permite obter estimativas de acurácia superiores aos resultados observados com a célula de N2A, representando um método alternativo eficaz no isolamento do vírus rábico.

Neonatal mortality in intensive care units of Central Brazil

OBJECTIVE: To identify potential prognostic factors for neonatal mortality among newborns referred to intensive care units. METHODS: A live-birth cohort study was carried out in Goiânia, Central Brazil, from November 1999 to October 2000. Linked birth and infant death certificates were used to ascertain the cohort of live born infants. An additional active surveillance system of neonatal-based mortality was implemented. Exposure variables were collected from birth and death certificates. The outcome was survivors (n=713) and deaths (n=162) in all intensive care units in the study period. Cox's proportional hazards model was applied and a Receiver Operating Characteristic curve was used to compare the performance of statistically significant variables in the multivariable model. Adjusted mortality rates by birth weight and 5-min Apgar score were calculated for each intensive care unit. RESULTS: Low birth weight and 5-min Apgar score remained independently associated to death. Birth weight equal to 2,500g had 0.71 accuracy (95% CI: 0.65-0.77) for predicting neonatal death (sensitivity =72.2%). A wide variation in the mortality rates was found among intensive care units (9.5-48.1%) and two of them remained with significant high mortality rates even after adjusting for birth weight and 5-min Apgar score. CONCLUSIONS: This study corroborates birth weight as a sensitive screening variable in surveillance programs for neonatal death and also to target intensive care units with high mortality rates for implementing preventive actions and interventions during the delivery period.

Validação da escala de depressão geriátrica em um ambulatório geral

OBJETIVO: A Escala de Depressão Geriátrica, utilizada para o rastreamento de sintomas depressivos em idosos, ainda não teve suas características de medida avaliadas em ambulatórios gerais no Brasil. O objetivo foi estudar a validade da Escala, com 15 itens (EDG-15), na identificação de episódio de Depressão Maior ou Distimia em idosos atendidos em ambulatório geral. MÉTODOS: A Escala foi aplicada em 302 indivíduos com 65 anos ou mais, que em seguida foram examinados, de maneira independente, por um geriatra que não tinha conhecimento dos resultados da Escala. Os diagnósticos de Depressão Maior ou Distimia foram feitos utilizando-se os critérios do Diagnostic and Statistical Manual of Mental Disorders-IV. A sensibilidade e a especificidade nos vários pontos de corte foram expressas pela curva Receiver Operating Characteristic. RESULTADOS: O ponto de corte de melhor equilíbrio foi 5/6, obteve sensibilidade de 81% e especificidade de 71%; e o valor da área sob a curva Receiver Operating Characteristic foi de 0,85 (IC 95%: 0,79-0,91). CONCLUSÕES: A Escala de Depressão Geriátrica pode ser utilizada para o rastreamento de sintomas depressivos na população geriátrica ambulatorial brasileira. O ponto de corte 5/6, sugerido inicialmente por outros autores, mostrou-se adequado.

Comorbidity adjustment index for the international classification of diseases, 10

OBJECTIVE: To develop a Charlson-like comorbidity index based on clinical conditions and weights of the original Charlson comorbidity index. METHODS: Clinical conditions and weights were adapted from the International Classification of Diseases, 10th revision and applied to a single hospital admission diagnosis. The study included 3,733 patients over 18 years of age who were admitted to a public general hospital in the city of Rio de Janeiro, southeast Brazil, between Jan 2001 and Jan 2003. The index distribution was analyzed by gender, type of admission, blood transfusion, intensive care unit admission, age and length of hospital stay. Two logistic regression models were developed to predict in-hospital mortality including: a) the aforementioned variables and the risk-adjustment index (full model); and b) the risk-adjustment index and patient's age (reduced model). RESULTS: Of all patients analyzed, 22.3% had risk scores >1, and their mortality rate was 4.5% (66.0% of them had scores >1). Except for gender and type of admission, all variables were retained in the logistic regression. The models including the developed risk index had an area under the receiver operating characteristic curve of 0.86 (full model), and 0.76 (reduced model). Each unit increase in the risk score was associated with nearly 50% increase in the odds of in-hospital death. CONCLUSIONS: The risk index developed was able to effectively discriminate the odds of in-hospital death which can be useful when limited information is available from hospital databases.

Body mass index for predicting hyperglycemia and serum lipid changes in Brazilian adolescents

OBJECTIVE: To determine the best cut-offs of body mass index for identifying alterations of blood lipids and glucose in adolescents. METHODS: A probabilistic sample including 577 adolescent students aged 12-19 years in 2003 (210 males and 367 females) from state public schools in the city of Niterói, Southeastern Brazil, was studied. The Receiver Operating Characteristic curve was used to identify the best age-adjusted BMI cut-off for predicting high levels of serum total cholesterol (>150mg/dL), LDL-C (>100mg/dL), serum triglycerides (>100mg/dL), plasma glucose (>100mg/dL) and low levels of HDL-C (< 45mg/dL). Four references were used to calculate sensitivity and specificity of BMI cut-offs: one Brazilian, one international and two American. RESULTS: The most prevalent metabolic alterations (>50%) were: high total cholesterol and low HDL-C. BMI predicted high levels of triglycerides in males, high LDL-C in females, and high total cholesterol and the occurrence of three or more metabolic alterations in both males and females (areas under the curve range: 0.59 to 0.67), with low sensitivity (57%-66%) and low specificity (58%-66%). The best BMI cut-offs for this sample (20.3 kg/m² to 21.0 kg/m²) were lower than those proposed in the references studied. CONCLUSIONS: Although BMI values lower than the International cut-offs were better predictor of some metabolic abnormalities in Brazilian adolescents, overall BMI is not a good predictor of these abnormalities in this population.

Análise TG-ROC de testes de imunofluorescência no diagnóstico de leishmaniose visceral canina

OBJETIVO: Analisar a acurácia do diagnóstico de dois protocolos de imunofluorescência indireta para leishmaniose visceral canina. MÉTODOS: Cães provenientes de inquérito soroepidemiológico realizado em área endêmica nos municípios de Araçatuba e de Andradina, na região noroeste do estado de São Paulo, em 2003, e área não endêmica da região metropolitana de São Paulo, foram utilizados para avaliar comparativamente dois protocolos da reação de imunofluorescência indireta (RIFI) para leishmaniose: um utilizando antígeno heterólogo Leishmania major (RIFI-BM) e outro utilizando antígeno homólogo Leishmania chagasi (RIFI-CH). Para estimar acurácia utilizou-se a análise two-graph receiver operating characteristic (TG-ROC). A análise TG-ROC comparou as leituras da diluição 1:20 do antígeno homólogo (RIFI-CH), consideradas como teste referência, com as diluições da RIFI-BM (antígeno heterólogo). RESULTADOS: A diluição 1:20 do teste RIFI-CH apresentou o melhor coeficiente de contingência (0,755) e a maior força de associação entre as duas variáveis estudadas (qui-quadrado=124,3), sendo considerada a diluição-referência do teste nas comparações com as diferentes diluições do teste RIFI-BM. Os melhores resultados do RIFI-BM foram obtidos na diluição 1:40, com melhor coeficiente de contingência (0,680) e maior força de associação (qui-quadrado=80,8). Com a mudança do ponto de corte sugerido nesta análise para a diluição 1:40 da RIFI-BM, o valor do parâmetro especificidade aumentou de 57,5% para 97,7%, embora a diluição 1:80 tivesse apresentado a melhor estimativa para sensibilidade (80,2%) com o novo ponto de corte. CONCLUSÕES: A análise TG-ROC pode fornecer importantes informações sobre os testes de diagnósticos, além de apresentar sugestões sobre pontos de cortes que podem melhorar as estimativas de sensibilidade e especificidade do teste, e avaliá-los a luz do melhor custo-benefício.