A Validation Study for the Use of ROS1 Immunohistochemical Staining in Screening for ROS1 Translocations in Lung Cancer

INTRODUCTION: The presence of ROS proto-oncogene 1, receptor tyrosine kinase gene (ROS1) rearrangements in lung cancers confers sensitivity to ROS kinase inhibitors, including crizotinib. However, they are rare abnormalities (in ∼1% of non-small cell lung carcinomas) that are typically identified by fluorescence in situ hybridization (FISH), and so screening using immunohistochemical (IHC) staining would be both cost- and time-efficient.

METHODS: A cohort of lung tumors negative for other common mutations related to targeted therapies were screened to assess the sensitivity and specificity of IHC staining in detecting ROS1 gene rearrangements, enriched by four other cases first identified by FISH. A review of published data was also undertaken.

RESULTS: IHC staining was 100% sensitive (95% confidence interval: 48-100) and 83% specific (95% confidence interval: 86-100) overall when an h-score higher than 100 was used. Patients with ROS1 gene rearrangements were younger and typically never-smokers, with the tumors all being adenocarcinomas with higher-grade architectural features and focal signet ring morphologic features (two of five). Four patients treated with crizotinib showed a partial response, with three also showing a partial response to pemetrexed. Three of four patients remain alive at 13, 27, and 31 months, respectively.

CONCLUSION: IHC staining can be used to screen for ROS1 gene rearrangements, with patients herein showing a response to crizotinib. Patients with tumors that test positive according to IHC staining but negative according to FISH were also identified, which may have implications for treatment selection.

Montreal Cognitive Assessment (MoCA): validation study for vascular dementia

The Montreal Cognitive Assessment (MoCA) is a brief instrument developed for the screening of milder forms of cognitive impairment, having surpassed the well-known limitations of the MMSE. The aim of the present study was to validate the MoCA as well as its short version, which was proposed by the NINDS-CSN VCI Harmonization Standards for screening Vascular Dementia (VaD) patients. The results, based on a homogeneous sample of 34 VaD patients, indicate that the MoCA is a psychometrically valid and reliable instrument for cognitive screening in VaD patients, showing excellent discriminant validity. Both the full and short versions of the MoCA had excellent diagnostic accuracy in discriminating VaD patients, exhibiting an area under curve (AUC) higher than the MMSE [AUC(MoCA full version) = .950; 95% IC = .868-.988; AUC(MoCA short version) = .936; 95% IC = .849-.981; AUC(MMSE) = .860; 95% IC = .754-.932]. With a cutoff below 17 on the MoCA full version and 8 on the short version, the results for sensitivity, specificity, positive and negative predictive values, and classification accuracy were superior compared to the MMSE. In conclusion, both versions of the MoCA are valid, reliable, sensitive and accurate screening instruments for VaD patients.

Cancer appetite and symptom questionnaire (CASQ) for brazilian patients: Cross-cultural adaptation and validation study

Background: Appetite and symptoms, conditions generally reported by the patients with cancer, are somewhat challenging for professionals to measure directly in clinical routine (latent conditions). Therefore, specific instruments are required for this purpose. This study aimed to perform a cultural adaptation of the Cancer Appetite and Symptom Questionnaire (CASQ), into Portuguese and evaluate its psychometric properties on a sample of Brazilian cancer patients. Methods: This is a validation study with Brazilian cancer patients. The face, content, and construct (factorial and convergent) validities of the Cancer Appetite and Symptom Questionnaire, the study tool, were estimated. Further, a confirmatory factor analysis (CFA) was conducted. The ratio of chi-square and degrees of freedom (χ2/df), comparative fit index (CFI), goodness of fit index (GFI) and root mean square error of approximation (RMSEA) were used for fit model assessment. In addition, the reliability of the instrument was estimated using the composite reliability (CR) and Cronbach’s alpha coefficient (α), and the invariance of the model in independent samples was estimated by a multigroup analysis (Δχ2). Results: Participants included 1,140 cancer patients with a mean age of 53.95 (SD = 13.25) years; 61.3% were women. After the CFA of the original CASQ structure, 2 items with inadequate factor weights were removed. Four correlations between errors were included to provide adequate fit to the sample (χ2/df = 8.532, CFI = .94, GFI = .95, and RMSEA = .08). The model exhibited a low convergent validity (AVE = .32). The reliability was adequate (CR = .82 α = .82). The refined model showed strong invariance in two independent samples (Δχ2: λ: p = .855; i: p = .824; Res: p = .390). A weak stability was obtained between patients undergoing chemotherapy and radiotherapy (Δχ2: λ: p = .155; i: p < .001; Res: p < .001), and between patients undergoing chemotherapy combined with radiotherapy and palliative care (Δχ2: λ: p = .058; i: p < .001; Res: p < .001). Conclusion: The Portuguese version of the CASQ had good face and construct validity and reliability. However, the CASQ still presented invariance in independent samples of Brazilian patients with cancer. However, the tool has low convergent validity and weak invariance in samples with different treatments.

VALIDATION STUDY OF HEALTH BELIEFS SCALE

Introduction: The Health Belief Scale is a questionnaire used to assess a wide range of beliefs related to health. The objective of this study was to undertake construction and culturally adapt the Health Belief Scale (HBS) to the Portuguese language and to test its reliability and validity. Methods: This new version was obtained with forward/backward translations, consensus panels and a pre-test, having been inspired by some of the items from “Canada’s Health Promotion Survey” and the “European Health and Behaviour Survey”, with the inclusion of new items about food-related beliefs. The Portuguese version of Health Belief Scale and a form for the characteristics of the participants were applied to 849 Portuguese adolescents. Results: Reliability was good with a Cronbach’s alpha coeficient of 0.867, and an intraclass correlation coeficient (ICC) of 0.95. Corrected item-total coeficients ranged from 0.301 to 0.620 and weighted kappa coeficients ranged from 0.72 to 0.93 for the total scale items. We obtained a scale composed of 13 items divided into ive factors (smoking and alcohol belief, food belief, sexual belief, physical and sporting belief, and social belief), which explain 57.97% of the total variance. Conclusions: The scale exhibited suitable psychometric properties, in terms of internal consistency, reproducibility and construct validity. It can be used in various areas of research.

Portuguese version of the Tilburg Frailty Indicator: Transcultural adaptation and psychometric validation

Artigo científico disponível actualmente em Early View (Online Version of Record published before inclusion in an issue)

Validation of a case definition for leptospirosis diagnosis in patients with acute severe febrile disease admitted in reference hospitals at the State of Pernambuco, Brazil

INTRODUCTION: Leptospirosis is often mistaken for other acute febrile illnesses because of its nonspecific presentation. Bacteriologic, serologic, and molecular methods have several limitations for early diagnosis: technical complexity, low availability, low sensitivity in early disease, or high cost. This study aimed to validate a case definition, based on simple clinical and laboratory tests, that is intended for bedside diagnosis of leptospirosis among hospitalized patients. METHODS: Adult patients, admitted to two reference hospitals in Recife, Brazil, with a febrile illness of less than 21 days and with a clinical suspicion of leptospirosis, were included to test a case definition comprising ten clinical and laboratory criteria. Leptospirosis was confirmed or excluded by a composite reference standard (microscopic agglutination test, ELISA, and blood culture). Test properties were determined for each cutoff number of the criteria from the case definition. RESULTS: Ninety seven patients were included; 75 had confirmed leptospirosis and 22 did not. Mean number of criteria from the case definition that were fulfilled was 7.8±1.2 for confirmed leptospirosis and 5.9±1.5 for non-leptospirosis patients (p<0.0001). Best sensitivity (85.3%) and specificity (68.2%) combination was found with a cutoff of 7 or more criteria, reaching positive and negative predictive values of 90.1% and 57.7%, respectively; accuracy was 81.4%. CONCLUSIONS: The case definition, for a cutoff of at least 7 criteria, reached average sensitivity and specificity, but with a high positive predictive value. Its simplicity and low cost make it useful for rapid bedside leptospirosis diagnosis in Brazilian hospitalized patients with acute severe febrile disease.

Electroencephalographic source imaging: a prospective study of 152 operated epileptic patients.

Electroencephalography is mandatory to determine the epilepsy syndrome. However, for the precise localization of the irritative zone in patients with focal epilepsy, costly and sometimes cumbersome imaging techniques are used. Recent small studies using electric source imaging suggest that electroencephalography itself could be used to localize the focus. However, a large prospective validation study is missing. This study presents a cohort of 152 operated patients where electric source imaging was applied as part of the pre-surgical work-up allowing a comparison with the results from other methods. Patients (n = 152) with >1 year postoperative follow-up were studied prospectively. The sensitivity and specificity of each imaging method was defined by comparing the localization of the source maximum with the resected zone and surgical outcome. Electric source imaging had a sensitivity of 84% and a specificity of 88% if the electroencephalogram was recorded with a large number of electrodes (128-256 channels) and the individual magnetic resonance image was used as head model. These values compared favourably with those of structural magnetic resonance imaging (76% sensitivity, 53% specificity), positron emission tomography (69% sensitivity, 44% specificity) and ictal/interictal single-photon emission-computed tomography (58% sensitivity, 47% specificity). The sensitivity and specificity of electric source imaging decreased to 57% and 59%, respectively, with low number of electrodes (<32 channels) and a template head model. This study demonstrated the validity and clinical utility of electric source imaging in a large prospective study. Given the low cost and high flexibility of electroencephalographic systems even with high channel counts, we conclude that electric source imaging is a highly valuable tool in pre-surgical epilepsy evaluation.

Validation and clinical use of the CECA, a disease-specific quality of life questionnaire for patients with anogenital Condylomata Acuminata

The aim of this validation study was to assess the measurement properties of the CECA (Spanish acronym for the Specific Questionnaire for Condylomata Acuminata) in patients with anogenital condylomas. A total of 247 patients aged > 18 years completed the questionnaire on 2 occasions as well as the Dermatology Life Quality Index (DLQI). The CECA questionnaire showed good internal consistency (Cronbach's alpha values of 0.86 and 0.91 in the emotional and sexual activity dimensions) and good testretest reliability (intraclass correlation coefficient 0.76 emotional dimension, 0.82 sexual activity dimension). Patients with de novo lesions and those with more extensive lesions and larger number of warts showed poorer health-related quality of life. CECA and DLQI scores correlated moderately. Patients whose lesions cleared at follow-up or with a reduction of >or= 50% showed a better improvement of health-related quality of life. The CECA questionnaire is a valid, reliable and sensitive tool for the assessment of health-related quality of life in patients with anogenital warts.

Predictive ability of an early diagnostic guess in patients presenting with chest pain; a longitudinal descriptive study.

ABSTRACT: BACKGROUND: The intuitive early diagnostic guess could play an important role in reaching a final diagnosis. However, no study to date has attempted to quantify the importance of general practitioners' (GPs) ability to correctly appraise the origin of chest pain within the first minutes of an encounter. METHODS: The validation study was nested in a multicentre cohort study with a one year follow-up and included 626 successive patients who presented with chest pain and were attended by 58 GPs in Western Switzerland. The early diagnostic guess was assessed prior to a patient's history being taken by a GP and was then compared to a diagnosis of chest pain observed over the next year. RESULTS: Using summary measures clustered at the GP's level, the early diagnostic guess was confirmed by further investigation in 51.0% (CI 95%; 49.4% to 52.5%) of patients presenting with chest pain. The early diagnostic guess was more accurate in patients with a life threatening illness (65.4%; CI 95% 64.5% to 66.3%) and in patients who did not feel anxious (62.9%; CI 95% 62.5% to 63.3%). The predictive abilities of an early diagnostic guess were consistent among GPs. CONCLUSIONS: The GPs early diagnostic guess was correct in one out of two patients presenting with chest pain. The probability of a correct guess was higher in patients with a life-threatening illness and in patients not feeling anxious about their pain.

Development and validation of a self-report version of the Spinal Cord Independence Measure (SCIM III).

Study design:Cross-sectional validation study.Objectives:To develop and validate a self-report version of the Spinal Cord Independence Measure (SCIM III).Setting:Two SCI rehabilitation facilities in Switzerland.Methods:SCIM III comprises 19 questions on daily tasks with a total score between 0 and 100 and subscales for 'self-care', 'respiration & sphincter management' and 'mobility'. A self-report version (SCIM-SR) was developed by expert discussions and pretests in individuals with spinal cord injury (SCI) using a German translation. A convenience sample of 99 inpatients with SCI was recruited. SCIM-SR data were analyzed together with SCIM III data obtained from attending health professionals.Results:High correlations between SCIM III and SCIM-SR were observed. Pearson's r for the total score was 0.87 (95% confidence interval (CI) 0.82-0.91), for the subscales self-care 0.87 (0.81-0.91); respiration & sphincter management 0.81 (0.73-0.87); and mobility 0.87 (0.82-0.91). Intraclass correlations were: total score 0.90 (95% CI 0.85-0.93); self-care 0.86 (0.79-0.90); respiration & sphincter management 0.80 (0.71-0.86); and mobility 0.83 (0.76-0.89). Bland-Altman plots showed that patients rated their functioning higher than professionals, in particular for mobility. The mean difference between SCIM-SR and SCIM III for the total score was 5.14 (point estimate 95% CI 2.95-7.34), self-care 0.89 (0.19-1.59), respiration & sphincter management 1.05 (0.18-2.28 ) and mobility 3.49 (2.44-4.54). Particularly patients readmitted because of pressure sores rated their independence higher than attending professionals.Conclusion:Our results support the criterion validity of SCIM-SR. The self-report version may facilitate long-term evaluations of independence in persons with SCI in their home situation.

Calibration and Validation of SWAT for the Upper Maquoketa River Watershed, June 2005

A validation study has been performed using the Soil and Water Assessment Tool (SWAT) model with data collected for the Upper Maquoketa River Watershed (UMRW), which drains over 16,000 ha in northeast Iowa. This validation assessment builds on a previous study with nested modeling for the UMRW that required both the Agricultural Policy EXtender (APEX) model and SWAT. In the nested modeling approach, edge-offield flows and pollutant load estimates were generated for manure application fields with APEX and were then subsequently routed to the watershed outlet in SWAT, along with flows and pollutant loadings estimated for the rest of the watershed routed to the watershed outlet. In the current study, the entire UMRW cropland area was simulated in SWAT, which required translating the APEX subareas into SWAT hydrologic response units (HRUs). Calibration and validation of the SWAT output was performed by comparing predicted flow and NO3-N loadings with corresponding in-stream measurements at the watershed outlet from 1999 to 2001. Annual stream flows measured at the watershed outlet were greatly under-predicted when precipitation data collected within the watershed during the 1999-2001 period were used to drive SWAT. Selection of alternative climate data resulted in greatly improved average annual stream predictions, and also relatively strong r2 values of 0.73 and 0.72 for the predicted average monthly flows and NO3-N loads, respectively. The impact of alternative precipitation data shows that as average annual precipitation increases 19%, the relative change in average annual streamflow is about 55%. In summary, the results of this study show that SWAT can replicate measured trends for this watershed and that climate inputs are very important for validating SWAT and other water quality models.

PACIC Instrument: disentangling dimensions using published validation models.

OBJECTIVE: To better understand the structure of the Patient Assessment of Chronic Illness Care (PACIC) instrument. More specifically to test all published validation models, using one single data set and appropriate statistical tools. DESIGN: Validation study using data from cross-sectional survey. PARTICIPANTS: A population-based sample of non-institutionalized adults with diabetes residing in Switzerland (canton of Vaud). MAIN OUTCOME MEASURE: French version of the 20-items PACIC instrument (5-point response scale). We conducted validation analyses using confirmatory factor analysis (CFA). The original five-dimension model and other published models were tested with three types of CFA: based on (i) a Pearson estimator of variance-covariance matrix, (ii) a polychoric correlation matrix and (iii) a likelihood estimation with a multinomial distribution for the manifest variables. All models were assessed using loadings and goodness-of-fit measures. RESULTS: The analytical sample included 406 patients. Mean age was 64.4 years and 59% were men. Median of item responses varied between 1 and 4 (range 1-5), and range of missing values was between 5.7 and 12.3%. Strong floor and ceiling effects were present. Even though loadings of the tested models were relatively high, the only model showing acceptable fit was the 11-item single-dimension model. PACIC was associated with the expected variables of the field. CONCLUSIONS: Our results showed that the model considering 11 items in a single dimension exhibited the best fit for our data. A single score, in complement to the consideration of single-item results, might be used instead of the five dimensions usually described.

Development and validation of a symptom-based activity index for adults with eosinophilic esophagitis.

BACKGROUND & AIMS: Standardized instruments are needed to assess the activity of eosinophilic esophagitis (EoE) and to provide end points for clinical trials and observational studies. We aimed to develop and validate a patient-reported outcome (PRO) instrument and score, based on items that could account for variations in patient assessments of disease severity. We also evaluated relationships between patient assessment of disease severity and EoE-associated endoscopic, histologic, and laboratory findings. METHODS: We collected information from 186 patients with EoE in Switzerland and the United States (69.4% male; median age, 43 y) via surveys (n = 135), focus groups (n = 27), and semistructured interviews (n = 24). Items were generated for the instruments to assess biologic activity based on physician input. Linear regression was used to quantify the extent to which variations in patient-reported disease characteristics could account for variations in patient assessment of EoE severity. The PRO instrument was used prospectively in 153 adult patients with EoE (72.5% male; median age, 38 y), and validated in an independent group of 120 patients with EoE (60.8% male; median age, 40.5 y). RESULTS: Seven PRO factors that are used to assess characteristics of dysphagia, behavioral adaptations to living with dysphagia, and pain while swallowing accounted for 67% of the variation in patient assessment of disease severity. Based on statistical consideration and patient input, a 7-day recall period was selected. Highly active EoE, based on endoscopic and histologic findings, was associated with an increase in patient-assessed disease severity. In the validation study, the mean difference between patient assessment of EoE severity (range, 0-10) and PRO score (range, 0-8.52) was 0.15. CONCLUSIONS: We developed and validated an EoE scoring system based on 7 PRO items that assess symptoms over a 7-day recall period. Clinicaltrials.gov number: NCT00939263.

Comparison and validation of tissue modelization and statistical classification methods in T1-weighted MR brain images.

This paper presents a validation study on statistical nonsupervised brain tissue classification techniques in magnetic resonance (MR) images. Several image models assuming different hypotheses regarding the intensity distribution model, the spatial model and the number of classes are assessed. The methods are tested on simulated data for which the classification ground truth is known. Different noise and intensity nonuniformities are added to simulate real imaging conditions. No enhancement of the image quality is considered either before or during the classification process. This way, the accuracy of the methods and their robustness against image artifacts are tested. Classification is also performed on real data where a quantitative validation compares the methods' results with an estimated ground truth from manual segmentations by experts. Validity of the various classification methods in the labeling of the image as well as in the tissue volume is estimated with different local and global measures. Results demonstrate that methods relying on both intensity and spatial information are more robust to noise and field inhomogeneities. We also demonstrate that partial volume is not perfectly modeled, even though methods that account for mixture classes outperform methods that only consider pure Gaussian classes. Finally, we show that simulated data results can also be extended to real data.