Exploratory factor analysis in validation studies : Uses and recommendations

Resumen tomado de la publicaci??n

The psychometric properties of the brief Other as Shamer Scale for Children (OAS‐C) : preliminary validation studies in a sample of Portuguese children

Shame is a social emotion with adaptive functions involved in human be-havior and social interactions. This emotion is regarded as an involuntary response associated with increased self-awareness, loss of status and self-devaluation (Gilbert, 1998), that may render individuals more prone to psychopathology (Gilbert, 1998; Pinto-Gouveia & Matos, 2011). Thus, identifying and assessing feelings of shame in childhood is essential in addressing the actual impact of shame on individual’s developmental trajectory. The Other As Shamer Scale (OAS; Goss, Gilbert & Allan, 1994) is a widely used measure of external shame, adapted and translated to several languages — including Portuguese (Matos, Pinto-Gouveia, Gilbert, Duarte & Figueiredo, 2015) — to adult and to adolescent populations (OASB-A - Other As Shamer Brief for adolescents; translated and adapted by Cunha, Xavier, Cherpe & Pinto-Gouveia, 2014). The current study aims to adapt and to explore the psychometric proper-ties of the brief OAS in a sample of Portuguese children attending to elementary schools.

Validation of the WHOQOL-BREF among women following childbirth

Background: There is an increasing interest in measuring quality of life (QOL) in clinical settings and in clinical trials. None of the commonly used QOL instrument have been validated for use postnatally. Aim: To assess the psychometric properties of the 26-item WHOQOL-BREF among women following childbirth. Methods: Using a prospective cohort design we recruited 320 women within the first few days of childbirth. At six weeks postpartum, participants were asked to complete the WHOQOL-BREF, the Edinburgh Postnatal Depression Index and the Australian Unity Wellbeing Index. Validation of the WHOQOL-BREF included an analysis of internal consistency, discriminate validity, convergent validity and an examination of the domain structure. Results: 221 (69.1%) women returned their six-week questionnaire. All domains of the WHOQOL-BREF met reliability standards (alpha coefficient exceeding 0.70). The questionnaire discriminated well between known groups (depressed and non-depressed women. P = <0.000) and demonstrated satisfactory correlations with the Australian Unity Wellbeing index (r = >0.45). The domain structure of the WHOQOL-BREF was also valid in this population of new mothers, with moderate to high correlation between individual items and the domain structure to which the items were originally assigned. Conclusion: The WHOQOL-BRF is well-accepted and valid instrument in this population and may be used in postnatal clinical settings or for assessing intervention effects in research studies.

Validation of the interRAI Cognitive Performance Scale against independent clinical diagnosis and the Mini-Mental State Examination in older hospitalized patients

Objective To compare the diagnostic accuracy of the interRAI Acute Care (AC) Cognitive Performance Scale (CPS2) and the Mini-Mental State Examination (MMSE), against independent clinical diagnosis for detecting dementia in older hospitalized patients. Design, Setting, and Participants The study was part of a prospective observational cohort study of patients aged ≥70 years admitted to four acute hospitals in Queensland, Australia, between 2008 and 2010. Recruitment was consecutive and patients expected to remain in hospital for ≥48 hours were eligible to participate. Data for 462 patients were available for this study. Measurements Trained research nurses completed comprehensive geriatric assessments and administered the interRAI AC and MMSE to patients. Two physicians independently reviewed patients’ medical records and assessments to establish the diagnosis of dementia. Indicators of diagnostic accuracy included sensitivity, specificity, predictive values, likelihood ratios and areas under receiver (AUC) operating characteristic curves. Results 85 patients (18.4%) were considered to have dementia according to independent clinical diagnosis. The sensitivity of the CPS2 [0.68 (95%CI: 0.58–0.77)] was not statistically different to the MMSE [0.75 (0.64–0.83)] in predicting physician diagnosed dementia. The AUCs for the 2 instruments were also not statistically different: CPS2 AUC = 0.83 (95%CI: 0.78–0.89) and MMSE AUC = 0.87 (95%CI: 0.83–0.91), while the CPS2 demonstrated higher specificity [0.92 95%CI: 0.89–0.95)] than the MMSE [0.82 (0.77–0.85)]. Agreement between the CPS2 and clinical diagnosis was substantial (87.4%; κ=0.61). Conclusion The CPS2 appears to be a reliable screening tool for assessing cognitive impairment in acutely unwell older hospitalized patients. These findings add to the growing body of evidence supporting the utility of the interRAI AC, within which the CPS2 is embedded. The interRAI AC offers the advantage of being able to accurately screen for both dementia and delirium without the need to use additional assessments, thus increasing assessment efficiency.

Validation of back-calculation equations for juvenile bluefish (Pomatomus saltatrix) with the use of tetracycline-marked otoliths

In recent years, a decrease in the abundance of bluefish (Pomatomus saltatrix) has been observed (Fahay et al., 1999; Munch and Conover, 2000) that has led to increased interest in a better understanding the life history of the species. Estimates of several young-of-the-year (YOY) life history characteristics, including the importance and use of estuaries as nursery habitat (Kendall and Walford, 1979) and size-dependant mortality (Hare and Cowen, 1997), are reliant upon the accuracy of growth determination. By using otoliths, it is possible to use back-calculation formulae (BCFs) to estimate the length at certain ages and stages of development for many species of fishes. Use of otoliths to estimate growth in this way can provide the same information as long-term laboratory experiments and tagging studies without the time and expense of rearing or recapturing fish. The difficulty in using otoliths in this way lies in validating that 1) there is constancy in the periodicity of the increment formation, and 2) there is no uncoupling of the relationship between somatic and otolith growth. To date there are no validation studies demonstrating the relationship between otolith growth and somatic growth for bluefish. Daily increment formation in otoliths has been documented for larval (Hare and Cowen, 1994) and juvenile bluefish (Nyman and Conover, 1988). Hare and Cowen (1995) found ageindependent variability in the ratio of otolith size to body length in early age bluefish, although these differences varied between ontogenetic stages. Furthermore, there have been no studies where an evaluation of back-calculation methods has been combined with a validation of otolithderived lengths for juvenile bluefish.

Psychometric evaluation and experimental validation of the statistics anxiety rating scale.

The Statistics Anxiety Rating Scale (STARS) was adapted into German to examine its psychometric properties (n = 400). Two validation studies (n = 66, n = 96) were conducted to examine its criterion-related validity. The psychometric properties of the questionnaire were very similar to those previously reported for the original English version in various countries and other language versions. Confirmatory factor analysis indicated 2 second-order factors: One was more closely related to anxiety and the other was more closely related to negative attitudes toward statistics. Predictive validity of the STARS was shown both in an experimental exam-like situation in the laboratory and during a real examination situation. Taken together, the findings indicate that statistics anxiety as assessed by the STARS is a useful construct that is more than just an expression of a more general disposition to anxiety.

Next-generation sequencing: a change of paradigm in molecular diagnostic validation

Next-generation sequencing (NGS) is beginning to show its full potential for diagnostic and therapeutic applications. In particular, it is enunciating its capacity to contribute to a molecular taxonomy of cancer, to be used as a standard approach for diagnostic mutation detection, and to open new treatment options that are not exclusively organ-specific. If this is the case, how much validation is necessary and what should be the validation strategy, when bringing NGS into the diagnostic/clinical practice? This validation strategy should address key issues such as: what is the overall extent of the validation? Should essential indicators of test performance such as sensitivity of specificity be calculated for every target or sample type? Should bioinformatic interpretation approaches be validated with the same rigour? What is a competitive clinical turnaround time for a NGS-based test, and when does it become a cost-effective testing proposition? While we address these and other related topics in this commentary, we also suggest that a single set of international guidelines for the validation and use of NGS technology in routine diagnostics may allow us all to make a much more effective use of resources.

Digital slide viewing for primary reporting in gastrointestinal pathology: a validation study

Despite the increasing availability of digital slide viewing, and numerous advantages associated with its application, a lack of quality validation studies is amongst the reasons for poor uptake in routine practice. This study evaluated primary digital pathology reporting in the setting of routine subspecialist gastrointestinal pathology, commonplace in most tissue pathology laboratories and representing one of the highest volume specialties in most laboratories. Individual digital and glass slide diagnoses were compared amongst three pathologists reporting in a gastrointestinal subspecialty team, in a prospective series of 100 consecutive diagnostic cases from routine practice in a large teaching hospital laboratory. The study included a washout period of at least 6 months. Discordant diagnoses were classified, and the study evaluated against recent College of American Pathologists (CAP) recommendations for evaluating digital pathology systems for diagnostic use. The study design met all 12 of the CAP recommendations. The 100 study cases generated 300 pairs of diagnoses, comprising 100 glass slide diagnoses and 100 digital diagnoses from each of the three study pathologists. 286 of 300 pairs of diagnoses were concordant, representing intraobserver concordance of 95.3 %, broadly comparable to rates previously published in this field. In ten of the 14 discordant pairs, the glass slide diagnosis was favoured; in four cases, the digital diagnosis was favoured, but importantly, the 14 discordant intraobserver diagnoses were considered to be of minor clinical significance. Interobserver, or viewing modality independent, concordance was found in 94 of the total of 100 study cases, providing a comparable baseline discordance rate expected in any second viewing of pathology material. These overall results support the safe use of digital pathology in primary diagnostic reporting in this setting

Translation, cultural adaptation to Brazil and validation of the venous leg ulcer quality of life questionnaire (VLU-QoL-Br)

Objetivo:traduzir o instrumento Venous legulcer quality of life questionnaire (VLU-QoL), adaptá-lo culturalmente para o português do Brasil e validá-lo com pacientes do Hospital das Clínicas da Faculdade de Medicina de Botucatu (FMB) da Universidade Estadual Paulista (Unesp). Métodos:o questionário foi traduzido por um tradutor profissional e por dois dermatologistas especialistas na área de úlceras venosas (UV), sendo reformulado em reunião com os três tradutores. O constructo (VLU-QoL-Br) foi submetido a pré-entrevista com 10 portadores de UV para a adaptação da linguagem. Posteriormente, foi aplicado em pacientes do HC-Unesp, e como teste-reteste para verificação de sua reprodutibilidade. Resultados:foram avaliados 82 pacientes, sendo 56 (68%) do sexo feminino. A idade média foi de 67,3 anos. O questionário foi traduzido, adaptado e aplicado aos pacientes. O constructo apresentou alta consistência interna (alfa= 0,94) e adequada correlação item-total. Quando avaliados os 32 retestes, observou-se correlação intraclasse para concordância de 0,78 (p < 0,01), indicando boa reprodutibilidade do constructo. A análise fatorial confirmatória corroborou as dimensões do questionário original: atividades, psicológico e sintomas. Escores do VLU-QoL-Br se associaram, independentemente, à área total das úlceras e a menor escolaridade dos sujeitos (p < 0,01). Conclusão:a tradução, a adaptação e a validação do questionário VLU-Qol-Br demonstrou boa performance psicométrica, permitindo seu uso clínico no Brasil. É importante avaliar seu desempenho em outras regiões e em diferentes amostras de indivíduos.

Validation of the weight concerns scale applied to Brazilian university students

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Validation of a FFQ for estimating omega-3, omega-6 and trans fatty acid intake during pregnancy using mature breast milk and food recalls

BACKGROUND/OBJECTIVES: To assess the performance of a food frequency questionnaire (FFQ) for estimating omega-3, omega-6 and trans fatty acid intake during pregnancy. Moreover, we determined whether the fatty acid composition of mature breast milk represents a valuable biomarker for fatty acid intake during pregnancy. SUBJECTS/METHODS: A prospective study in 41 pregnant women, aged 18-35 years, was conducted. Food intake during pregnancy was evaluated by three 24-h recalls (24 hR), and 2 FFQ. The fatty acid composition of mature breast milk was determined by gas chromatography. The method of triads and joint classification between quartiles of intake were applied. RESULTS: The FFQ was accurate for estimating docosahexanoic (DHA), linoleic and total omega-6 fatty acids according to validity coefficients. Higher agreements (>70%) into the same or adjacent quartiles between the dietary methods were found for alpha-linolenic, total omega-3, linoleic and trans fatty acid intake. High validity coefficients for eicosapentanoic (EPA) and DHA acids of human milk were found (0.61 and 0.73, respectively), and the method was adequate for categorizing the intake of alpha-linolenic, total omega-3 and trans fatty acids compared with FFQ estimates, and for arachidonic acid and trans fatty acids compared with food recall estimates, during pregnancy. CONCLUSIONS: The FFQ was an accurate tool for categorizing alpha-linolenic, total omega-3 and trans fatty acid intake. According to the validity coefficients observed, the FFQ accurately estimated DHA, linoleic and total omega-6 fatty acids and the composition of mature breast milk was shown to be a suitable biomarker for EPA and DHA fatty acid intake during pregnancy.

Validation of the 2000 Bernstein-Parsonnet and EuroSCORE at the Heart Institute - USP

Objective: To validate the 2000 Bernstein Parsonnet (2000BP) and additive EuroSCORE (ES) to predict mortality in patients who underwent coronary bypass surgery and/or heart valve surgery at the Heart Institute, University of Sao Paulo (InCor/HC-FMUSP). Methods:A prospective observational design. We analyzed 3000 consecutive patients who underwent coronary bypass surgery and/or heart valve surgery, between May 2007 and July 2009 at the InCor/HC-FMUSP. Mortality was calculated with the 2000BP and ES models. The correlation between estimated mortality and observed mortality was validated by calibration and discrimination tests. Results: There were significant differences in the prevalence of risk factors between the study population, 2000BP and ES. Patients were stratified into five groups for 2000BP and three for the ES. In the validation of models, the ES showed good calibration (P = 0396), however, the 2000BP (P = 0.047) proved inadequate. In discrimination, the area under the ROC curve proved to be good for models, ES (0.79) and 2000BP (0.80). Conclusion: In the validation, 2000BP proved questionable and ES appropriate to predict mortality in patients who underwent coronary bypass surgery and/or heart valve surgery at the InCor/HC-FMUSP.

Adaptation and validation of the Patient Expectations and Satisfaction with Prenatal Care instrument among Brazilian pregnant women

Objective: to adapt and validate the Patient Expectations and Satisfaction with Prenatal Care instrument for use in Brazil. It contains 41 items divided into two dimensions: expectations and satisfaction. The adapted version was submitted to analysis for stability, convergent construct validity, and internal consistency (Cronbach’s alpha) for distinct groups and dimensions. Method: 119 pregnant women receiving prenatal care were interviewed and 26 of these women answered the instrument twice (retest). Internal consistency was appropriate (Cronbach’s alpha ≥ 0.70); test-retest presented strong correlation (r=0.82; p<0.001) for the domain expectations and moderate correlation (r=0.66; p<0.001) for the satisfaction domain. The analysis confirmed that the instrument’s adapted version is valid in the studied group. Results: there is strong evidence for the validity and reliability of the instrument’s adaptation. Conclusion: the instrument needs to be tested in groups of pregnant women with different social characteristics.

Validation of statistical shape model based reconstruction of the proximal femur - A morphology study

Seventeen bones (sixteen cadaveric bones and one plastic bone) were used to validate a method for reconstructing a surface model of the proximal femur from 2D X-ray radiographs and a statistical shape model that was constructed from thirty training surface models. Unlike previously introduced validation studies, where surface-based distance errors were used to evaluate the reconstruction accuracy, here we propose to use errors measured based on clinically relevant morphometric parameters. For this purpose, a program was developed to robustly extract those morphometric parameters from the thirty training surface models (training population), from the seventeen surface models reconstructed from X-ray radiographs, and from the seventeen ground truth surface models obtained either by a CT-scan reconstruction method or by a laser-scan reconstruction method. A statistical analysis was then performed to classify the seventeen test bones into two categories: normal cases and outliers. This classification step depends on the measured parameters of the particular test bone. In case all parameters of a test bone were covered by the training population's parameter ranges, this bone is classified as normal bone, otherwise as outlier bone. Our experimental results showed that statistically there was no significant difference between the morphometric parameters extracted from the reconstructed surface models of the normal cases and those extracted from the reconstructed surface models of the outliers. Therefore, our statistical shape model based reconstruction technique can be used to reconstruct not only the surface model of a normal bone but also that of an outlier bone.