Validation of the UNESP-Botucatu unidimensional composite pain scale for assessing postoperative pain in cattle

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Student's academic efficacy or Inefficacy? an example on how to evaluate the psychometric properties of a measuring instrument and evaluate the effects of item wording

This study evaluated the effect of item inversion on the construct validity and reliability of psychometric scales and proposed a theoretical framework for the evaluation of the psychometric properties of data gathered with psychometric instruments. To this propose, we used the Maslach Burnout Inventory, which is the most used psychometric inventory to measure burnout in different professional context (Students, Teachers, Police, Doctors, Nurses, etc…). The version of the MBI used was the MBI-Student Survey (MBI-SS). This inventory is composed of three key dimensions: Exhaustion, Cynicism and Professional Efficacy. The two first dimensions—which have positive formulated items—are moderate to strong positive correlated, and show moderate to strong negative correlations with the 3rd dimension—which has negative formulated items. We tested the hypothesis that, in college students, formulating the 3rd dimension of burnout as Inefficacy (reverting the negatively worded items in the Efficacy dimension) improves the correlation of the 3rd dimension with the other two dimensions, improves its internal consistency, and the overall MBI-SS’ construct validity and reliability. Confirmatory factor analysis results, estimated by Maximum Likelihood, revealed adequate factorial fit for both forms of the MBI-SS (with Efficacy) vs. the MBI-SSi (with Inefficacy). Also both forms showed adequate convergent and discriminant related validity. However, reliability and convergent validity were higher for the MBI-SSi. There were also stronger (positive) correlations between the 3 factors in MBI-SSi than the ones observed in MBI-SS. Results show that positively rewording of the 3rd dimension of the MBI-SS improves its validity and reliability. We therefore propose that the 3rd dimension of the MBI-SS should be named Professional Inefficacy and its items should be positively worded.

Refinement and partial validation of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in horses

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Validez y confiabilidad de la versión en español de la escala multidimensional de la UNESP-Botucatu para evaluar el dolor postoperatorio en gatos

This study focused on the validation of the Spanish version of the UNESP-Botucatu multidimensional composite pain scale to assess postoperative pain in cats. The original scale in Portuguese was translated into Spanish by two independent translators, and summarised in one version by a third individual. The summarised version was back-translated and minor adjustments were made. The scale was reviewed by three anesthesiologists with Spanish as their first language, and the final version was submitted to psychometric testing. Thirty cats undergoing ovariohysterectomy were video recorded during the perioperative period. Six observers from different spanish speaking countries, who had Spanish as the first language watched the videos and determined the pain scores using the Spanish version of the scale, identifying the cats that should receive analgesics. Videos were reanalysed in a different order about 2 months after the first assessment. The sensitivity to change, content and construct validity were established by the significant change in pain scores in response to surgery and analgesics. The agreement between the evaluations of the 'gold standard'(researcher that developed the scale) and the other observers confirmed the criterion validity. Inter- and intra-rater reliability, evaluated by intra-class correlation coefficient, ranged from good to very good for all scale items. The cut-off point for rescue analgesia identified by Receiver Operating Characteristic curve was > 7 with 92% of sensitivity and 91% of specificity. The Spanish version of the UNESP-Botucatu multidimensional composite pain scale is interpretable (has an optimal analgesic intervention score), valid and reliable instrument for assessing acute pain in cats undergoing ovariohysterectomy.

Development of the color scale of perceived exertion: preliminary validation

This study developed a Color Scale of Perceived Exertion (RPE-color scale) and assessed its concurrent and construct validity in adult women. One hundred participants (18-77 years), who were habitual exercisers, associated colors with verbal anchors of the Borg RPE scale (RPE-Borg scale) for RPE-color scale development. For RPE-color scale validation, 12 Young (M = 21.7 yr., SD = 1.5) and 10 Older (M = 60.3 yr., SD = 3.5) adult women performed a maximal graded exercise test on a treadmill and reported perceived exertion in both RPE-color and RPE-Borg scales. In the Young group, the RPE-color scale was significantly associated with heart rate and oxygen consumption, having strong correlations with the RPE-Borg scale. In the Older group, the RPE-color scale was significantly associated with heart rate, having moderate to high correlations with the RPE-Borg scale. The RPE-color scale demonstrated concurrent and construct validity in the Young women, as well as construct validity in Older adults.

Cognição Numérica de crianças pré-escolares brasileiras pela ZAREKI-K

The Numerical Cognition is infl uenced by biological, cognitive, educational and cultural factors. It consists of a primary system, called Number Sense that would be innate and universal, also of secondary systems: the Calculation, implied to perform mathematical operations by means of symbols or words and Number Processing, which is divided into two components, Number Comprehension, related with the understanding of numerical symbols and Number Production, which includes reading, writing and coun-ting numbers. However, studies that show the development of these functions in children of preschool age are scarce. Therefore, aims of this study were to investigate numerical cognition in preschool Brazilian children to demonstrate the construct validity of the ZAREKI-K (A Neuropsychological Battery for the Assessment of Treatment of Numbers and Calculation for preschool children). The participants were 42 children of both genders, who attended public elementary schools; the children were evaluated by this battery and WISC-III. The results indicated signifi cant differences associated with age which children of 6 years had better scores on subtests related to Number Production, Calculation and Number Comprehension, as well moderate and high correlations between some subtests of both instruments, demonstrating the construct validity of the battery. In conclusion, preliminary normative data were obtained for ZAREKI-K. The analyses suggested that it is a promising tool for the assessment of numerical cognition in preschool children.Keywords: Mathematics, number, preschoolers, working memory, Developmental Dyscalculia.

Desenvolvimento e validação de um questionário multidimensional de avaliação da qualidade de vida relacionada ao melasma (HRQ-Melasma)

Pós-graduação em Enfermagem (mestrado profissional) - FMB

Relações entre o construto e as características do teste escrito do EPPLE eletrônico: um processo de validação

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES)

Evaluating Measurement Invariance with Censored Ordinal Data: A Monte Carlo Comparison of Alternative Model Estimators and Scales of Measurement

Evaluations of measurement invariance provide essential construct validity evidence. However, the quality of such evidence is partly dependent upon the validity of the resulting statistical conclusions. The presence of Type I or Type II errors can render measurement invariance conclusions meaningless. The purpose of this study was to determine the effects of categorization and censoring on the behavior of the chi-square/likelihood ratio test statistic and two alternative fit indices (CFI and RMSEA) under the context of evaluating measurement invariance. Monte Carlo simulation was used to examine Type I error and power rates for the (a) overall test statistic/fit indices, and (b) change in test statistic/fit indices. Data were generated according to a multiple-group single-factor CFA model across 40 conditions that varied by sample size, strength of item factor loadings, and categorization thresholds. Seven different combinations of model estimators (ML, Yuan-Bentler scaled ML, and WLSMV) and specified measurement scales (continuous, censored, and categorical) were used to analyze each of the simulation conditions. As hypothesized, non-normality increased Type I error rates for the continuous scale of measurement and did not affect error rates for the categorical scale of measurement. Maximum likelihood estimation combined with a categorical scale of measurement resulted in more correct statistical conclusions than the other analysis combinations. For the continuous and censored scales of measurement, the Yuan-Bentler scaled ML resulted in more correct conclusions than normal-theory ML. The censored measurement scale did not offer any advantages over the continuous measurement scale. Comparing across fit statistics and indices, the chi-square-based test statistics were preferred over the alternative fit indices, and ΔRMSEA was preferred over ΔCFI. Results from this study should be used to inform the modeling decisions of applied researchers. However, no single analysis combination can be recommended for all situations. Therefore, it is essential that researchers consider the context and purpose of their analyses.

Weekly Problems Scales: Instruments for Sexually Abused Youth and Their Nonoffending Parents in Treatment

This study’s purpose was to determine if efficient measures could be created to assess multiple problematic behaviors identified in youth who were sexually abused and in treatment. Because of the lack of easily administered brief instruments that assess multiple domains of interest in this population, complementary parent and child assessment measures were developed. The Weekly Problems Scale–Child Version (WPSC) and the Weekly Problems Scale–Parent Version (WPS-P) were created to monitor the weekly progress of the child and family in treatment and focus specifically on common areas of difficulties in this population. Exploratory factor analysis was conducted to assist in identifying the number of underlying dimensions in the scales. Results indicate that the WPS-C and WPS-P demonstrate adequate internal consistency, temporal stability, and construct validity. The WPS-C and WPSP display significant promise as research and clinical assessment tools for use with youth who are sexually abused and their nonoffending parents in treatment.

Construção e Validação da Escala de Imprevisibilidade Familiar na Infância (EIFI)

Este estudo teve o objetivo de construir e validar uma medida psicológica denominada de Escala de Imprevisibilidade Familiar na Infância (EIFI) para a população brasileira. Participaram 394 pessoas, sendo 158 adultos em conflito com a lei que já haviam passado pela prisão (média de idade=34,23 anos; DP=10,17), 122 estudantes universitários (M=19,26; DP=2,06) e 114 mulheres com idade superior a 40 anos e escolaridade a partir de ensino médio (M=51,19; DP=8,64). Foram conduzidos procedimentos de validade de conteúdo, face e construto. A análise fatorial gerou como produto um instrumento com estrutura de quatro dimensões (cuidado/apoio, recursos financeiros, alimentação e disciplina) com índices de confiabilidade satisfatórios para todas elas. Concluímos que a EIFI foi validada para a população brasileira apresentando-se no cenário nacional como um instrumento para medida de imprevisibilidade familiar na infância.

Validation of the Brazilian versions of two inventories for measuring oral health-related quality of life of edentulous subjects

'Objectives: To analyse the validity of the Brazilian versions of OHIP-EDENT and GOHAI as assessment tools of edentulous subjects' OHRQoL. Background: Inventories for measuring oral health-related quality of life (OHRQoL) are important in clinical studies regarding oral rehabilitation. However, there is a need for comprehensive validation after translation into different cultural settings. Materials and methods: The sample comprised of 100 complete denture wearers (29 men, 71 women, mean age of 65.2 +/- 9.9 years). The associations between each OHRQoL inventory and other variables served as measurements of construct validity. Data analysis comprised the Spearman correlation test as well as multiple regression using the OHRQoL inventories as dependent variables and the other scales as determinants. Results: Both OHRQoL inventories showed good correlation with denture satisfaction, whereas lower correlation coefficients were found among the inventories and the HAD subscales. Denture satisfaction alone explained 48% and 39% of the variance found for the OHIP-EDENT and GOHAI, respectively, as assessed by multiple regression. A smaller effect was found for OHIP-EDENT. Conclusion: Both OHIP-EDENT and GOHAI showed good construct validity for measurement of OHRQoL of edentulous subjects.

Short Assessment of Health Literacy for Portuguese-Speaking Adults

OBJECTIVE: To develop and validate a short health literacy assessment tool for Portuguese-speaking adults. METHODS: The Short Assessment of Health Literacy for Portuguese-speaking Adults is an assessment tool which consists of 50 items that assess an individual's ability to correctly pronounce and understand common medical terms. We evaluated the instrument's psychometric properties in a convenience sample of 226 Brazilian older adults. Construct validity was assessed by correlating the tool scores with years of schooling, self-reported literacy, and global cognitive functioning. Discrimination validity was assessed by testing the tool's accuracy in detecting inadequate health literacy, defined as failure to fully understand standard medical prescriptions. RESULTS: Moderate to high correlations were found in the assessment of construct validity (Spearman's coefficients ranging from 0.63 to 0.76). The instrument showed adequate internal consistency (Cronbach's alpha=0.93) and adequate test-retest reliability (intraclass correlation coefficient=0.95). The area under the receiver operating characteristic curve for detection of inadequate health literacy was 0.82. A version consisting of 18 items was tested and showed similar psychometric properties. CONCLUSIONS: The instrument developed showed good validity and reliability in a sample of Brazilian older adults. It can be used in research and clinical settings for screening inadequate health literacy.

Questionário Atitudes de Segurança: adaptação transcultural do Safety Attitudes Questionnaire - Short Form 2006 para o Brasil

O objetivo deste estudo foi realizar a adaptação transcultural do Safety Attitudes Questionnaire - Short Form 2006 para o Brasil. O instrumento foi aplicado em seis hospitais de três Regiões do Brasil. Foi realizada a validade de conteúdo, face e de construto. A análise da confiabilidade do instrumento foi realizada por meio da análise da consistência interna dos itens por meio do alfa de Cronbach. A amostra do estudo foi composta por 1.301 profissionais das enfermarias clínicas e cirúrgicas de seis hospitais. A análise confirmatória mostrou que o ajuste do modelo final dos 41 itens foi considerado satisfatório. Aversão do instrumento em Português apresentou alfa de 0,89. As correlações item/total entre os domínios foram consideradas de moderada a forte, com exceção do domínio percepção do estresse. Conclui-se, portanto, que a versão do instrumento adaptada para o Português é considerada válida e confiável nesta amostra.

Cross-cultural adaptation and psychometric properties of the Brazilian-Portuguese version of the Duke Anticoagulation Satisfaction Scale

Aim. The aim of this study was to evaluate the internal reliability and validity of the BrazilianPortuguese version of Duke Anticoagulation Satisfaction Scale (DASS) among cardiovascular patients. Background. Oral anticoagulation is widely used to prevent and treat thromboembolic events in several conditions, especially in cardiovascular diseases; however, this therapy can induce dissatisfaction and reduce the quality of life. Design. Methodological and cross-sectional research design. Methods. The cultural adaptation of the DASS included the translation and back-translation, discussions with healthcare professionals and patients to ensure conceptual equivalence, semantic evaluation and instrument pretest. The BrazilianPortuguese version of the DASS was tested among subjects followed in a university hospital anticoagulation outpatient clinic. The psychometric properties were assessed by construct validity (convergent, known groups and dimensionality) and internal consistency/reliability (Cronbachs alpha). Results. A total of 180 subjects under oral anticoagulation formed the baseline validation population. DASS total score and SF-36 domain correlations were moderate for General health (r = -0.47, p < 0.01), Vitality (r = -0.44, p < 0.01) and Mental health (r = -0.42, p < 0.01) (convergent). Age and length on oral anticoagulation therapy (in years) were weakly correlated with total DASS score and most of the subscales, except Limitation (r = -0.375, p < 0.01) (Known groups). The Cronbachs alpha coefficient was 0.79 for the total scale, and it ranged from 0.76 (hassles and burdens)0.46 (psychological impact) among the domains, confirming the internal consistency reliability. Conclusions. The BrazilianPortuguese version of the DASS has shown levels of reliability and validity comparable with the original English version. Relevance to clinical practice. Healthcare practitioners and researchers need internationally validated measurement tools to compare outcomes of interventions in clinical management and research tools in oral anticoagulation therapy.