Psychometric properties of the oral health impact profile and new methodological approach

Objective: Evaluate the validity, reliability, and factorial invariance of the complete Portuguese version of the Oral Health Impact Profile (OHIP) and its short version (OHIP-14). Methods: A total of 1,162 adults enrolled in the Faculty of Dentistry of Araraquara/UNESP participated in the study; 73.1% were women; and the mean age was 40.7 ± 16.3 yr. We conducted a confirmatory factor analysis, where χ2/df, comparative fit index, goodness of fit index, and root mean square error of approximation were used as indices of goodness of fit. The convergent validity was judged from the average variance extracted and the composite reliability, and the internal consistency was estimated by Cronbach standardized alpha. The stability of the models was evaluated by multigroup analysis in independent samples (test and validation) and between users and nonusers of dental prosthesis. Results: We found best-fitting models for the OHIP-14 and among dental prosthesis users. The convergent validity was below adequate values for the factors “functional limitation” and “physical pain” for the complete version and for the factors “functional limitation” and “psychological discomfort” for the OHIP-14. Values of composite reliability and internal consistency were below adequate in the OHIP-14 for the factors “functional limitation” and “psychological discomfort.” We detected strong invariance between test and validation samples of the full version and weak invariance for OHIP-14. The models for users and nonusers of dental prosthesis were not invariant for both versions. Conclusion: The reduced version of the OHIP was parsimonious, reliable, and valid to capture the construct “impact of oral health on quality of life,” which was more pronounced in prosthesis users.

Development and psychometric evaluation of the basic electrocardiogram interpretation self-efficacy scale

Purpose: Research suggests that nurses and nursing students lack competence in basic electrocardiogram (ECG) interpretation. Self-efficacy is considered to be paramount in the development of one's competence. The aim of this study was to develop and psychometrically evaluate a scale to assess self-efficacy of nursing students in basic ECG interpretation. Materials and methods: Observational cross-sectional study with a convenience sample of 293 nursing students. The basic ECG interpretation self-efficacy scale (ECG-SES) was developed and psychometrically tested in terms of reliability (internal consistency and temporal stability) and validity (content, criterion and construct). The ECG-SES’ internal consistency was explored by calculating the Cronbach's alpha coefficient (α); its temporal stability was investigated by calculating the Pearson correlation coefficient (r) between the participants’ results on a test–retest separated by a 4-week interval. The content validity index of the items (I-CVI) and the scale (S-CVI) was calculated based on the reviews of a panel of 16 experts. Criterion validity was explored by correlating the participants’ results on the ECG-SES with their results on the New General Self-Efficacy Scale (NGSE). 1 Construct validity was investigated by performing Principal Component Analysis (PCA) and known-group analysis. Results: The excellent reliability of the ECG-SES was evidenced by its internal consistency (α = 0.98) and its temporal stability at the 4-week re-test (r = 0.81; p < 0.01). The ECG-SES’ content validity was also excellent (all items’ I-CVI = 0.94–1; S-CVI = 0.99). A strong, significant correlation between the NGSE and the ECG-SES (r = 0.70; p < 0.01) showed its criterion validity. Corroborating the ECG-SES’ construct validity, PCA revealed that all its items loaded on a single factor that explained 74.6% of the total variance found. Furthermore, known-groups analysis showed the ECG-SES’ ability to detect expected differences in self-efficacy between groups with different training experiences (p < 0.01). Conclusion: The ECG-SES showed excellent psychometric properties for measuring the self-efficacy of nursing students in basic ECG interpretation.

Deviant behavior variety scale: Development and validation with a sample of portuguese adolescents

This study presents the development and analysis of the psychometric properties of the Deviant Behavior Variety Scale (DBVS). Participants were 861 Portuguese adolescents (54 % female), aged between 12 and 19 years old. Two alternative models were tested using Confirmatory Factor Analysis. Although both models showed good fit indexes, the two-factor model didn’t presented discriminant validity. Further results provided evidence for the factorial and the convergent validity of the single-factor structure of the DVBS, which has also shown good internal consistency. Criterion validity was evaluated through the association with related variables, such as age and school failure, as well as the scale’s ability to capture group differences, namely between genders and school retentions, and finally by comparing a sub-group of convicted adolescents with a group of non-convicted ones regarding their engagement in delinquent activities. Overall, the scale presented good psychometric properties, with results supporting that the DBVS is a valid and reliable self-reported measure to evaluate adolescents’ involvement in deviance.

Police Legitimacy in Sub-Saharan Africa

Is fairness in process and outcome a generalizable driver of police legitimacy? In many industrialized nations, studies have demonstrated that police legitimacy is largely a function of whether citizens perceive treatment as normatively fair and respectful. Questions remain whether this model holds in less-industrialized contexts, where corruption and security challenges favor instrumental preferences for effective crime control and prevention. Support for and against the normative model of legitimacy has been found in less-industrialized countries, yet few have simultaneously compared these models across multiple industrializing countries. Using a multilevel framework and data from respondents in 27 countries in sub-Saharan Africa (n~43,000), I find evidence for the presence of both instrumental and normative influences in shaping the perceptions of police legitimacy. More importantly, the internal consistency of legitimacy (defined as obligation to obey, moral alignment, and perceived legality of the police) varies considerably from country to country, suggesting that relationships between legality, morality, and obligation operate differently across contexts. Results are robust to a number of different modeling assumptions and alternative explanations. Overall, the results indicate that both fairness and effectiveness matter, not in all places, and in some cases contrary to theoretical expectations.

EVIDENCE OF VALIDITY OF THE LSB-50: CROSS-VALIDATION, FACTORIAL INVARIANCE AND EXTERNAL CRITERION ANALYSIS

The aim of this paper was to obtain evidence of the validity of the LSB-50 (de Rivera & Abuín, 2012), a screening measure of psychopathology, in Argentinean adolescents. The sample consisted of 1002 individuals (49.7% male; 50.3% female) between 12 and 18 years-old (M = 14.98; SD = 1.99). A cross-validation study and factorial invariance studies were performed in samples divided by sex and age to test if a seven-factor structure that corresponds to seven clinical scales (Hypersensitivity, Obsessive-Compulsive, Anxiety, Hostility, Somatization, Depression, and Sleep disturbance) was adequate for the LSB-50. The seven-factor structure proved to be suitable for all the subsamples. Next, the fit of the seven-factor structure was studied simultaneously? in the aforementioned subsamples through hierarchical models that imposed different constrains of equivalency?. Results indicated the invariance of the seven clinical dimensions of the LSB-50. Ordinal alphas showed good internal consistency for all the scales. Finally, the correlations with a diagnostic measure of psychopathology (PAI-A) indicated moderate convergence. It is concluded that the analyses performed provide robust evidence of construct validity for the LSB-50

Transcultural adaptation and validation of the Celiac Dietary Adherence Test: a simple questionnaire to measure adherence to a gluten-free diet

Background and aims: A gluten-free diet is to date the only treatment available to celiac disease sufferers. However, systematic reviews indicate that, depending on the method of evaluation used, only 42% to 91% of patients adhere to the diet strictly. Transculturally adapted tools that evaluate adherence beyond simple self-informed questions or invasive analyses are, therefore, of importance. The aim is to obtain a Spanish transcultural adaption and validation of Leffler's Celiac Dietary Adherence Test. Methods: A two-stage observational transversal study: translation and back translation by four qualified translators followed by a validation stage in which the questionnaire was administered to 306 celiac disease patients aged between 12 and 72 years and resident in Aragon. Factorial structure, criteria validity and internal consistency were evaluated. Results: The Spanish version maintained the 7 items in a 3-factor structure. Feasibility was very high in all the questions answered and the floor and ceiling effects were very low (4.3% and 1%, respectively). The Spearman correlation with the self-efficacy and life quality scales and the self-informed question were statistically significant (p < 0.01). According to the questionnaire criteria, adherence was 72.3%. Conclusion: The Spanish version of the Celiac Dietary Adherence Test shows appropriate psychometric properties and is, therefore, suitable for studying adherence to a gluten-free diet in clinical and research environments.

Qualidade dos serviços, satisfação e intenção de recompra : estudo dos adeptos que vão ao estádio pelas casas do Benfica

Este estudo pretende aferir a relação entre a qualidade de serviço, a satisfação e a intenção de recompra. Foram recolhidos 377 questionários de associados das casas do Benfica, que se deslocaram ao estádio para assistir ao jogo Benfica vs Marítimo, realizado em 23 de Maio de 2015. Posteriormente, os dados foram tratados no programa Statistical Package for Social Sciences (SPSS 20.0 for Windows). Foi utilizada a estatística descritiva seguida de uma análise de consistência interna, por último realizou-se uma análise de regressão linear, para analisar as relações entre as dimensões. Verificou-se que os fatores da qualidade de serviço ajudam a explicar a satisfação com as casas do Benfica, a satisfação com o jogo e a intenção de recompra, nomeadamente o peso da qualidade do acesso e o atendimento das casas do Benfica. Também os fatores inerentes à satisfação ajudam a entender a intenção de recompra, sendo a satisfação com o jogo o fator com maior impacto na intenção de recompra. Verifica-se a importância das interações na satisfação e na intenção de recompra, bem como a importância dos resultados desportivos na satisfação dos inquiridos.

Adaptação da Florida Affect Battery à população portuguesa

Dissertação de Mestrado, Neurociências Cognitivas e Neuropsicologia, Faculdade de Ciências Humanas e Sociais, Universidade do Algarve, 2016

Adaptação de um instrumento de rastreio cognitivo, o MoCA (Montreal Cognitive Assessment) para população cabo-verdiana

Dissertação de Mestrado, Neurociências Cognitivas e Neuropsicologia, Faculdade de Ciências Humanas e Sociais, Universidade do Algarve, 2016

Medidas individualizadas de mudança: análise das propriedades psicométricas do PSYCHLOPS

Neste estudo apresentam-se dados referentes à fiabilidade, validade e sensibilidade para detetar mudança de uma medida individualizada de mudança (MIM), o PSYCHLOPS. Os dados foram recolhidos em quatro países, e dividem-se por seis amostras, totalizando 1053 participantes. Pretende-se aprofundar o conhecimento acerca das propriedades psicométricas e da sua adequabilidade, em MIM no geral, e no PSYCHLOPS, em particular. Após avaliar as propriedades psicométricas separadamente por amostra, procedeu-se à sua integração mediante métodos de meta-análise. O valor global de alfa de .82 indica uma boa consistência interna, mas a sua interpretação é dificultada pela não equivalência de itens. A correlação entre o PSYCHLOPS e o CORE-OM é de .63, e a correlação entre os scores de mudança das duas medidas é .67. Os dados suportam as hipóteses referentes à validade, mas suscitam dúvidas quanto à estrutura do PSYCHLOPS, e quanto à adequabilidade da avaliação psicométrica tradicional em MIM; Abstract: Various evidence regarding reliability, validity, and responsiveness of PSYCHLOPS, a patient-generated outcome measure (PGOM), are presented. Data comes from three countries, in a total of seven data sets comprising 1053 participants. The purpose of this study is to deepen the understanding of psychometric properties in PGOMs, and in PSYCHLOPS in particular. Following psychometric analysis by sample, meta-analysis procedures were used to calculate overall values. Overall mean internal consistency (alpha) was .82. Overall mean correlation between PSYCHLOPS and CORE-OM is r = .63, and overall mean correlation between change scores is r = .67. Overall mean internal consistency is good, but item non-equivalency makes interpretation difficult. Data support hypotheses regarding correlations, but cast doubt over PSYCHLOPS’ internal structure, and over suitability of classical psychometric evaluation in PGOM.

Sexual dysfunction in breast cancer survivors: cross-cultural adaptation of the Sexual Activity Questionnaire for use in Portugal

"Introduction: The increasing survivor population of breast cancer has shifted research and practice interests into the impacts of the disease and treatment in quality of life aspects. The lack of tools available in Portuguese to objectively evaluate sexual function led to the development of this study, which aimed to cross-culturally adapt and validate the Sexual Activity Questionnaire for use in Portugal. Material and Methods: The questionnaire was translated and back-translated, refined following face-to-face interviews with seven breast cancer survivors, and then self-administered by a larger sample at baseline and a fortnight later to test validity and reliability. Results: Following cognitive debriefing (n = 7), minor changes were made and the Sexual Activity Questionnaire was then tested with 134 breast cancer survivors. A 3-factor structure explained 75.5% of the variance, comprising the Pleasure, Habit and Discomfort scales, all yielding good internal consistency (Cronbach’s α > 0.70). Concurrent validity with the FACt-An and the BCPT checklist was good (Spearman’s r > 0.65; p-value < 0.001) and reliability acceptable (Cohen’s k > 0.444). The Sexual Activity Questionnaire allowed the identification of 23.9% of sexually inactive women, for whom the main reasons were lack of interest or motivation and not having a partner. Discussion: Patient-reported outcomes led to a more comprehensive and improved approach to cancer, tackling areas previously abandoned. Future research should focus on the validation of this scale in samples with different characteristics and even in the overall population to enable generalizability of the findings. Conclusion: The adapted Sexual Activity Questionnaire is a valid tool for assessing sexual function in breast cancer survivors in Portugal."

A measure of skin familiarity and its role in the early detection of skin cancer

Skin self-examination (SSE) is promoted widely so that individuals will become familiar with their skin and be better able to identify suspicious changes earlier. However, individuals can also become familiar with their skin other than through purposeful SSE. In this article, we develop a measure of skin familiarity based on the density of spots on 14 different areas of the body. A factor analysis of the 14 body-area scores revealed that they could be grouped into four broad body regions (shoulders and back, front of legs, back of legs, and feet). Each total body score and body-region score has high internal consistency (Cronbach's alpha coefficients ranging from 0.79 to 0.93). Moreover, the scores correlate as expected with skin self-examination behaviors and other personal characteristics, indicating high construct validity. We consider the advantages that skin familiarity measures offer over the exclusive use of SSE measures in the assessment of early detection activities and discuss the direction of future research in this area

The State of our Toolbox: A Meta-analysis of Reliability Measurement Precision

My study investigated internal consistency estimates of psychometric surveys as an operationalization of the state of measurement precision of constructs in industrial and organizational (I/O) psychology. Analyses were conducted of samples used in research articles published in the Journal of Applied Psychology between 1975 and 2010 in five year intervals (K = 934) from 480 articles yielding 1427 coefficients. Articles and their respective samples were coded for test-taker characteristics (e.g., age, gender, and ethnicity), research settings (e.g., lab and field studies), and actual tests (e.g., number of items and scale anchor points). A reliability and inter-item correlations depository was developed for I/O variables and construct groups. Personality measures had significantly lower inter-item correlations than other construct groups. Also, internal consistency estimates and reporting practices were evaluated over time, demonstrating an improvement in measurement precision and missing data.

Autoavaliação das competências de informação em estudantes universitários

Nas últimas décadas foram feitos grandes esforços para definir, conhecer e avaliar quais são as competências informativas que os estudantes universitários necessitam para poder progredir na sua aprendizagem e na sua inserção no mercado laboral. Apesar do argumento de que os avanços tecnológicos facilitaram o acesso à informação, existe uma preocupação constante, porque os estudantes universitários não possuem competências suficientes para gerir e usar a informação: gerem quantidades enormes de informação através da Internet, mas não sabem o que fazer com ela, como avaliá-la, de que modo devem usá-la ou aproveitá-la de forma estratégica e ética. O questionário IL-HUMASS sobre literacia da informação foi concebido e desenhado com o objetivo de avaliar competências de informação e para ser aplicado à população de estudantes, professores e profissionais da informação dos diversos níveis na área das Ciências Sociais e Humanas nas universidades espanholas e portuguesas. Contém 26 itens agrupados em quatro categorias (pesquisa, avaliação, processamento e comunicação e difusão da informação) e em três dimensões de autoavaliação (importância, autoavaliação e fonte favorita de aprendizagem). A avaliação das qualidades psicométricas do IL-HUMASS para Português foi feita numa amostra de 1.077 estudantes universitários portugueses. A análise fatorial exploratória do questionário indicou um ajustamento aceitável, apoiando a estrutura original composta por quatro categorias para cada dimensão. O IL-HUMASS apresentou características psicométricas aceitáveis de consistência interna e validade de constructo. As características psicométricas do IL-HUMASS validam a sua utilização no nosso país em estudos que requeiram a avaliação de múltiplos indicadores, apresentando-se como particularmente útil para avaliar e diagnosticar competências em literacia da informação. Conclui-se com um diagnóstico do nível de competências de informação dos estudantes universitários, destacando algumas forças e debilidades, assim como uma proposta de intervenção subjacente nas oportunidades de melhoria e de necessidades de aprendizagem.

Validação da security scale para a população portuguesa: Análise fatorial confirmatória e estudo empírico davinculação na pré-adolescência

Dissertação de Mestrado apresentada no ISPA – Instituto Universitário para obtenção do grau de Mestre em Psicologia especialidade de Psicologia Clínica.