The KIDSCREEN-27 quality of life measure for children and adolescents: psychometric results from a cross-cultural survey in 13 European countries

OBJECTIVE: To assess the construct and criterion validity of the KIDSCREEN-27 health-related quality of life (HRQoL) questionnaire, a shorter version of the KIDSCREEN-52. METHODS: The five-dimensional KIDSCREEN-27 was tested in a sample of 22,827. For criterion validity the correlation with and the percentage explained variance of the scores of the KIDSCREEN-52 instrument were examined. Construct validity was assessed by testing a priori expected associations with other generic HRQoL measures (YQOL-S, PedsQL, CHIP), indicators of physical and mental health, and socioeconomic status. Age and gender differences were investigated. RESULTS: Correlation with corresponding scales of the KIDSCREEN-52 ranged from r = 0.63 to r = 0.96, and r2 ranged from 0.39 to 0.92. Correlations between other HRQoL questionnaires and KIDSCREEN-27 dimensions were moderate to high for those assessing similar constructs (r = 0.36 to 0.63). Statistically significant and sizeable differences between physically and mentally healthy and ill children were found in all KIDSCREEN-27 dimensions together with strong associations with psychosomatic complaints (r = -0.52). Most of the KIDSCREEN-27 dimensions showed a gradient according to socio-economic status, age and gender. CONCLUSIONS: The KIDSCREEN-27 seems to be a valid measure of HRQoL in children and adolescents. Further research is needed to assess longitudinal validity and sensitivity to change.

Psychometric properties of the Swiss version of the Nursing Home Survey on Patient Safety Culture

The Nursing Home Survey on Patient Safety Culture (NHSPSC) was specifically developed for nursing homes to assess a facility’s safety climate and it consists of 12 dimensions. After its pilot testing, however, no fur- ther psychometric analyses were performed on the instrument. For this study of safety climate in Swiss nursing home units, the NHSPSC was linguistically adapted to the Swiss context and to address the unit as well as facility level, with the aim of testing aspects of the validity and reliability of the Swiss version before its use in Swiss nursing home units. Psychometric analyses were performed on data from 367 nurs- ing personnel from nine nursing homes in the German-speaking part of Switzerland (response rate = 66%), and content validity (CVI) examined. The statistical influence of unit membership on respondents’ answers, and on their agreement concerning their units’ safety climate, was tested using intraclass corre- lation coefficients (ICCs) and the rWG(J) interrater agreement index. A multilevel exploratory factor analysis (MEFA) with oblimin rotation was applied to examine the questionnaire’s dimensionality. Cronbach’s alpha and Raykov’s rho were calculated to assess factor reliability. The relationship of safety climate dimensions with clinical outcomes was explored. Expert feedback confirmed the relevance of the instru- ment’s items (CVI = 0.93). Personnel showed strong agreement in their perceptions in three dimensions of the questionnaire. ICCs supported a multilevel analysis. MEFA produced nine factors at the within-level (in comparison to 12 in the original version) and two factors at the between-level with satisfactory fit statis- tics. Raykov’s Rho for the single level factors ranged between 0.67 and 0.86. Some safety climate dimen- sions show moderate, but non-significant correlations with the use of bedrails, physical restraint use, and fall-related injuries. The Swiss version of the NHSPSC needs further refinement and testing before its use can be recommended in Swiss nursing homes: its dimensionality needs further clarification, particularly to distinguish items addressing the unit-level safety climate from those at the facility level.

Affect and cognition measures in preference-based decisions: Validity testing of the Ottawa Decisional Conflict Scale and a decision-specific anxiety measure with men eligible for prostate cancer screening

Background. At present, prostate cancer screening (PCS) guidelines require a discussion of risks, benefits, alternatives, and personal values, making decision aids an important tool to help convey information and to help clarify values. Objective: The overall goal of this study is to provide evidence of the reliability and validity of a PCS anxiety measure and the Decisional Conflict Scale (DCS). Methods. Using data from a randomized, controlled PCS decision aid trial that measured PCS anxiety at baseline and DCS at baseline (T0) and at two-weeks (T2), four psychometric properties were assessed: (1) internal consistency reliability, indicated by factor analysis intraclass correlations and Cronbach's α; (2) construct validity, indicated by patterns of Pearson correlations among subscales; (3) discriminant validity, indicated by the measure's ability to discriminate between undecided men and those with a definite screening intention; and (4) factor validity and invariance using confirmatory factor analyses (CFA). Results. The PCS anxiety measure had adequate internal consistency reliability and good construct and discriminant validity. CFAs indicated that the 3-factor model did not have adequate fit. CFAs for a general PCS anxiety measure and a PSA anxiety measure indicated adequate fit. The general PCS anxiety measure was invariant across clinics. The DCS had adequate internal consistency reliability except for the support subscale and had adequate discriminate validity. Good construct validity was found at the private clinic, but was only found for the feeling informed subscale at the public clinic. The traditional DCS did not have adequate fit at T0 or at T2. The alternative DCS had adequate fit at T0 but was not identified at T2. Factor loadings indicated that two subscales, feeling informed and feeling clear about values, were not distinct factors. Conclusions. Our general PCS anxiety measure can be used in PCS decision aid studies. The alternative DCS may be appropriate for men eligible for PCS. Implications: More emphasis needs to be placed on the development of PCS anxiety items relating to testing procedures. We recommend that the two DCS versions be validated in other samples of men eligible for PCS and in other health care decisions that involve uncertainty. ^

The Health Behavior Change Competency Checklist (HBCCC): Instrument development and psychometric evaluation.

More than half of morbidity and mortality in the United States can be attributed to behavior-related disease, such as tobacco use, physical inactivity, poor diet and alcohol consumption. Given the increased prevalence of behaviorally related medical health concerns, physician competence in the implementation of effective behavior change strategies is quickly becoming an essential skill. However, only recently have primary care residency programs begun to systematically teach and evaluate motivational interviewing skills critical to influencing health behavior, and use of standardized, objective assessment tools to assess skillfulness has been largely absent. This paper reports the development of a checklist, the Health Behavior Change Competency Checklist (HBCCC). The instrument captures the theoretical model of behavior change, motivational interviewing, in a practical and versatile manner. Psychometric evaluation demonstrated moderate efficacy. Namely, results indicated the HBCCC possesses good reliability, as evidenced by high internal consistency, and adequate construct validity. It also displayed considerable utility and practical application. While these results provide several reasons for confidence in the HBCCC, item revision and additional testing are required in order to establish it as a meaningful and valuable instrument.

The development and preliminary testing of an instrument to measure the perceived economic burden of a subtype of arrhythmogenic right ventricular cardiomyopathy (ARVC) on patients and families in Newfoundland

The goal of this thesis was to develop, construct, and validate the Perceived Economic Burden scale to quantitatively measure the burden associated with a subtype Arrhythmogenic Right Ventricular Cardiomyopathy (ARVC) in families from the island of Newfoundland. An original 76 item self-administered survey was designed using content from existing literature as well as themes from qualitative research conducted by our team and distributed to individuals of families known to be at risk for the disease. A response rate of 37.2% (n = 64) was achieved between December 2013 and May 2014. Tests for data quality, Likert scale assumptions and scale reliability were conducted and provided preliminary evidence of the psychometric properties of the final constructed perceived economic burden of ARVC scale comprising 62 items in five sections. Findings indicated that being an affected male was a significant predictor of increased perceived economic burden in the majority of economic burden measures. Affected males also reported an increased likelihood of going on disability and difficulty obtaining insurance. Affected females also had an increased perceived financial burden. Preliminary results suggest that a perceived economic burden exists within the ARVC population in Newfoundland.

Analysis of residuals in contingency tables: another nail in the coffin of conditional approaches to significance testing.

Omnibus tests of significance in contingency tables use statistics of the chi-square type. When the null is rejected, residual analyses are conducted to identify cells in which observed frequencies differ significantly from expected frequencies. Residual analyses are thus conditioned on a significant omnibus test. Conditional approaches have been shown to substantially alter type I error rates in cases involving t tests conditional on the results of a test of equality of variances, or tests of regression coefficients conditional on the results of tests of heteroscedasticity. We show that residual analyses conditional on a significant omnibus test are also affected by this problem, yielding type I error rates that can be up to 6 times larger than nominal rates, depending on the size of the table and the form of the marginal distributions. We explored several unconditional approaches in search for a method that maintains the nominal type I error rate and found out that a bootstrap correction for multiple testing achieved this goal. The validity of this approach is documented for two-way contingency tables in the contexts of tests of independence, tests of homogeneity, and fitting psychometric functions. Computer code in MATLAB and R to conduct these analyses is provided as Supplementary Material.

Item and task difficulty in a B2 reading examination: perceptions of test-takers and CEFR alignment experts compared with psychometric measurements

The article presents a study of a CEFR B2-level reading subtest that is part of the Slovenian national secondary school leaving examination in English as a foreign language, and compares the test-taker actual performance (objective difficulty) with the test-taker and expert perceptions of item difficulty (subjective difficulty). The study also analyses the test-takers’ comments on item difficulty obtained from a while-reading questionnaire. The results are discussed in the framework of the existing research in the fields of (the assessment of) reading comprehension, and are addressed with regard to their implications for item-writing, FL teaching and curriculum development.

Adaptation and validation into Portuguese language of the HIV Antibody Testing Attitude Scale

Objective. To culturally adapt and validate a version in European Portuguese language of the HIV Antibody Testing Attitude Scale. Methods. Study conducting a methodological investigation for the adaptation and validation of an attitude measurement instrument. The instrument translation and back-translation were performed. Then, a pre-test was conducted. The study used a sample of 317 subjects from the academic community - students, professors and other professionals - who were contacted in the campus. Ethical principles were observed. Results. Three analyses were conducted using the method of principal component analysis (PCA) with five, four and three factors. A three-factor solution was achieved, which presents 50.82% variance. In the analysis of inter-item correlation, values between -0.018 and 0.749 were observed. Internal consistency shows Cronbach’s alpha coefficients of 0.860 overall and between 0.865 and 0.659 in the three factors. Conclusion. The instrument version shows psychometric properties that allow its use in Portuguese-speaking countries.

Adaptation and validation of HIV Antibody Testing Attitude Scale in Portuguese

Introduction; The awareness of HIV positiveness is important for health of the individual and of the comunity. The identicatio of HIV antibodies is possible both using conventional lab tests and quick result tests. In the bibliography it was made clear that there are no instruments in Portuguese to assert the reactions to the HIV quick tests and it was therefore considered it would be useful to adapt and validate a scale in Portuguese, since the language is the official language of 7 different countries and spoken by more than 250 milion people, Objectives: the purpose is to validate a version in European Portuguese of the HIV Antibody Testing Attitude Scale. Methods: the study refers to methodological research for the adaptation and validation of an instrument of attitude measurement. A translation and back-translation was prepared and a trial test was then carried out. A total of 317 students, lectures and co-workers of a Portuguese University was interviewes. Ethical principles were taken into consideration. the pool was obtained in the seven components of the University campus. Results: 3 trials of factorial testing of the main components of 5, 4 and 3 factors. It ended up a solution of 3 factors that explains 50.82% of the variability. In the analysis of the inter-items correlation values of between 0.018 and 0.749 were observed. The internal consistency reveals an alpha Cronbach coefficient of 0.860 as a whole, and in between 0,865 and 0.659 in the 3 factors. Conclusions: this version of the instrument shows that the psychometric properties allow its use in the Portuguese speaking countries.