Factor structure and measurement invariance of the Health Education Impact Questionnaire: does the subjectivity of the response perspective threaten the contextual validity of inferences?

Objective:
On-going evidence is required to support the validity of inferences about change and group differences in the
evaluation of health programs, particularly when self-report scales requiring substantial subjectivity in response generation are used as outcome measures. Following this reasoning, the aim of this study was to replicate the factor structure and investigate the measurement invariance of the latest version of the Health Education Impact Questionnaire, a widely used health program evaluation measure.
Methods:
An archived dataset of responses to the most recent version of the English-language Health Education Impact
Questionnaire that uses four rather than six response options (N=3221) was analysed using exploratory structural equation
modelling and confirmatory factor analysis appropriate for ordered categorical data. Metric and scalar invariance were
studied following recent recommendations in the literature to apply fully invariant unconditional models with minimum
constraints necessary for model identification.
Results:
The original eight-factor structure was replicated and all but one of the scales (Self Monitoring and Insight) was
found to consist of unifactorial items with reliability of ⩾0.8 and satisfactory discriminant validity. Configural, metric and scalar
invariance were established across pre-test to post-test and population sub-groups (sex, age, education, ethnic background).
Conclusion:
The results support the high level of interest in the Health Education Impact Questionnaire, particularly for use as a pre-test/post-test measure in experimental studies, other pre–post evaluation designs and system-level monitoring and evaluation.

Measuring chronic condition self-management in an Australian community: factor structure of the revised Partners in Health (PIH) scale

Purpose To evaluate the factor structure of the revised Partners in Health (PIH) scale for measuring chronic condition self-management in a representative sample from the Australian community.

Methods A series of consultations between clinical groups underpinned the revision of the PIH. The factors in the revised instrument were proposed to be: knowledge of illness and treatment, patient–health professional partnership, recognition and management of symptoms and coping with chronic illness. Participants (N = 904) reporting having a chronic illness completed the revised 12-item scale. Two a priori models, the 4-factor and bi-factor models were then evaluated using Bayesian confirmatory factor analysis (BCFA). Final model selection was established on model complexity, posterior predictive p values and deviance information criterion.

Results Both 4-factor and bi-factor BCFA models with small informative priors for cross-loadings provided an acceptable fit with the data. The 4-factor model was shown to provide a better and more parsimonious fit with the observed data in terms of substantive theory. McDonald’s omega coefficients indicated that the reliability of subscale raw scores was mostly in the acceptable range.

Conclusion The findings showed that the PIH scale is a relevant and structurally valid instrument for measuring chronic condition self-management in an Australian community. The PIH scale may help health professionals to introduce the concept of self-management to their patients and provide assessment of areas of self-management. A limitation is the narrow range of validated PIH measurement properties to date. Further research is needed to evaluate other important properties such as test–retest reliability, responsiveness over time and content validity.

The posttraumatic growth inventory: Factor structure and invariance in a sample ofbreast cancer patients and in a non-clinical sample

The Posttraumatic Growth Inventory (PTGI) is frequently used to assess positive changes following a traumatic event. The aim of the study is to examine the factor structure and the latent mean invariance of PTGI. A sample of 205 (M age = 54.3, SD = 10.1) women diagnosed with breast cancer and 456 (M age = 34.9, SD = 12.5) adults who had experienced a range of adverse life events were recruited to complete the PTGI and a socio-demographic questionnaire. We use Confirmatory Factor Analysis (CFA) to test the factor-structure and multi-sample CFA to examine the invariance of the PTGI between the two groups. The goodness of fit for the five-factor model is satisfactory for breast cancer sample (χ2(175) = 396.265; CFI = .884; NIF = .813; RMSEA [90% CI] = .079 [.068, .089]), and good for non-clinical sample (χ2(172) = 574.329; CFI = .931; NIF = .905; RMSEA [90% CI] = .072 [.065, .078]). The results of multi-sample CFA show that the model fit indices of the unconstrained model are equal but the model that uses constrained factor loadings is not invariant across groups. The findings provide support for the original five-factor structure and for the multidimensional nature of posttraumatic growth (PTG). Regarding invariance between both samples, the factor structure of PTGI and other parameters (i.e., factor loadings, variances, and co-variances) are not invariant across the sample of breast cancer patients and the non-clinical sample.

The structure of the Beck Hopelessness Scale: A confirmatory factor analysis in UK students

The aim of this paper was to confirm the factor structure of the 20-item Beck Hopelessness Scale in a non-clinical population. Previous research has highlighted a lack of clarity in its construct validity with regards to this population.

Based on previous factor analytic findings from both clinical and non-clinical studies, 13 separate confirmatory factor models were specified and estimated using LISREL 8.72 to test the one, two and three-factor models.

Psychology and medical students at Queen's University, Belfast (n = 581) completed both the BHS and the Beck Depression Inventory (BDI).

All models showed reasonable fit, but only one, a four-item single-factor model demonstrated a nonsignificant chi-squared statistic. These four items can be used to derive a Short-Form BHS (SBHS) in which increasing scores (0-4) corresponded with increasing scores in the BDI. The four items were also drawn from all three of Beck's proposed triad, and included both positively and negatively scored items.

This study in a UK undergraduate non-clinical population suggests that the BHS best measures a one-factor model of hopelessness. It appears that a shorter four-item scale can also measure this one-factor model. (C) 2011 Elsevier Ltd. All rights reserved.

Confirmatory factor analysis of the Way of Coping Checklist-Revised (WCCL-R) in the Asian context

Industrial employment growth has been one of the most dynamic areas of expansion in Asia; however, current trends in industrialised working environments have resulted in greater employee stress. Despite research showing that cultural values affect the way people cope with stress, there is a dearth of psychometrically established tools for use in non-Western countries to measure these constructs. Studies of the "Way of Coping Checklist-Revised" (WCCL-R) in the West suggest that the WCCL-R has good psychometric properties, but its applicability in the East is still understudied. A confirmatory factor analysis (CFA) is used to validate the WCCL-R constructs in an Asian population. This study used 1,314 participants from Indonesia, Sri Lanka, Singapore, and Thailand. An initial exploratory factor analysis revealed that original structures were not confirmed; however, a subsequent EFA and CFA showed that a 38-item, five-factor structure model was confirmed. The revised WCCL-R in the Asian sample was also found to have good reliability and sound construct and concurrent validity. The 38-item structure of the WCCL-R has considerable potential in future occupational stress-related research in Asian countries.

Examination of the latent structure of the psychological sense of school membership scale

Despite its widespread use, there has been limited examination of the underlying factor structure of the Psychological Sense of School Membership (PSSM) scale. The current study examined the psychometric properties of the PSSM to refine its utility for researchers and practitioners using a sample of 504 Australian high school students. Results from exploratory and confirmatory factor analyses indicated that the PSSM is a multidimensional instrument. Factor analysis procedures identified three factors representing related aspects of students’ perceptions of their school membership: caring relationships, acceptance, and rejection

The validity and structure of culture-level personality scores: Data from ratings of young adolescents

We examined properties of culture-level personality traits in ratings of targets (N=5,109) ages 12 to 17 in 24 cultures. Aggregate scores were generalizable across gender, age, and relationship groups and showed convergence with culture-level scores from previous studies of self-reports and observer ratings of adults, but they were unrelated to national character stereotypes. Trait profiles also showed cross-study agreement within most cultures, 8 of which had not previously been studied. Multidimensional scaling showed that Western and non-Western cultures clustered along a dimension related to Extraversion. A culture-level factor analysis replicated earlier findings of a broad Extraversion factor but generally resembled the factor structure found in individuals. Continued analysis of aggregate personality scores is warranted.

Confirmatory factor analysis of the Behaviour of Young Novice Drivers Scale (BYNDS)

The greatly increased risk of being killed or injured in a car crash for the young novice driver has been recognised in the road safety and injury prevention literature for decades. Risky driving behaviour has consistently been found to contribute to traffic crashes. Researchers have devised a number of instruments to measure this risky driving behaviour. One tool developed specifically to measure the risky behaviour of young novice drivers is the Behaviour of Young Novice Drivers Scale (BYNDS) (Scott-Parker et al., 2010). The BYNDS consists of 44 items comprising five subscales for transient violations, fixed violations, misjudgement, risky driving exposure, and driving in response to their mood. The factor structure of the BYNDS has not been examined since its development in a matched sample of 476 novice drivers aged 17-25 years. Method: The current research attempted to refine the BYNDS and explore its relationship with the self-reported crash and offence involvement and driving intentions of 390 drivers aged 17-25 years (M = 18.23, SD = 1.58) in Queensland, Australia, during their first six months of independent driving with a Provisional (intermediate) driver’s licence. A confirmatory factor analysis was undertaken examining the fit of the originally proposed BYNDS measurement model. Results: The model was not a good fit to the data. A number of iterations removed items with low factor loadings, resulting in a 36-item revised BYNDS which was a good fit to the data. The revised BYNDS was highly internally consistent. Crashes were associated with fixed violations, risky driving exposure, and misjudgement; offences were moderately associated with risky driving exposure and transient violations; and road-rule compliance intentions were highly associated with transient violations. Conclusions: Applications of the BYNDS in other young novice driver populations will further explore the factor structure of both the original and revised BYNDS. The relationships between BYNDS subscales and self-reported risky behaviour and attitudes can also inform countermeasure development, such as targeting young novice driver non-compliance through enforcement and education initiatives.

Factor analysis of the Self Report Version of the Strengths and Difficulties Questionnaire in a sample of children with intellectual disability

The rate of emotional and behavioral disturbance in children with intellectual disability (ID) is up to four times higher than that of their typically developing peers. It is important to identify these difficulties in children with ID as early as possible to prevent the chronic co-morbidity of ID and psychopathology. Children with ID have traditionally been assessed via proxy reporting, but appropriate and psychometrically rigorous instruments are needed so that children can report on their own emotions and behaviors. In this study, the factor structure of the self-report version of the Strengths and Difficulties Questionnaire (SDQ) was examined in a population of 128 children with ID (mean age = 12 years). Exploratory and Confirmatory Factor Analysis showed a three factor model (comprising Positive Relationships, Negative Behavior and Emotional Competence) to be a better measure than the original five factor SDQ model in this population.

Teacher Reporting Attitudes Scale (TRAS): confirmatory and exploratory factor analyses with a Malaysian sample.

The Teacher Reporting Attitude Scale (TRAS) is a newly developed tool to assess teachers’ attitudes toward reporting child abuse and neglect. This article reports on an investigation of the factor structure and psychometric properties of the short form Malay version of the TRAS. A self-report cross-sectional survey was conducted with 667 teachers in 14 randomly selected schools in Selangor state, Malaysia. Analyses were conducted in a 3-stage process using both confirmatory (stages 1 and 3) and exploratory factor analyses (stage 2) to test, modify, and confirm the underlying factor structure of the TRAS in a non-Western teacher sample. Confirmatory factor analysis did not support a 3-factor model previously reported in the original TRAS study. Exploratory factor analysis revealed an 8-item, 4-factor structure. Further confirmatory factor analysis demonstrated appropriateness of the 4-factor structure. Reliability estimates for the four factors—commitment, value, concern, and confidence—were moderate. The modified short form TRAS (Malay version) has potential to be used as a simple tool for relatively quick assessment of teachers’ attitudes toward reporting child abuse and neglect. Cross-cultural differences in attitudes toward reporting may exist and the transferability of newly developed instruments to other populations should be evaluated.

University Student Depression Inventory (USDI) : confirmatory factor analysis and review of psychometric properties

Background: The 30-item USDI is a self-report measure that assesses depressive symptoms among university students. It consists of three correlated three factors: Lethargy, Cognitive-Emotional and Academic motivation. The current research used confirmatory factor analysis to asses construct validity and determine whether the original factor structure would be replicated in a different sample. Psychometric properties were also examined. Method: Participants were 1148 students (mean age 22.84 years, SD = 6.85) across all faculties from a large Australian metropolitan university. Students completed a questionnaire comprising of the USDI, the Depression Anxiety Stress Scale (DASS) and Life Satisfaction Scale (LSS). Results: The three correlated factor model was shown to be an acceptable fit to the data, indicating sound construct validity. Internal consistency of the scale was also demonstrated to be sound, with high Cronbach Alpha values. Temporal stability of the scale was also shown to be strong through test-retest analysis. Finally, concurrent and discriminant validity was examined with correlations between the USDI and DASS subscales as well as the LSS, with sound results contributing to further support the construct validity of the scale. Cut-off points were also developed to aid total score interpretation. Limitations: Response rates are unclear. In addition, the representativeness of the sample could be improved potentially through targeted recruitment (i.e. reviewing the online sample statistics during data collection, examining the representativeness trends and addressing particular faculties within the university that were underrepresented). Conclusions: The USDI provides a valid and reliable method of assessing depressive symptoms found among university students.

Testing the psychometric properties of the Brisbane Practice Environment Measure using Exploratory Factor Analysis and Confirmatory Factor Analysis in an Australian registered nurse population

A cross-sectional survey was conducted, and the construct validity and reliability of the Brisbane Practice Environment Measure in an Australian sample of registered nurses were examined. Nurses were randomly selected from the database of an Australian nursing organization. The original 33 items of the Brisbane Practice Environment Measure were utilized to inform the psychometric properties using confirmatory factor analysis. The Cronbach's alpha was 0.938 for the total scale and ranged 0.657–0.887 for the subscales. A five-factor structure of the measure was confirmed, χ2 = 944.622, (P < 0.01), χ2/d.f. ratio = 2.845, Tucker Lewis Index 0.929, Root Mean Square Error = 0.061 and Comparative Fit Index = 0.906. The selected 28 items of the measure proved reliable and valid in measuring effects of the practice environment upon Australian nurses. The implications are that regular measurement of the practice environment using these 28 items might assist in the development of strategies which might improve job satisfaction and retention of registered nurses in Australia.

Validation of a framework for measuring hospital disaster resilience using factor analysis

Hospital disaster resilience can be defined as “the ability of hospitals to resist, absorb, and respond to the shock of disasters while maintaining and surging essential health services, and then to recover to its original state or adapt to a new one.” This article aims to provide a framework which can be used to comprehensively measure hospital disaster resilience. An evaluation framework for assessing hospital resilience was initially proposed through a systematic literature review and Modified-Delphi consultation. Eight key domains were identified: hospital safety, command, communication and cooperation system, disaster plan, resource stockpile, staff capability, disaster training and drills, emergency services and surge capability, and recovery and adaptation. The data for this study were collected from 41 tertiary hospitals in Shandong Province in China, using a specially designed questionnaire. Factor analysis was conducted to determine the underpinning structure of the framework. It identified a four-factor structure of hospital resilience, namely, emergency medical response capability (F1), disaster management mechanisms (F2), hospital infrastructural safety (F3), and disaster resources (F4). These factors displayed good internal consistency. The overall level of hospital disaster resilience (F) was calculated using the scoring model: F = 0.615F1 + 0.202F2 + 0.103F3 + 0.080F4. This validated framework provides a new way to operationalise the concept of hospital resilience, and it is also a foundation for the further development of the measurement instrument in future studies.

Confirmatory factor analysis of the baby eating behaviour questionnaire and associations with infant weight, gender and feeding mode in an Australian sample

The aim of this study was to evaluate the factor structure of the Baby Eating Behaviour Questionnaire (BEBQ) in an Australian community sample of mother-infant dyads. A secondary aim was to explore the relationship between the BEBQ subscales and infant gender, weight and current feeding mode. Confirmatory factor analysis (CFA) utilising structural equation modelling examined the hypothesised 4-factor model of the BEBQ. Only mothers (N=467) who completed all items on the BEBQ (infant age: M=17 weeks, SD=3 weeks) were included in the analysis. The original 4-factor model did not provide an acceptable fit to the data due to poor performance of the Satiety responsiveness factor. Removal of this factor (3 items) resulted in a well-fitting 3-factor model. Cronbach’s α was acceptable for the Enjoyment of food (α=0.73), Food responsiveness (α=0.78) and Slowness in eating (α=0.68) subscales but low for the Satiety responsiveness (α=0.56) subscale. Enjoyment of food was associated with higher infant weight whereas Slowness in eating and Satiety responsiveness were both associated with lower infant weight. Differences on all four subscales as a function of feeding mode were observed. This study is the first to use CFA to evaluate the hypothesised factor structure of the BEBQ. Findings support further development work on the Satiety responsiveness subscale in particular, but confirm the utility of the Enjoyment of food, Food responsiveness and Slowness in eating subscales.

Confirmatory factor analysis and invariance testing of the Young Carer of Parents Inventory (YCOPI)

Objective Research into youth caregiving in families where a parent experiences a significant medical condition has been hampered by a lack of contextually sensitive measures of the nature and breadth of young caregiving experiences. This study examined the factor structure and measurement invariance of such a measure called the Young Carer of Parents Inventory (YCOPI; Pakenham et al., 2006) using confirmatory factor analysis across 3 groups of youth. The YCOPI has 2 parts: YCOPI-A with 5 factors assessing caregiving experiences that are applicable to all caregiving contexts; YCOPI-B with 4 factors that tap dimensions related to youth caregiving in the context of parent illness. Design Two samples (ages 9–20 years) were recruited: a community sample of 2,429 youth from which 2 groups were derived (“healthy” family [HF], n = 1760; parental illness [PI], n = 446), and a sample of 130 youth of a parent with multiple sclerosis). Results With some modification, the YCOPI-A demonstrated a replicable factor structure across 3 groups, and exhibited only partial measurement invariance across the HF and PI groups. The impact of assuming full measurement invariance on latent mean differences appeared small, supporting use of the measure in research and applied settings when estimated using latent factors and controlling for measurement invariance. PI youth reported significantly higher scores than did HF youth on all YCOPI-A subscales. The YCOPI-B requires some modifications, and further development work is recommended. Conclusion The factor structure that emerged and the addition of new items constitutes the YCOPI-Revised. Findings support the use of the YCOPI-Revised in research and applied settings.