Evaluating Measurement Invariance with Censored Ordinal Data: A Monte Carlo Comparison of Alternative Model Estimators and Scales of Measurement

Evaluations of measurement invariance provide essential construct validity evidence. However, the quality of such evidence is partly dependent upon the validity of the resulting statistical conclusions. The presence of Type I or Type II errors can render measurement invariance conclusions meaningless. The purpose of this study was to determine the effects of categorization and censoring on the behavior of the chi-square/likelihood ratio test statistic and two alternative fit indices (CFI and RMSEA) under the context of evaluating measurement invariance. Monte Carlo simulation was used to examine Type I error and power rates for the (a) overall test statistic/fit indices, and (b) change in test statistic/fit indices. Data were generated according to a multiple-group single-factor CFA model across 40 conditions that varied by sample size, strength of item factor loadings, and categorization thresholds. Seven different combinations of model estimators (ML, Yuan-Bentler scaled ML, and WLSMV) and specified measurement scales (continuous, censored, and categorical) were used to analyze each of the simulation conditions. As hypothesized, non-normality increased Type I error rates for the continuous scale of measurement and did not affect error rates for the categorical scale of measurement. Maximum likelihood estimation combined with a categorical scale of measurement resulted in more correct statistical conclusions than the other analysis combinations. For the continuous and censored scales of measurement, the Yuan-Bentler scaled ML resulted in more correct conclusions than normal-theory ML. The censored measurement scale did not offer any advantages over the continuous measurement scale. Comparing across fit statistics and indices, the chi-square-based test statistics were preferred over the alternative fit indices, and ΔRMSEA was preferred over ΔCFI. Results from this study should be used to inform the modeling decisions of applied researchers. However, no single analysis combination can be recommended for all situations. Therefore, it is essential that researchers consider the context and purpose of their analyses.

THE INFLUENCE OF CHILDHOOD ABUSE ON LONGITUDINAL COURSE OF RECOVERY IN PSYCHIATRIC REHABILITATION

Background: Empirical outcome studies have identified specific symptomatic, cognitive, emotional and functional sequelae of childhood abuse in people with severe mental illness (SMI). These findings illuminate the need for an integrated understanding of biological, psychological, environmental, and developmental aspects of SMI. Purpose: The purpose of the present study includes the following: 1) to examine reliability and validity of the comprehensive child abuse rating system in a sample of individuals with SMI, 2) to examine the influence of childhood abuse severity on recovery of psychotic symptoms, neurocognition and social-cognition, and social functioning in people with SMI during 12 months of inpatient psychiatric rehabilitation, and 3) to examine moderating effects of social cognition on the relationship between severity of different types of child abuse history and social functioning. Results: In Study I (N=171), the child abuse rating system produced reliable ratings and some subtypes of child abuse history were related to poorer premorbid functioning and cognition, higher overall psychiatric symptoms, and lower social functioning. In Study II (N=161), the longitudinal factor pattern invariance of the measures of social functioning, externality, and psychiatric symptoms were confirmed across 3 time points (e.g., at admission, at 6 months, and at 12 months). In addition, significant but varied linear relationships between subtypes of child abuse and each level of assessment of functioning were identified. In Study III (N=143), the results showed that higher baseline social inference, independent of history of child physical abuse (CPA), played a protective role in improvements in social functioning. High externality appeared to be counter-therapeutic for individuals with no history of CPA but protective for individuals with a more severe history of CPA. Conclusion: The child abuse rating system appears to provide reliable and valid assessment of subtypes of child abuse history of individuals with SMI. Considering the extreme heterogeneity in both SMI and child maltreatment, the current finding sheds light on providing individualized treatment and assessment planning for individuals with SMI and a history of childhood abuse.