Evaluating Measurement Invariance with Censored Ordinal Data: A Monte Carlo Comparison of Alternative Model Estimators and Scales of Measurement

Evaluations of measurement invariance provide essential construct validity evidence. However, the quality of such evidence is partly dependent upon the validity of the resulting statistical conclusions. The presence of Type I or Type II errors can render measurement invariance conclusions meaningless. The purpose of this study was to determine the effects of categorization and censoring on the behavior of the chi-square/likelihood ratio test statistic and two alternative fit indices (CFI and RMSEA) under the context of evaluating measurement invariance. Monte Carlo simulation was used to examine Type I error and power rates for the (a) overall test statistic/fit indices, and (b) change in test statistic/fit indices. Data were generated according to a multiple-group single-factor CFA model across 40 conditions that varied by sample size, strength of item factor loadings, and categorization thresholds. Seven different combinations of model estimators (ML, Yuan-Bentler scaled ML, and WLSMV) and specified measurement scales (continuous, censored, and categorical) were used to analyze each of the simulation conditions. As hypothesized, non-normality increased Type I error rates for the continuous scale of measurement and did not affect error rates for the categorical scale of measurement. Maximum likelihood estimation combined with a categorical scale of measurement resulted in more correct statistical conclusions than the other analysis combinations. For the continuous and censored scales of measurement, the Yuan-Bentler scaled ML resulted in more correct conclusions than normal-theory ML. The censored measurement scale did not offer any advantages over the continuous measurement scale. Comparing across fit statistics and indices, the chi-square-based test statistics were preferred over the alternative fit indices, and ΔRMSEA was preferred over ΔCFI. Results from this study should be used to inform the modeling decisions of applied researchers. However, no single analysis combination can be recommended for all situations. Therefore, it is essential that researchers consider the context and purpose of their analyses.

Model complexity affects transient population dynamics following a dispersal event: A case study with pea aphids

Stage-structured population models predict transient population dynamics if the population deviates from the stable stage distribution. Ecologists’ interest in transient dynamics is growing because populations regularly deviate from the stable stage distribution, which can lead to transient dynamics that differ significantly from the stable stage dynamics. Because the structure of a population matrix (i.e., the number of life-history stages) can influence the predicted scale of the deviation, we explored the effect of matrix size on predicted transient dynamics and the resulting amplification of population size. First, we experimentally measured the transition rates between the different life-history stages and the adult fecundity and survival of the aphid, Acythosiphon pisum. Second, we used these data to parameterize models with different numbers of stages. Third, we compared model predictions with empirically measured transient population growth following the introduction of a single adult aphid. We find that the models with the largest number of life-history stages predicted the largest transient population growth rates, but in all models there was a considerable discrepancy between predicted and empirically measured transient peaks and a dramatic underestimation of final population sizes. For instance, the mean population size after 20 days was 2394 aphids compared to the highest predicted population size of 531 aphids; the predicted asymptotic growth rate (λmax) was consistent with the experiments. Possible explanations for this discrepancy are discussed. Includes 4 supplemental files.

Contributions of demography and dispersal parameters to the spatial spread of a stage-structured insect invasion

Stage-structured models that integrate demography and dispersal can be used to identify points in the life cycle with large effects on rates of population spatial spread, information that is vital in the development of containment strategies for invasive species. Current challenges in the application of these tools include: (1) accounting for large uncertainty in model parameters, which may violate assumptions of ‘‘local’’ perturbation metrics such as sensitivities and elasticities, and (2) forecasting not only asymptotic rates of spatial spread, as is usually done, but also transient spatial dynamics in the early stages of invasion. We developed an invasion model for the Diaprepes root weevil (DRW; Diaprepes abbreviatus [Coleoptera: Curculionidae]), a generalist herbivore that has invaded citrus-growing regions of the United States. We synthesized data on DRW demography and dispersal and generated predictions for asymptotic and transient peak invasion speeds, accounting for parameter uncertainty. We quantified the contributions of each parameter toward invasion speed using a ‘‘global’’ perturbation analysis, and we contrasted parameter contributions during the transient and asymptotic phases. We found that the asymptotic invasion speed was 0.02–0.028 km/week, although the transient peak invasion speed (0.03– 0.045 km/week) was significantly greater. Both asymptotic and transient invasions speeds were most responsive to weevil dispersal distances. However, demographic parameters that had large effects on asymptotic speed (e.g., survival of early-instar larvae) had little effect on transient speed. Comparison of the global analysis with lower-level elasticities indicated that local perturbation analysis would have generated unreliable predictions for the responsiveness of invasion speed to underlying parameters. Observed range expansion in southern Florida (1992–2006) was significantly lower than the invasion speed predicted by the model. Possible causes of this mismatch include overestimation of dispersal distances, demographic rates, and spatiotemporal variation in parameter values. This study demonstrates that, when parameter uncertainty is large, as is often the case, global perturbation analyses are needed to identify which points in the life cycle should be targets of management. Our results also suggest that effective strategies for reducing spread during the asymptotic phase may have little effect during the transient phase. Includes Appendix.