Evaluating Measurement Invariance with Censored Ordinal Data: A Monte Carlo Comparison of Alternative Model Estimators and Scales of Measurement

Evaluations of measurement invariance provide essential construct validity evidence. However, the quality of such evidence is partly dependent upon the validity of the resulting statistical conclusions. The presence of Type I or Type II errors can render measurement invariance conclusions meaningless. The purpose of this study was to determine the effects of categorization and censoring on the behavior of the chi-square/likelihood ratio test statistic and two alternative fit indices (CFI and RMSEA) under the context of evaluating measurement invariance. Monte Carlo simulation was used to examine Type I error and power rates for the (a) overall test statistic/fit indices, and (b) change in test statistic/fit indices. Data were generated according to a multiple-group single-factor CFA model across 40 conditions that varied by sample size, strength of item factor loadings, and categorization thresholds. Seven different combinations of model estimators (ML, Yuan-Bentler scaled ML, and WLSMV) and specified measurement scales (continuous, censored, and categorical) were used to analyze each of the simulation conditions. As hypothesized, non-normality increased Type I error rates for the continuous scale of measurement and did not affect error rates for the categorical scale of measurement. Maximum likelihood estimation combined with a categorical scale of measurement resulted in more correct statistical conclusions than the other analysis combinations. For the continuous and censored scales of measurement, the Yuan-Bentler scaled ML resulted in more correct conclusions than normal-theory ML. The censored measurement scale did not offer any advantages over the continuous measurement scale. Comparing across fit statistics and indices, the chi-square-based test statistics were preferred over the alternative fit indices, and ΔRMSEA was preferred over ΔCFI. Results from this study should be used to inform the modeling decisions of applied researchers. However, no single analysis combination can be recommended for all situations. Therefore, it is essential that researchers consider the context and purpose of their analyses.

Markov blanket-based approach for learning multi-dimensional Bayesian network classifiers: An application to predict the European Quality of Life-5 Dimensions (EQ-5D) from the 39-item Parkinson's Disease Questionnaire (PDQ-39)

Multi-dimensional Bayesian network classifiers (MBCs) are probabilistic graphical models recently proposed to deal with multi-dimensional classification problems, where each instance in the data set has to be assigned to more than one class variable. In this paper, we propose a Markov blanket-based approach for learning MBCs from data. Basically, it consists of determining the Markov blanket around each class variable using the HITON algorithm, then specifying the directionality over the MBC subgraphs. Our approach is applied to the prediction problem of the European Quality of Life-5 Dimensions (EQ-5D) from the 39-item Parkinson’s Disease Questionnaire (PDQ-39) in order to estimate the health-related quality of life of Parkinson’s patients. Fivefold cross-validation experiments were carried out on randomly generated synthetic data sets, Yeast data set, as well as on a real-world Parkinson’s disease data set containing 488 patients. The experimental study, including comparison with additional Bayesian network-based approaches, back propagation for multi-label learning, multi-label k-nearest neighbor, multinomial logistic regression, ordinary least squares, and censored least absolute deviations, shows encouraging results in terms of predictive accuracy as well as the identification of dependence relationships among class and feature variables.

Censored Linear Regression Models For Irregularly Observed Longitudinal Data Using The Multivariate-t Distribution.

In acquired immunodeficiency syndrome (AIDS) studies it is quite common to observe viral load measurements collected irregularly over time. Moreover, these measurements can be subjected to some upper and/or lower detection limits depending on the quantification assays. A complication arises when these continuous repeated measures have a heavy-tailed behavior. For such data structures, we propose a robust structure for a censored linear model based on the multivariate Student's t-distribution. To compensate for the autocorrelation existing among irregularly observed measures, a damped exponential correlation structure is employed. An efficient expectation maximization type algorithm is developed for computing the maximum likelihood estimates, obtaining as a by-product the standard errors of the fixed effects and the log-likelihood function. The proposed algorithm uses closed-form expressions at the E-step that rely on formulas for the mean and variance of a truncated multivariate Student's t-distribution. The methodology is illustrated through an application to an Human Immunodeficiency Virus-AIDS (HIV-AIDS) study and several simulation studies.

Log-modified Weibull regression models with censored data: Sensitivity and residual analysis

This paper proposes a regression model considering the modified Weibull distribution. This distribution can be used to model bathtub-shaped failure rate functions. Assuming censored data, we consider maximum likelihood and Jackknife estimators for the parameters of the model. We derive the appropriate matrices for assessing local influence on the parameter estimates under different perturbation schemes and we also present some ways to perform global influence. Besides, for different parameter settings, sample sizes and censoring percentages, various simulations are performed and the empirical distribution of the modified deviance residual is displayed and compared with the standard normal distribution. These studies suggest that the residual analysis usually performed in normal linear regression models can be straightforwardly extended for a martingale-type residual in log-modified Weibull regression models with censored data. Finally, we analyze a real data set under log-modified Weibull regression models. A diagnostic analysis and a model checking based on the modified deviance residual are performed to select appropriate models. (c) 2008 Elsevier B.V. All rights reserved.

Polytomous item response theory models

Polytomous Item Response Theory Models provides a unified, comprehensive introduction to the range of polytomous models available within item response theory (IRT). It begins by outlining the primary structural distinction between the two major types of polytomous IRT models. This focuses on the two types of response probability that are unique to polytomous models and their associated response functions, which are modeled differently by the different types of IRT model. It describes, both conceptually and mathematically, the major specific polytomous models, including the Nominal Response Model, the Partial Credit Model, the Rating Scale model, and the Graded Response Model. Important variations, such as the Generalized Partial Credit Model are also described as are less common variations, such as the Rating Scale version of the Graded Response Model. Relationships among the models are also investigated and the operation of measurement information is described for each major model. Practical examples of major models using real data are provided, as is a chapter on choosing an appropriate model. Figures are used throughout to illustrate important elements as they are described.

ADHD in a representative sample of the Brazilian population: estimated prevalence and comparative adequacy of criteria between adolescents and adults according to the item response theory

Background: Attention deficit hyperactivity disorder (ADHD) is a clinically significant disorder in adulthood, but current diagnostic criteria and instruments do not seem to adequately capture the complexity of the disorder in this developmental phase. Accordingly, there are limited data on the proportion of adults affected by the disorder, specially in developing countries. Method: We assessed a representative household sample of the Brazilian population for ADHD with the Adult ADHD Self-report Scale (ASRS) Screener, and evaluated the instrument according to the Rasch model of item response theory. Results: The sample was comprised by 3007 individuals, and the overal prevalence of positive screeners for ADHD was 5.8% [95% confidence interval (CI), 4.8-7.0]. Rasch analyses revealed the misfitt of the overall sample to expectations of the model. The evaluation of the sample stratified by age revealed that data for adolescents showed a signficant fittnes to the model expectations, while items completed by adults were not adequated. Conclusions: The lack of fitness to the model for adult respondents challenges the possibility of a linear transformation of the ordinal data into interval measures and the utilization of parametric analyses of data. This result suggests that diagnostic criteria and instruments for adult ADHD must take into account a developmental perspective. Moreover, it calls for further evaluation of currently employed research methods in light of modern theories of psychometrics. Copyright (C) 2010 John Wiley & Sons, Ltd.

Validation of the Edinburgh Postnatal Depression Scale for men, and comparison of item endorsement with their partners

Background: The Edinburgh Postnatal Depression Scale (EPDS) has been validated and used extensively in screening for depression in new mothers, both in English speaking and non-English speaking communities. While some studies have reported the use of the EPDS with Fathers, none have validated it for this group, and thus the appropriate cut-off score for screening for depression or anxiety caseness for this population is not known. Method: Couples were recruited antenatally and interviewed at six weeks postpartum. EPDS scores and distress caseness (depression or anxiety disorders) for 208 fathers and 230 mothers were determined using the Diagnostic Interview Schedule. Results: Analyses of the EPDS for fathers using distress caseness (depression or anxiety disorders) as the criterion shows that a cut-off of 5/6 has optimum receiver operating characteristics. Furthermore acceptable reliability (split-half and internal consistency) and validity (concurrent) coefficients were obtained. For mothers the optimum cut-off screening value to detect distress caseness was 7/8. Item analysis revealed that fathers endorsed seven of the ten items at lower rates to mothers, with the most significant being that referring to crying. Conclusions: The EPDS is a reliable and valid measure of mood in fathers. Screening for depression or anxiety disorders in fathers requires a two point lower cut-off than screening for depression or anxiety in mothers, and we recommend this cut-off to he 5/6. (C) 2001 Elsevier Science B.V. All rights reserved.

Evaluating two morningness scales with item response theory

Using a student sample (n = 692) and an organization sample (n = 180), we scrutinized two morning-evening orientation scales using item response theory (IRT) methods. We used IRT to compare the measurement precision of the Composite Scale (CS) and the Early/Late Preferences Scale (PS). The CS had slightly higher measurement precision at all ranges of orientations, except for extreme morning and evening orientations for which the PS had slightly higher precision. IRT item-level statistics were also computed to try to understand how morning-orientation items functioned. Items that asked questions about morning activities tended to be more discriminating indicators of morning-orientation than items that asked about evening or peak performance activities. Items that involved unpleasant activities were less frequently endorsed than items that involved neutral or enjoyable activities. Implications for measurement of morning-evening orientation are discussed. (C) 2002 Elsevier Science Ltd. All rights reserved.

Instrumento mensurador de adesão para hipertensos: contribuição da Teoria da Resposta ao Item

OBJETIVO: Analisar instrumento de medição da adesão ao tratamento da hipertensão por meio da "Teoria da Resposta ao Item".MÉTODOS: Estudo analítico com 406 hipertensos com complicações associadas, atendidos na atenção básica em Fortaleza, CE, 2011, pela "Teoria da Resposta ao Item". As etapas de execução foram: teste de dimensionalidade, calibração dos itens; tratamento dos dados e construção da escala, analisadas com base no modelo de resposta gradual. Estudo da dimensionalidade do instrumento foi feito pela análise da matriz de correlação policórica e análise fatorial de informação completa. Utilizou-se o software Multilog para calibração dos itens e estimação dos escores.RESULTADOS: Os itens referentes ao tratamento medicamentoso foram os mais diretamente relacionados à adesão, enquanto aqueles referentes ao tratamento não medicamentoso precisam ser reformulados, pois possuíram menor quantidade de informação psicométrica e baixa discriminação. A independência dos itens, o reduzido número de níveis da escala e as baixas variâncias explicadas no ajuste dos modelos mostraram as principais fragilidades do instrumento analisado. A "Teoria da Resposta ao Item" mostrou-se relevante para análise, pois avaliou o respondente quanto à adesão ao tratamento da hipertensão, ao nível de dificuldade dos itens e à sua capacidade de discriminação entre indivíduos com diferentes níveis de adesão, o que gerou maior quantidade de informação.CONCLUSÕES: O instrumento analisado é limitado para medir a adesão ao tratamento da hipertensão, mediante análise pela "Teoria da Resposta ao Item", e necessita de ajustes. A adequada formulação dos itens é importante para medir precisamente o traço latente desejado.

HIV/AIDS knowledge among men who have sex with men: applying the item response theory

OBJECTIVE To evaluate the level of HIV/AIDS knowledge among men who have sex with men in Brazil using the latent trait model estimated by Item Response Theory. METHODS Multicenter, cross-sectional study, carried out in ten Brazilian cities between 2008 and 2009. Adult men who have sex with men were recruited (n = 3,746) through Respondent Driven Sampling. HIV/AIDS knowledge was ascertained through ten statements by face-to-face interview and latent scores were obtained through two-parameter logistic modeling (difficulty and discrimination) using Item Response Theory. Differential item functioning was used to examine each item characteristic curve by age and schooling. RESULTS Overall, the HIV/AIDS knowledge scores using Item Response Theory did not exceed 6.0 (scale 0-10), with mean and median values of 5.0 (SD = 0.9) and 5.3, respectively, with 40.7% of the sample with knowledge levels below the average. Some beliefs still exist in this population regarding the transmission of the virus by insect bites, by using public restrooms, and by sharing utensils during meals. With regard to the difficulty and discrimination parameters, eight items were located below the mean of the scale and were considered very easy, and four items presented very low discrimination parameter (< 0.34). The absence of difficult items contributed to the inaccuracy of the measurement of knowledge among those with median level and above. CONCLUSIONS Item Response Theory analysis, which focuses on the individual properties of each item, allows measures to be obtained that do not vary or depend on the questionnaire, which provides better ascertainment and accuracy of knowledge scores. Valid and reliable scales are essential for monitoring HIV/AIDS knowledge among the men who have sex with men population over time and in different geographic regions, and this psychometric model brings this advantage.

Investment focused strategies in electricity markets using the ITEM-game simulator

This paper presents a methodology to establish investment and trading strategies of a power generation company. These strategies are integrated in the ITEM-Game simulator in order to test their results when played against defined strategies used by other players. The developed strategies are focused on investment decisions, although trading strategies are also implemented to obtain base case results. Two cases are studied considering three players with the same trading strategy. In case 1, all players also have the same investment strategy driven by a market target share. In case 2, player 1 has an improved investment strategy with a target share twice of the target of players 2 and 3. Results put in evidence the influence of the CO2 and fuel prices in the company investment decision. It is also observed the influence of the budget constraint which might prevent the player to take the desired investment decision.

Criação de uma escala de satisfação com a vida por meio da Teoria da Resposta ao Item

RESUMO Objetivo A satisfação com a vida é um julgamento cognitivo de alguns domínios específicos na vida e depende de uma comparação entre as circunstâncias de vida do indivíduo e um padrão por ele estabelecido. O objetivo deste estudo foi construir uma escala de satisfação com a vida por meio da Teoria da Resposta ao Item (TRI). Métodos Para a criação da escala, foi utilizado o questionário “Estilo de Vida e Hábitos de Lazer de Trabalhadores da Indústria” e a Teoria da Resposta ao Item com base no modelo de resposta gradual proposto por Samejima. Participaram do estudo 47.477 trabalhadores brasileiros da indústria. Resultados A escala contou com sete itens do bloco de perguntas “indicadores de saúde e comportamentos preventivos”, com assuntos relacionados ao estado de saúde, qualidade de sono, nível de estresse, sentimento de tristeza ou depressão e percepção de vida no lar, no trabalho e no lazer. Conclusão São poucos os estudos que tiveram seu foco direcionado à satisfação com a vida no Brasil, e aqueles que de alguma forma o abordaram incluíram somente uma questão específica sobre felicidade ou satisfação de vida, principalmente em estudos sobre o bem-estar subjetivo. Os resultados mostraram que a TRI foi eficiente para criar a escala, medindo principalmente aqueles indivíduos com valores intermediários de satisfação com a vida.