Use of multilevel logistic regression to identify the causes of differential item functioning

Resumen tomado de la publicaci??n

A comparison of discriminant logistic regression and Item Response Theory Likelihood-Ratio Tests for Differential Item Functioning (IRTLRDIF) in polytomous short tests

Resumen tomado de la publicaci??n

X-ray your data with Rasch

By using the Rasch model, much detailed diagnostic information is available to developers of survey and assessment instruments and to the researchers who use them. We outline an approach to the analysis of data obtained from the administration of survey instruments that can enable researchers to recognise and diagnose difficulties with those instruments and then to suggest remedial actions that can improve the measurement properties of the scales included in questionnaires. We illustrate the approach using examples drawn from recent research and demonstrate how the approach can be used to generate figures that make the results of Rasch analyses accessible to non-specialists.

Evaluation of a skin self examination attitude scale using an item response theory model approach

Introduction The Skin Self-Examination Attitude Scale (SSEAS) is a brief measure that allows for the assessment of attitudes in relation to skin self-examination. This study evaluated the psychometric properties of the SSEAS using Item Response Theory (IRT) methods in a large sample of men ≥ 50 years in Queensland, Australia. Methods A sample of 831 men (420 intervention and 411 control) completed a telephone assessment at the 13-month follow-up of a randomized-controlled trial of a video-based intervention to improve skin self-examination (SSE) behaviour. Descriptive statistics (mean, standard deviation, item–total correlations, and Cronbach’s alpha) were compiled and difficulty parameters were computed with Winsteps using the polytomous Rasch Rating Scale Model (RRSM). An item person (Wright) map of the SSEAS was examined for content coverage and item targeting. Results The SSEAS have good psychometric properties including good internal consistency (Cronbach’s alpha = 0.80), fit with the model and no evidence for differential item functioning (DIF) due to experimental trial grouping was detected. Conclusions The present study confirms the SSEA scale as a brief, useful and reliable tool for assessing attitudes towards skin self-examination in a population of men 50 years or older in Queensland, Australia. The 8-item scale shows unidimensionality, allowing levels of SSE attitude, and the item difficulties, to be ranked on a single continuous scale. In terms of clinical practice, it is very important to assess skin cancer self-examination attitude to identify people who may need a more extensive intervention to allow early detection of skin cancer.

Validation of a mobility item bank for older patients in primary care

Background: To develop and validate an item bank to measure mobility in older people in primary care and to analyse differential item functioning (DIF) and differential bundle functioning (DBF) by sex. Methods: A pool of 48 mobility items was administered by interview to 593 older people attending primary health care practices. The pool contained four domains based on the International Classification of Functioning: changing and maintaining body position, carrying, lifting and pushing, walking and going up and down stairs. Results: The Late Life Mobility item bank consisted of 35 items, and measured with a reliability of 0.90 or more across the full spectrum of mobility, except at the higher end of better functioning. No evidence was found of non-uniform DIF but uniform DIF was observed, mainly for items in the changing and maintaining body position and carrying, lifting and pushing domains. The walking domain did not display DBF, but the other three domains did, principally the carrying, lifting and pushing items. Conclusions: During the design and validation of an item bank to measure mobility in older people, we found that strength (carrying, lifting and pushing) items formed a secondary dimension that produced DBF. More research is needed to determine how best to include strength items in a mobility measure, or whether it would be more appropriate to design separate measures for each construct.

Uncovering the root cause of ethnic difference in ability testing:differential test functioning, test familiarity and trait optimism as explanations of ethnic group differences

The present research represents a coherent approach to understanding the root causes of ethnic group differences in ability test performance. Two studies were conducted, each of which was designed to address a key knowledge gap in the ethnic bias literature. In Study 1, both the LR Method of Differential Item Functioning (DIF) detection and Mixture Latent Variable Modelling were used to investigate the degree to which Differential Test Functioning (DTF) could explain ethnic group test performance differences in a large, previously unpublished dataset. Though mean test score differences were observed between a number of ethnic groups, neither technique was able to identify ethnic DTF. This calls into question the practical application of DTF to understanding these group differences. Study 2 investigated whether a number of non-cognitive factors might explain ethnic group test performance differences on a variety of ability tests. Two factors – test familiarity and trait optimism – were able to explain a large proportion of ethnic group test score differences. Furthermore, test familiarity was found to mediate the relationship between socio-economic factors – particularly participant educational level and familial social status – and test performance, suggesting that test familiarity develops over time through the mechanism of exposure to ability testing in other contexts. These findings represent a substantial contribution to the field’s understanding of two key issues surrounding ethnic test performance differences. The author calls for a new line of research into these performance facilitating and debilitating factors, before recommendations are offered for practitioners to ensure fairer deployment of ability testing in high-stakes selection processes.

The effects of linguistic factors on student performance on economics multiple choice questions

This paper proposes a framework to analyse performance on multiple choice questions with the focus on linguistic factors. Item Response Theory (IRT) is deployed to estimate ability and question difficulty levels. A logistic regression model is used to detect Differential Item Functioning questions. Probit models testify relationships between performance and linguistic factors controlling the effects of question construction and students’ background. Empirical results have important implications. The lexical density of stems affects performance. The use of non-Economics specialised vocabulary has differing impacts on the performance of students with different language backgrounds. The IRT-based ability and difficulty help explain performance variations.

The structure of amorphous platinum disulfide as studied by anomalous x-ray-scattering

Anomalous X-ray scattering (AXS) has been applied to study the structure of amorphous platinum disulfide, Pt1-xS2, prepared by the precipitation process. The local atomic arrangement in amorphous Pt1-xS2 was determined by the least-squares variational method so as to reproduce the experimental differential interference function at the Pt L(III) absorption edge by the AXS method as well as the ordinary interference function by MoK alpha. The structural unit in amorphous Pt1-xS2 is found to be a PtS6 octahedron, similar to that in crystalline PtS2. These octahedra share both their corners and edges, while only edge-sharing linkages occur in crystalline PtS2.

社会发展与中国人人格变迁——控制测验理论与工具的变异后不同时期的中国人人格差异研究

In non-western society，researches on social development and personality change focused on economic development and social modernization. The present study is aimed at exploring the relationship between the social transformation and personality changes of Chinese people by using so-called indigenous personality measurement of CPAI (Chinese Personality Assessment Inventory). Meanwhile, the influence of CPAI measurement itself and measurement theory were also taken into consideration. In study 1, two sets of CPAI data collected in a 10 year interval were analyzed. At the same time, the CPAI-2 data was analyzed in terms of modernization level of various cities from which the data were collected. However, this study didn’t consider the importance of “equivalence” of the measurement, CPAI. In study 2, we detected DIF (Differential item functioning) across the different period groups to confirm if CPAI was equal to people in different period. In this process, both CTT and IRT method were used. The outcome reminded us that there were some DIF items. In study 3, to make sure that the personality measurement is fair to people in different period, we only saved those items whose DIF effect size lower than 0.01, and used IRT method to estimate test-taker’s personality. Then, cohort analysis was used to explore the pattern of personality change of Chinese people. In study 4, we factor-analyzed the DIF items to find the relation between social transformation and the latent personality variable which were composed of DIF items. From these 4 studies, we could got the following conclusions: (1) The CPAI 22 traits could be divided into two categories, with the changing of age, period and cohort, type I traits didn’t change, they were Logical vs Affective Orientation, Enterprise, Responsibility, Inferiority vs Self-Acceptance, Optimism vs Pessimism, Face, Family, Defensive, Graciousness vs Meanness; While with the changing of age, period and cohort, type II traits changed, they were Leadership, Self vs. Social Orientation, Veraciousness vs Slickness, Traditionalism vs Modernity, Harmony, Renqing, Meticulousness, Extraversion vs Introversion, Emotionality, Practical Mindedness, Internal vs External Locus of Control, Thrift vs Extravagance, Discipline. Meanwhile DIF items measured 5 psychologycial characteristics which changed greatly with the changing of age, period and cohort, they were Life attitude of Cynicism-realism, Psychological maladjustment, Coping style of Waiyuanneifang, Self-efficacy, the value of Individualism. (2) In sum, Chinese people in 1992 were more traditional than those in 2001, and with the 10-year of rapid development, according to the market economy’s needs, Chinese people became more individualism. (3) The DIF method of CTT and IRT were comparable. But, in generally, IRT method was more accurate and valid in detecting DIF as were as estimating personality. (4) The DIF outcomes showed that CPAI had good item validity. Meanwhile, it’s possible to develop a subscale by using CPAI items to assess some psychological characteristics. In this current study, according to their stability and variability, we could divided personality traits and psychological characteristics into 3 categories, and the outcome supported the hypothesis of “Six Factor Model”, these foundings were of some theoretic meanings. Meanwhile, as the relation between social development and personality change being explored, it certain help Chinese people cope with the rapid changing society. In this study, we also found that it’s possible to develop a subscale by using CPAI items to assess obverse personality traits and it had some practical use. Furthermore, the use of different measurement theory and cohort analysis embodied some innovation in methodology.

Segmentation du rein fonctionnel à partir de CTdouble énergie injectés

Les néphropaties (maladie des tissus rénaux) postradiques constituent l'un des facteurs limitants pour l'élaboration des plans de traitement lors des radiothérapies abdominales. Le processus actuel, qui consiste à évaluer la fonctionnalité relative des reins grâce à une scintigraphie gamma deux dimensions, ne permet pas d'identifier les portions fonctionnelles qui pourraient être évitées lors de l' élaboration des plans de traitement. Une méthode permettant de cartographier la fonctionnalité rénale en trois dimensions et d'extraire un contour fonctionnel utilisable lors de la planification a été développée à partir de CT double énergie injectés à l'iode. La concentration en produit de contraste est considérée reliée à la fonctionnalité rénale. La technique utilisée repose sur la décomposition à trois matériaux permettant de reconstruire des images en concentration d'iode. Un algorithme de segmentation semi-automatisé basé sur la déformation hiérarchique et anamorphique de surfaces permet ensuite d'extraire le contour fonctionnel des reins. Les premiers résultats obtenus avec des images patient démontrent qu'une utilisation en clinique est envisageable et pourra être bénéfique.

Funcionamiento diferencial de los items en una situaci??n de contacto de lenguas

Resumen tomado de la publicaci??n

Factores relacionados con el manejo quirúrgico de estrechez de la unión pieloureteral en niños

Objetivo: Describir los factores relacionados con la toma de decisión de manejo quirúrgico en pacientes con hidronefrosis secundaria a estrechez de la unión pieloureteral en el servicio de Urología Pediátrica de una institución de IV nivel. Materiales y Métodos: Se realizó un estudio descriptivo retrospectivo. Se seleccionaron por conveniencia a 100 pacientes con diagnóstico antenatal de hidronefrosis, 37 fueron llevados a manejo quirúrgico por estrechez de la unión pieloureteral (EUPU) entre los años 2009 y 2012. Se evaluaron los factores que llevaron a la toma| de esta decisión. Resultados: Los pacientes con diagnóstico postnatal de EUPU representaron el 37% de la población, la indicación de manejo quirúrgico en 13 pacientes (35,1%) fue dilatación caliceal (SFU 3), en 21 pacientes (56,8%) de deterioro de la función renal y en los restantes (8,1%) infección urinaria recurrente. Se encontró una progresión de 30% en la severidad de la dilatación en el periodo postnatal, habían 9 pacientes (24% de la muestra) SFU de 3 y 4 en el periodo prenatal y 20 (54%) en el periodo postnatal que fueron llevados a manejo quirúrgico. De los pacientes que disponíamos de datos precisos de valores de variación porcentual de gammagrafía 16% de la muestra, se encontró que había una variación del 50% en deterioro de la función renal. Conclusión: En el grupo de pacientes colombianos de la consulta externa del servicio de urología pediátrica estudiado se encontró que la decisión de manejo quirúrgico en pacientes con EUPU, está en concordancia con lo encontrado en la literatura mundial, siendo estos la presencia de dilatación caliceal deterioro de la función renal en gammagrafía DMSA.

Testing the structural and cross-cultural validity of the KIDSCREEN-27 quality of life questionnaire

OBJECTIVES: The aim of this study is to assess the structural and cross-cultural validity of the KIDSCREEN-27 questionnaire. METHODS: The 27-item version of the KIDSCREEN instrument was derived from a longer 52-item version and was administered to young people aged 8-18 years in 13 European countries in a cross-sectional survey. Structural and cross-cultural validity were tested using multitrait multi-item analysis, exploratory and confirmatory factor analysis, and Rasch analyses. Zumbo's logistic regression method was applied to assess differential item functioning (DIF) across countries. Reliability was assessed using Cronbach's alpha. RESULTS: Responses were obtained from n = 22,827 respondents (response rate 68.9%). For the combined sample from all countries, exploratory factor analysis with procrustean rotations revealed a five-factor structure which explained 56.9% of the variance. Confirmatory factor analysis indicated an acceptable model fit (RMSEA = 0.068, CFI = 0.960). The unidimensionality of all dimensions was confirmed (INFIT: 0.81-1.15). Differential item functioning (DIF) results across the 13 countries showed that 5 items presented uniform DIF whereas 10 displayed non-uniform DIF. Reliability was acceptable (Cronbach's alpha = 0.78-0.84 for individual dimensions). CONCLUSIONS: There was substantial evidence for the cross-cultural equivalence of the KIDSCREEN-27 across the countries studied and the factor structure was highly replicable in individual countries. Further research is needed to correct scores based on DIF results. The KIDSCREEN-27 is a new short and promising tool for use in clinical and epidemiological studies.