Item analysis /

Thesis (M. S.)--University of Illinois at Urbana-Champaign.

Evaluating the properties of a stage-specific self-efficacy scale for physical activity using classical test theory, confirmatory factor analysis and item response modeling

The purpose of this paper was to evaluate the psychometric properties of a stage-specific selfefficacy scale for physical activity with classical test theory (CTT), confirmatory factor analysis (CFA) and item response modeling (IRM). Women who enrolled in the Women On The Move study completed a 20-item stage-specific self-efficacy scale developed for this study [n = 226, 51.1% African-American and 48.9% Hispanic women, mean age = 49.2 (67.0) years, mean body mass index = 29.7 (66.4)]. Three analyses were conducted: (i) a CTT item analysis, (ii) a CFA to validate the factor structure and (iii) an IRM analysis. The CTT item analysis and the CFA results showed that the scale had high internal consistency (ranging from 0.76 to 0.93) and a strong factor structure. Results also showed that the scale could be improved by modifying or eliminating some of the existing items without significantly altering the content of the scale. The IRM results also showed that the scale had few items that targeted high self-efficacy and the stage-specific assumption underlying the scale was rejected. In addition, the IRM analyses found that the five-point response format functioned more like a four-point response format. Overall, employing multiple methods to assess the psychometric properties of the stage-specific self-efficacy scale demonstrated the complimentary nature of these methods and it highlighted the strengths and weaknesses of this scale.

Validation of the Edinburgh Postnatal Depression Scale for men, and comparison of item endorsement with their partners

BACKGROUND: The Edinburgh Postnatal Depression Scale (EPDS) has been validated and used extensively in screening for depression in new mothers, both in English speaking and non-English speaking communities. While some studies have reported the use of the EPDS with fathers, none have validated it for this group, and thus the appropriate cut-off score for screening for depression or anxiety caseness for this population is not known. METHODS: Couples were recruited antenatally and interviewed at six weeks postpartum. EPDS scores and distress caseness (depression or anxiety disorders) for 208 fathers and 230 mothers were determined using the Diagnostic Interview Schedule. RESULTS: Analyses of the EPDS for fathers using distress caseness (depression or anxiety disorders) as the criterion shows that a cut-off of 5/6 has optimum receiver operating characteristics. Furthermore acceptable reliability (split-half and internal consistency) and validity (concurrent) coefficients were obtained. For mothers the optimum cut-off screening value to detect distress caseness was 7/8. Item analysis revealed that fathers endorsed seven of the ten items at lower rates to mothers, with the most significant being that referring to crying. CONCLUSIONS: The EPDS is a reliable and valid measure of mood in fathers. Screening for depression or anxiety disorders in fathers requires a two point lower cut-off than screening for depression or anxiety in mothers, and we recommend this cut-off to be 5/6

Laadukasta yliopisto-opetusta kehittämässä : Laadukkaan yliopisto-opetuksen kehittäminen ja yliopistopedagogisen koulutuksen yhteys opetuksen kehittämiseen Helsingin yliopiston opettajilla

Objectives. The purpose of this study was to examine the development of high-quality university teaching among the teachers of the University of Helsinki. Furthermore, the relation of university pedagogical training to development of teaching was analyzed. This study introduces a new perspective to the research of quality of university teaching by considering quality from the teaching development perspective. The individual level examination was done from teacher's perspective. The development of high-quality university teaching was approached through three factors of teaching development defined by Biggs (2003). These factors are 1) the level of thinking about teaching on which the teaching development is based on (can also be called the quality model), 2) the methods for and 3) the impediments to teaching development. The research of Trigwell and Prosser (1996), Lindblom-Ylänne, Nevgi and Postareff (2004) and Postareff, Lindblom-Ylänne and Nevgi (2007) and the ideas of Ramsden (1992) have been central sources to this study. Methods. This study was a survey study. The data was collected with an electronic questionnaire in the spring of 2007. The sample consisted of 655 person of which some had and some had not university pedagogical training. Total of 251 answered the study. The data was mainly analyzed with SPSS statistical programme. Item analysis, principal component analysis, nonparametric Kruskal-Wallis and Mann-Whitney tests, correlation and crosstabulation were the methods used to analyze the data. Results and conclusions. According to the results it seems that the teachers of the University of Helsinki have good basis for developing high-quality university teaching. The 3rd level of thinking about teaching, which emphasizes student-centred features, could be identified on majority of the teachers. The use of teaching development methods was comprehensive. Most frequently used methods were related to the enhancement of content knowledge. In general the impediments to teaching development were not considered to be very significant. The most significant impediments were the factors related to lack of appreciation of teaching and factors related to lack of time meant for the planning and developing of teaching. Differences were found according to sex, teaching experience, degree, position and faculty. This study also showed that university pedagogical training seems to have a positive relation to the development of high-quality university teaching among the teachers of University of Helsinki. According to the results when the amount of teachers university pedagogical training increased, the 3rd level of thinking about teaching could be identified more often. Teachers also used more often teaching development methods related to cooperation and active participation and enhancement of pedagogical skills. Furthermore, they considered the factors related to lack of pedagogical skills and motivation to be lesser impediments to teaching development.

Modelización de una prueba de afecto hacia la matemática con la teoría de respuesta al ítem

Resumen: Se aplicó el Modelo de Crédito Parcial (MCP) de la Teoría de Respuesta al Ítem (TRI) al análisis de ítems de una escala que mide Afecto hacia la Matemática. Esta variable describe el interés de los estudiantes de Psicología por involucrarse en actividades vinculadas a la matemática y los sentimientos asociados al uso de sus conceptos. La prueba consta de 8 ítems con formato de respuesta Likert de 6 opciones. Participaron 1875 estudiantes de Psicología de la Universidad de Buenos Aires (Argentina) de los cuales un 82% fueron mujeres. El análisis de la consistencia interna brindó un índice altamente satisfactorio (Alfa = .91). Se verificó la condición de unidimensionalidad requerida por el modelo mediante un análisis factorial exploratorio. Todos los análisis basados sobre la TRI se realizaron con el programa Winsteps. La estimación de los parámetros del modelo se efectuó por Máxima Verosimilitud Conjunta. El ajuste del MCP fue satisfactorio para todos los ítems. La Función de Información del Test fue elevada en un rango amplio de niveles del rasgo latente. Un ítem presentó una inversión en dos parámetros de umbral. Como consecuencia, 1 de las 6 categorías del ítem no fue máximamente probable en ningún intervalo de la escala del rasgo latente. Se analizan las implicancias de este hallazgo en la evaluación de la calidad psicométrica del ítem. Los resultados de este estudio permitieron profundizar el análisis del constructo y aportaron evidencias de validez basadas en las estructura interna de la escala

交易型领导的结构和作用机制研究

The Multifactor Leadership theory developed by Bass (1985) has become the new paradigm of leadership research. The empirical results of the effectiveness of transformational and transactional leadership in the literature, however, are not consentient. Researchers in China found the different structure of transformational leadership, but have not developed the transactional leadership. This study attempts to investigate three key questions in the unique Chinese socio-economic context: 1) what is the structure of transactional leadership in China? 2) What are the differences between western countries and China? And 3) what is the relationship between the transformational and transactional leadership mechanism? This study examines data collected from 3,500 participants, using Explored Factor Analysis (EFA), Confirmed Factor Analysis (CFA), Hierarchical Regression Analyses, partial correlations and other statistics methods. The major finings are listed as follows： Firstly, inductive methods was used to explore the structure of transactional leadership and the result show that transactional leadership is a four dimensions structure which includes contingent reward, contingent punishment , process control and anticipated investment. Reliability analysis, item analysis, EFA and CFA show the reliability and validity of the transactional leadership questionnaire we designed is good enough, the design of the item is effectively and properly. Contrast to other researches, anticipated investment emphasis on the leader’s recessive investment for subordinate, and this kind of transaction is quite special under the Chinese culture. While the content of the contingent reward with the contingent punishment is wider than the contingent reward in the western country, and the process control is wider than the management by exception and including goal setting and the management during the process. Secondly, hierarchical regression analyses showed that transformational and transactional leadership were significant positively related with in-role performance, extra-role performance, satisfaction and leadership effectiveness while negatively related to intention to leave. The effects of transactional and transformational leadership are different. Transactional leadership could significantly predict intention to leave controlling for transformational leadership, while transformational leadership could significantly predict in-role performance, extra-role performance, satisfaction and leadership effectiveness controlling for transactional leadership. Thirdly, the income level and the rank of subordinates are the moderators between the transformational, transactional leadership and leadership effectiveness. The leadership effectiveness of transactional leadership would decrease as the rank of subordinates increased, while the leadership effectiveness of transformational leadership would increase as the rank of subordinates increased. Transactional leadership is positively related to the effectiveness when the level of the subordinate income is low, but negatively related to the effectiveness when the level of the subordinate income is high. However the income level of the subordinate could not influence the leadership effectiveness of transformational leadership.

心理测验中项目表述效应的特点、机制和预测因素研究

心理测验中项目的表述效应是测量误差的一个重要来源。本研究借助焦虑控制问卷，探讨心理量表中项目表述效应的心理测量学特点和其产生的方法学上的原因。研究首先考察了项目表述效应在不同的群体间的交互效度验证；然后通过反转项目表述方向的方法，构造出原问卷项目的相反表达的项目，进而通过不同组合形成四个版本的问卷，经过量表层面和项目层面的分析，考查了项目表述效应的心理测量学特点。然后通过项目反应理论分析和实验研究，考查了项目反应理论产生的作用机制。研究最后还考查了人格因素对项目表述效应的影响。主要研究结果如下： 1． 焦虑控制问卷（ACQ）中项目表述效应稳定的存在，中文版问卷的主要结构是一个特质性因子，另外还有两个方法因子。这一结构很好的拟合了中国被试的数据，不管是单个量表验证的结果还是两组被试交互验证的结果都支持这一结构； 2． 通过反ACQ问卷，构造了四个版本的量表，对四个版本验证性因素分析的结果表明，全正向表述项目量表和全反向表述项目量表没有项目表述效应出现，而同时存在正向和反向表述项目的原文卷和反转问卷都出现了方法效应；正向项目和反向项目得分分析的结果表明，总分上只有原量表和全反向量表没有显著差异，原量表和全正量表与全反量表都有显著的差异，表明项目表述效应的出项只和反向表述项目的反向记分有关； 3． 基于项目层面的研究中，用Rasch模型中的Rating Scale Model和full information Bifactor item Analysis 分别去拟合数据，发现Rasch模型对数据的拟合不好，而Bifactor items Analysis 对数据的拟合稍好一些，说明焦虑控制问卷中的项目表述效应因子与特质因子确实不是在同一个水平上的因子，表述效应因子是次级因子； 4． 项目表述效应的产生机制是由于人们只对与自己特质水平最近的项目作是的反应，而对与自己实际特质水平较远的项目作否的反应模式特点造成的； 5． 关于人格对项目表述效应出现的预测作用研究表明，自尊、社会赞许性对反向表述效应因子的产生具有正向预测作用，而行为抑制、行为激活和负向评价恐惧对反向表述因子的出现具有负向的预测作用。 总而言之，本研究得出的结论是，项目表述效应是一种人为造成的方法效应，它是被试只对与自己特质水平最近的项目作是的反应，而对与自己实际特质水平较远的项目作否的反应模式特点造成的。但同时，它又不是完全没有意义的“讨厌”因子，一些人格因素可以预测它的出现，即它的出现受到一些人格因素的影响。

Hannoversche Korruptionsskala (HKS 38)

Mit der Hannoverschen Korruptionsskala (HKS 38) kann die Einstellung gegenüber Korruption gemessen werden. Die HKS 38 besteht aus 38 Items, die den Subskalen kognitiv, affektiv und konativ zugeordnet werden können. Die 38 Items der Endversion wurden anhand studentischer Stichproben (n=709) per Itemanalyse nach den Regeln der klassischen Testtheorie aus 130 Items selektiert. Für die Gesamtskala sowie die drei Subskalen stehen einheitliche Normen zur Verfügung. Die Daten für die Normierung wurden in einer repräsentativen Telefonumfrage innerhalb der deutschsprachigen Wohnbevölkerung erhoben (n=1.391). Der Einsatzbereich der Skala ist ab 18 Jahre.

Psychometric Properties of the Inventário Dimensional Clínico da Personalidade (IDCP) using the Rating Scale Model

The aim of this study was to evaluate the performance of the Dimensional Clinical Personality Inventory (DCPI) using Rasch-based person and item analysis. 1281 participants were recruited, between 18 and 90 years of age (M=26.64; SD=8.94), 431 men (33.6%) and 127 (9.9%) patients diagnosed with axis I disorders and/or axis II according to DSM-IV-TR. Results indicated the IDCP scales performed reasonably well, and the usefulness of the analyses presented, demonstrate the Rasch model’s applicability for clinical applications. Among the important tools offered by the Rasch model, we explore the use of the person-item map, which visually presents the intuitively understandable psychological construct along the dimensional scale of the instrument.

Evaluación de la validez de la escala llanto para el dolor en neonatos y menores de cinco años

Introducción: La escala LLANTO para dolor es una escala que hasta la fecha ha sido solo validada en población infantil española, actualmente no se conocen datos en población colombiana. Se pretende validar la escala de dolor LLANTO en pacientes neonatos y menores de 5 años, a través de su aplicación en pacientes atendidos en una de tres instituciones, además comparándola con las escalas FLACC y PIPP dependiendo de edad del paciente. Metodología: Se incluyeron niños con cualquier tipo de dolor, clasificándolos en dos grupos por edad: 1) neonatos y 2) niños entre 1 mes y 5 años de edad, que asistieron a la Fundación Cardioinfantil, Clínica Infantil Colsubsidio o al Hospital Universitario Mayor. Las escalas fueron aplicadas por dos residentes de pediatría y una enfermera especializada en el cuidado de población infantil. Para la prueba piloto se diseñó un cuestionario determinar dificultades en la aplicación de la escala LLANTO. Una vez corregidos los problemas identificados se procederá a la validación de la escala. Resultados: Se presentan los datos de la prueba piloto. Se incluyeron 8 neonatos y 8 niños entre 1 mes y 5 años, esta muestra fue obtenida en un periodo de un mes, con la encuesta se evaluó la aceptación y entendimiento de la escala LLANTO por parte de los evaluadores. La prueba piloto mostró resultados favorables en el 100% de los encuestados. Discusión: Se considera que la escala LLANTO no requiere cambios para continuar con su validación.

A construção e validação de um teste com referência a critério para medir as competências básicas de leitura e escrita para o Programa de Alfabetização Funcional do MOBRAL

A necessidade de se desenvolverem instrumentos adequados a avaliação de programas educacionais é premente no momento atual. Segundo os estudos mais recentes no campo da medida educacional, os testes com referência a critério são os que atendem a esta necessidade. Este estudo teve por objetivo a construção de dois testes deste tipo para a avaliação do Programa de Alfabetização Funcional do MOBRAL nos dominios da aquisição das competências basicas em leitura e escrita. Inicialmente foram selecionadas e descritas quatro competências para serem medidas por cada teste. As competências foram selecionadas tendo como base os objetivos do programa apresentados no Roteiro de Orientação ao Alfabetizador (1977). A segunda etapa do estudo consistiu na criação das especificações para cada competência selecionadas nos dois dominios. A partir destas especificações foram construidos 32 itens para o teste de leitura e 40 para o de escrita. Estes itens foram, distribuidos randomicamente em 5 formas experimentais para cada teste. O teste de leitura é composto de itens de múltipla escolha e o teste de escrita de itens de resposta construida. Os criterios de correção e os padrões minimos de desempenho foram estabelecidos para cada teste. Para a analise destes padrões minimos foram calculados as medias e os desvios-padrão para cada forma aplicada. Estes resultados permitem a manutenção dos padrões minimos usados em estudos posteriores. A análise dos itens foi feita em duas etapas: na primeira foram calculados os indices de discriminância pelo processo tradicional e na segunda os indices de sensitivida de pelo processo desenvolvido por Gronlund (1976). Os resultados obtidos permitiram o aproveitamento de todos os itens. Os itens foram divididos em duas formas equivalentes para cada teste, cada um pode ser subdividido em três subtestes para a medida isolada das competências descritas. Para o exame de validade foram estabelecidos os indices de validade descritiva e de seleção de dominio. A fidedignidade dos testes ficou assegurada com a construção de mais de 5 itens para competência Gronlund (1976).

Refinement and initial validation of a multidimensional composite scale for use in assessing acute postoperative pain in cats

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Development of the Heat and Energy Concept Inventory: Preliminary Results on the Prevalence and Persistence of Engineering Students' Misconceptions

BACKGROUND Students frequently hold a number of misconceptions related to temperature, heat and energy. There is not currently a concept inventory with sufficiently high internal reliability to assess these concept areas for research purposes. Consequently, there is little data on the prevalence of these misconceptions amongst undergraduate engineering students. PURPOSE (HYPOTHESIS) This work presents the Heat and Energy Concept Inventory (HECI) to assess prevalent misconceptions related to: (1) Temperature vs. Energy, (2) Temperature vs. Perceptions of Hot and Cold, (3) Factors that affect the Rate vs. Amount of Heat Transfer and (4) Thermal Radiation. The HECI is also used to document the prevalence of misconceptions amongst undergraduate engineering students. DESIGN/METHOD Item analysis, guided by classical test theory, was used to refine individual questions on the HECI. The HECI was used in a one group, pre-test-post-test design to assess the prevalence and persistence of targeted misconceptions amongst a population of undergraduate engineering students at diverse institutions. RESULTS Internal consistency reliability was assessed using Kuder-Richardson Formula 20; values were 0.85 for the entire instrument and ranged from 0.59 to 0.76 for the four subcategories of the HECI. Student performance on the HECI went from 49.2% to 54.5% after instruction. Gains on each of the individual subscales of the HECI, while generally statistically significant, were similarly modest. CONCLUSIONS The HECI provides sufficiently high estimates of internal consistency reliability to be used as a research tool to assess students' understanding of the targeted concepts. Use of the instrument demonstrates that student misconceptions are both prevalent and resistant to change through standard instruction.

Testing the structural and cross-cultural validity of the KIDSCREEN-27 quality of life questionnaire

OBJECTIVES: The aim of this study is to assess the structural and cross-cultural validity of the KIDSCREEN-27 questionnaire. METHODS: The 27-item version of the KIDSCREEN instrument was derived from a longer 52-item version and was administered to young people aged 8-18 years in 13 European countries in a cross-sectional survey. Structural and cross-cultural validity were tested using multitrait multi-item analysis, exploratory and confirmatory factor analysis, and Rasch analyses. Zumbo's logistic regression method was applied to assess differential item functioning (DIF) across countries. Reliability was assessed using Cronbach's alpha. RESULTS: Responses were obtained from n = 22,827 respondents (response rate 68.9%). For the combined sample from all countries, exploratory factor analysis with procrustean rotations revealed a five-factor structure which explained 56.9% of the variance. Confirmatory factor analysis indicated an acceptable model fit (RMSEA = 0.068, CFI = 0.960). The unidimensionality of all dimensions was confirmed (INFIT: 0.81-1.15). Differential item functioning (DIF) results across the 13 countries showed that 5 items presented uniform DIF whereas 10 displayed non-uniform DIF. Reliability was acceptable (Cronbach's alpha = 0.78-0.84 for individual dimensions). CONCLUSIONS: There was substantial evidence for the cross-cultural equivalence of the KIDSCREEN-27 across the countries studied and the factor structure was highly replicable in individual countries. Further research is needed to correct scores based on DIF results. The KIDSCREEN-27 is a new short and promising tool for use in clinical and epidemiological studies.

Evaluation of an inventory for the assessment of critical incidents involving football fans

Introduction: Fan violence is a frequent occurrence in Swiss football (Bundesamt für Polizei, 2015) leading to high costs for prevention and control (Mensch & Maurer, 2014). Various theories put forward an explanation of fan violence, such as the Elaborated Social Identity Model (Drury & Reicher, 2000)and the Aggravation Mitigation Model (Hylander & Guvå, 2010). Important observations from these theories are the multi-dimensional understanding of fan violence and the Dynamics occurring in the fan group. Nevertheless, none of them deal with critical incidents (CIs) which involve a tense atmosphere combined with a higher risk of fan violence. Schumacher Dimech, Brechbühl and Seiler (2015) tackled this gap in research and explored CIs where 43 defining criteria were identified and compiled in an integrated model of CIs. The defining criteria were categorised in four higher-order themes “antecedents” (e.g. a documented history of fan rivalry), “triggers” (e.g. the arrest of a fan), “reactions” (e.g. fans masking themselves) and “consequences” (e.g. fans avoiding communication with fan social workers). Methods: An inventory based on this model is being developed including these 43 criteria. In an exploratory phase, this inventory was presented as an online questionnaire and was completed by 143 individuals. Three main questions are examined: Firstly, the individual items are tested using descriptive analyses. An item analysis is conducted to test reliability, item difficulty and discriminatory power. Secondly, the model’s four higher-order themes are tested using exploratory factor analysis (EFA). Thirdly, differences between sub -groups are explored, such as gender and age-related differences. Results: Respondents rated the items’ importance as high and the quota of incomplete responses was not systematic. Two items were removed from the inventory because of low mean or a high rate of “don’t know”-responses. EFA produced a six-factor solution grouping items into match-related factors, repressive measures, fans’ delinquent behaviour, intra-group behaviour, communication and control and inter-group factors. The item “fans consume alcohol” could not be ordered into any category but was retained since literature accentuates this factor’s influence on fan violence. Analyses examining possible differences between groups are underway. Discussion: Results exploring the adequacy of this inventory assessing defining criteria of CIs in football are promising and thus further evaluative investigation is recommended. This inventory can be used in two ways: as a standardised instrument of assessment for experts evaluating specific CIs and as an instrument for exploring differences in perception and assessment of a CI e.g. gender and age differences, differences between interest groups and stakeholders.