Student, school, and country differences in sustained test-taking effort in the 2009 PISA reading assessment

In this article, the change in examinee effort during an assessment, which we will refer to as persistence, is modeled as an effect of item position. A multilevel extension is proposed to analyze hierarchically structured data and decompose the individual differences in persistence. Data from the 2009 Program of International Student Achievement (PISA) reading assessment from N = 467,819 students from 65 countries are analyzed with the proposed model, and the results are compared across countries. A decrease in examinee effort during the PISA reading assessment was found consistently across countries, with individual differences within and between schools. Both the decrease and the individual differences are more pronounced in lower performing countries. Within schools, persistence is slightly negatively correlated with reading ability; but at the school level, this correlation is positive in most countries. The results of our analyses indicate that it is important to model and control examinee effort in low-stakes assessments. (DIPF/Orig.)

Does gender make a difference? Gender-related fairness of high-stakes testing in A-level examinations in English as foreign language in the German state of North Rhine-Westphalia in the context of Educational Governance

The shift from decentralized to centralized A-level examinations (Abitur) was implemented in the German school system as a measure of Educational Governance in the last decade. This reform was mainly introduced with the intention of providing higher comparability of school examinations and student achievement as well as increasing fairness in school examinations. It is not known yet if these ambitious aims and functions of the new centralized examination format have been achieved and if fairer assessment can be guaranteed in terms of providing all students with the same opportunities to pass the examinations by allocating fair tests to different student subpopulations e.g., students of different background or gender. The research presented in this article deals with these questions and focuses on gender differences. It investigates gender-specific fairness of the test items in centralized Abitur examinations as high school exit examinations in Germany. The data are drawn from Abitur examinations in English (as a foreign language). Differential item functioning (DIF) analysis reveals that at least some parts of the examinations indicate gender inequality. (DIPF/Orig.)

Assessment of student engagement among junior high school students and associations with self-esteem, burnout, and academic achievement

The aim of the study was to investigate the structure of affective and cognitive engagement using the Student Engagement Instrument (SEI; Appleton, Christenson, Kim, & Reschly, 2006) and to examine the associations to behavioral engagement, as well as student-reported self-esteem, burnout, and academic achievement among Finnish junior high school students. The analyses were carried out in the main sample of 2,485 students, as well as in an independent sample of 821 students. The results showed that the original five-factor structure of the SEI construed along three affective and two cognitive engagement factors fit the current data relatively well. Affective and cognitive student engagement correlated positively with an independent measure of behavioral engagement. Furthermore, affective and cognitive engagement were positively associated with student-reported self-esteem and academic achievement, and negatively with school burnout. The findings provided corroborating evidence for the psychometric properties and utilization of the SEI instrument for assessing the engagement of junior high school students. (DIPF/Orig.)