Student, school, and country differences in sustained test-taking effort in the 2009 PISA reading assessment

In this article, the change in examinee effort during an assessment, which we will refer to as persistence, is modeled as an effect of item position. A multilevel extension is proposed to analyze hierarchically structured data and decompose the individual differences in persistence. Data from the 2009 Program of International Student Achievement (PISA) reading assessment from N = 467,819 students from 65 countries are analyzed with the proposed model, and the results are compared across countries. A decrease in examinee effort during the PISA reading assessment was found consistently across countries, with individual differences within and between schools. Both the decrease and the individual differences are more pronounced in lower performing countries. Within schools, persistence is slightly negatively correlated with reading ability; but at the school level, this correlation is positive in most countries. The results of our analyses indicate that it is important to model and control examinee effort in low-stakes assessments. (DIPF/Orig.)

Assessment of student engagement among junior high school students and associations with self-esteem, burnout, and academic achievement

The aim of the study was to investigate the structure of affective and cognitive engagement using the Student Engagement Instrument (SEI; Appleton, Christenson, Kim, & Reschly, 2006) and to examine the associations to behavioral engagement, as well as student-reported self-esteem, burnout, and academic achievement among Finnish junior high school students. The analyses were carried out in the main sample of 2,485 students, as well as in an independent sample of 821 students. The results showed that the original five-factor structure of the SEI construed along three affective and two cognitive engagement factors fit the current data relatively well. Affective and cognitive student engagement correlated positively with an independent measure of behavioral engagement. Furthermore, affective and cognitive engagement were positively associated with student-reported self-esteem and academic achievement, and negatively with school burnout. The findings provided corroborating evidence for the psychometric properties and utilization of the SEI instrument for assessing the engagement of junior high school students. (DIPF/Orig.)

Do teacher stereotypes about school tracks function as expectations at the collective level and do they relate to the perception of obstacles in the classroom and to teachers’ self-efficacy beliefs?

The effects of individual teacher expectations have been the subject of intensive research. Results indicate that teachers use their expectations to adapt their interactions with their students to some degree (as summarized in a review by Jussim & Harber, 2005). This can in turn lead to expectancy-confirming student developments. While there are studies on the Pygmalion effect on individual students, there is only little research on teacher judgements of whole classes and schools. Our study aims to extend the perspective of teacher judgements at the collective level to stereotypes within the context of school tracking. The content and structure of teachers’ school track stereotypes are investigated as well as the question of whether these stereotypical judgements are related to teachers’ perception of obstacles to their teaching and their teaching self-efficacy beliefs. Cross-sectional data on 341 teachers at two different school types from the Panel Study at the Research School „Education and Capabilities“ in North Rhine-Westphalia (PARS) (see Bos et al., 2016) were used for two purposes: First, the structure of teachers’ stereotypes was identified via an exploratory factor analysis. Second, in follow-up regression analyses, the stereotype dimensions extracted were used to predict teachers’ perceptions of obstacles to their classroom work and their individual and collective teacher self-efficacy beliefs. Results showed that – after controlling for the average cognitive abilities and the average cultural capital of the students – teacher stereotypes were indeed related to perceived obstacles concerning their classroom work and their self-efficacy beliefs. After a discussion of the strengths and limitations of the present research, the article closes with a short proposal of a future research framework for collective Pygmalion effects. (DIPF/Orig.)