Student, school, and country differences in sustained test-taking effort in the 2009 PISA reading assessment

In this article, the change in examinee effort during an assessment, which we will refer to as persistence, is modeled as an effect of item position. A multilevel extension is proposed to analyze hierarchically structured data and decompose the individual differences in persistence. Data from the 2009 Program of International Student Achievement (PISA) reading assessment from N = 467,819 students from 65 countries are analyzed with the proposed model, and the results are compared across countries. A decrease in examinee effort during the PISA reading assessment was found consistently across countries, with individual differences within and between schools. Both the decrease and the individual differences are more pronounced in lower performing countries. Within schools, persistence is slightly negatively correlated with reading ability; but at the school level, this correlation is positive in most countries. The results of our analyses indicate that it is important to model and control examinee effort in low-stakes assessments. (DIPF/Orig.)

Perceived learning environments and metacognitive strategy knowledge at the upper secondary school level

There is evidence that students benefit from teachers’ explicit fostering of metacognitive strategy knowledge (MSK). However, there is insufficient understanding about the effect of implicit promotion of MSK in regular school instruction. This study investigates the relationship between perceived characteristics of learning environments (social climate, support, autonomy, self-reflection) and students’ MSK. A representative cohort of students (Nt1 = 1,272/Nt2 = 1,126) in Grades 10 and 11 at schools at the upper secondary education level (ISCED Level 3A) in Switzerland participated in this two-wave longitudinal study. Multilevel analysis showed effects on both the individual and the class level. Students who experienced higher social integration showed a higher extent of MSK at the beginning of the school year than students who experienced less social integration. Perceived autonomy was also positively related to students’ MSK on the individual level. In contrast, the results showed a negative relationship between perceived self-reflection and students’ MSK. On the class level, there was a negative relationship between self-reflection and students’ MSK. Teachers’ support did not correlate with students’ MSK on either the individual or the class level. Implications of these results for education and further studies are discussed. (DIPF/Orig.)