Student, school, and country differences in sustained test-taking effort in the 2009 PISA reading assessment

In this article, the change in examinee effort during an assessment, which we will refer to as persistence, is modeled as an effect of item position. A multilevel extension is proposed to analyze hierarchically structured data and decompose the individual differences in persistence. Data from the 2009 Program of International Student Achievement (PISA) reading assessment from N = 467,819 students from 65 countries are analyzed with the proposed model, and the results are compared across countries. A decrease in examinee effort during the PISA reading assessment was found consistently across countries, with individual differences within and between schools. Both the decrease and the individual differences are more pronounced in lower performing countries. Within schools, persistence is slightly negatively correlated with reading ability; but at the school level, this correlation is positive in most countries. The results of our analyses indicate that it is important to model and control examinee effort in low-stakes assessments. (DIPF/Orig.)

Comics as a literary-didactic method and their use for reducing gender differences in reading literacy at the primary level of education

The aim of the present study was to examine the effect of the systematic use of comics as a literary-didactic method to reduce gender differences in reading literacy and reading motivation at the primary level of education. It was assumed that the use of comics would have a positive effect on pupils’ reading literacy and reading motivation, while also reducing the aforementioned differences between boys and girls. The dimensions of reading literacy and reading motivation were examined in experimental and control groups, before and after the intervention, by means of questionnaires and tests for pupils. The sample consisted of 143 pupils from second to fifth grade from two Slovenian primary schools in a rural environment, of which 73 pupils participated in the experimental group and 70 pupils represented the control group. Effects of the use of comics as a literary-didactic method were not found: using comics as a literary-didactic method did not have a statistically significant effect on pupils’ reading literacy and reading motivation. However, when the four-way structure of the research (taking into account the age and gender of the pupils) was considered, some subgroups showed a statistically significant increase in reading interest and attitude towards reading. No reduction of gender differences in reading literacy and reading motivation was found. Based on the results, guidelines for further research are established and suggestions are offered for teachers’ work. (DIPF/Orig.)