Viewbrics: Formatief evalueren van complexe vaardigheden middels ‘video-rubrics’ in het Voortgezet Onderwijs

Presentatie over de doelstelling en aanpak binnen het Viewbrics-project (www.viewbrics.nl), waarin gekeken wordt naar het effect van het gecombineerd gebruik van tekstuele rubrieken met videovoorbeelden op de kwaliteit van de feedback, mentale modellen en het aanleren van een aantal complexe (21e eeuwse) vaardigheden (samenwerken, presenteren, informatievaardigheden) in het Voortgezet Onderwijs.

A First Step Towards Synthesising Rubrics and Video for the Formative Assessment of Complex Skills

Abstract. The performance objectives used for the formative assessment of com- plex skills are generally set through text-based analytic rubrics[1]. Moreover, video modeling examples are a widely applied method of observational learning, providing students with context-rich modeling examples of complex skills that act as an analogy for problem solving [1]. The purpose of this theoretical paper is to synthesize the components of video modeling and rubrics to support the formative assessment of complex skills. Based on theory, we argue that application of the developed Video Enhanced Rubrics (VER) fosters learners’ development of mental models, quality of provided feedback by various actors and finally, the learners mastery of complex skills.

Answering questions after initial study guides attention during restudy

Though the testing-effect can be boosted by including a restudy phase after answering test questions, we do not know precisely why it does so. One possible explanation is being tested here. The present study measured attention allocation during initial reading and rereading with a remote eye tracker to gain information on the cognitive processes during restudy, with and without prior testing. The results show that at the final study moment, students in the study-test-condition attended longer to information pertaining to the initial test questions as compared to students in the study-only condition (i.e., who did not take the test). No differences in attention allocation were found for information only questioned on a posttest 1 week later. In addition, it was found that performance on the initial test questions heavily affected which information students restudy; students in the study-test-condition paid namely more attention to the answers of questions they answered incorrectly during the initial test than to the answers of the questions they answered correctly on the initial test

The Testing Effect for Learning Principles and Procedures from Texts

The authors explored whether a testing effect occurs not only for retention of facts but also for application of principles and procedures. For that purpose, 38 high school students either repeatedly studied a text on probability calculations or studied the text, took a test on the content, restudied the text, and finally took the test a second time. Results show that testing not only leads to better retention of facts than restudying, but also to better application of acquired knowledge (i.e., principles and procedures) in high school statistics. In other words, testing seems not only to benefit fact retention, but also positively affects deeper learning.

Viewbrics: Formative Assessment of Complex Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education

To learn complex skills, like collaboration, learners need to acquire a concrete and consistent mental model of what it means to master this skill. If learners know their current mastery level and know their targeted mastery level, they can better determine their subsequent learning activities. Rubrics support learners in judging their skill performance as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models with contextualized, time-related and observable behavioral aspects of a complex skill. This paper outlines the design of a study that intends to investigate the effect of rubrics with video modelling examples compared to text-based rubrics on skills acquisition and feedback provisioning. The hypothesis is that video-enhanced rubrics, compared to text based rubrics, will improve mental model formation of a complex skill and improve the feedback quality a learner receives (from e.g. teachers, peers) while practicing a skill, hence positively effecting final mastery of a skill.

A First Step Towards Video Enhanced Rubrics for the Formative Assessment of Complex Skills : A literature review and a plea

Paper presentation at the TEA2016 conference, Tallinn, Estonia.

Validation of the self-regulated online learning questionnaire

Abstract The number of students engaged in Massive Open Online Courses (MOOCs) is increasing rapidly. Due to the autonomy of students in this type of education, students in MOOCs are required to regulate their learning to a greater extent than students in traditional, face-to-face education. However, there is no questionnaire available suited for this online context that measures all aspects of self-regulated learning (SRL). In this study, such a questionnaire is developed based on existing SRL questionnaires. This is the self-regulated online learning ques- tionnaire. Exploratory factor analysis (EFA) on the first dataset led to a set of scales differing from those theoretically defined beforehand. Confirmatory factor analysis (CFA) was conducted on a second dataset to compare the fit of the theoretical model and the exploratively obtained model. The exploratively obtained model provided much better fit to the data than the theoretical model. All models under investigation provided better fit when excluding the task strategies scale and when merging the scales measuring metacognitive activities. From the results of the EFA and the CFA it can be concluded that further development of the questionnaire is necessary.