A First Step Towards Synthesising Rubrics and Video for the Formative Assessment of Complex Skills

Abstract. The performance objectives used for the formative assessment of com- plex skills are generally set through text-based analytic rubrics[1]. Moreover, video modeling examples are a widely applied method of observational learning, providing students with context-rich modeling examples of complex skills that act as an analogy for problem solving [1]. The purpose of this theoretical paper is to synthesize the components of video modeling and rubrics to support the formative assessment of complex skills. Based on theory, we argue that application of the developed Video Enhanced Rubrics (VER) fosters learners’ development of mental models, quality of provided feedback by various actors and finally, the learners mastery of complex skills.

Viewbrics: Formative Assessment of Complex Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education

To learn complex skills, like collaboration, learners need to acquire a concrete and consistent mental model of what it means to master this skill. If learners know their current mastery level and know their targeted mastery level, they can better determine their subsequent learning activities. Rubrics support learners in judging their skill performance as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models with contextualized, time-related and observable behavioral aspects of a complex skill. This paper outlines the design of a study that intends to investigate the effect of rubrics with video modelling examples compared to text-based rubrics on skills acquisition and feedback provisioning. The hypothesis is that video-enhanced rubrics, compared to text based rubrics, will improve mental model formation of a complex skill and improve the feedback quality a learner receives (from e.g. teachers, peers) while practicing a skill, hence positively effecting final mastery of a skill.

A First Step Towards Video Enhanced Rubrics for the Formative Assessment of Complex Skills : A literature review and a plea

Paper presentation at the TEA2016 conference, Tallinn, Estonia.

Using online peer assessment tools to provide feedback and promote learning

A set of slides used for the RAP SIG event on 19 Jan 2017

Pratiche di formative assessment per promuovere abilita di comprensione dei testi. Una sperimentazione in una scuola secondaria di primo grado

I dati delle indagini sugli apprendimenti degli studenti in Italia rivelano l’esistenza di fragilità nell’acquisizione di competenze essenziali e di differenze tra i risultati conseguiti. Per innovare la didattica al fine di adeguarla ai bisogni degli studenti, gli esperti di Docimologia caldeggiano l’uso di pratiche di valutazione formativa, o formative assessment (FA). In ambito internazionale diversi studi hanno mostrato l'efficacia di tali prassi, mentre in Italia non esistono ricerche sperimentali finalizzate a studiarne l’impatto sugli apprendimenti. Il progetto è entrato all’interno di quest’ambito di studi per controllare l’efficacia di un insieme di pratiche di FA sull'incremento delle abilità di comprensione dei testi degli studenti. Lo scopo è stato perseguito realizzando una sperimentazione in una scuola secondaria di primo grado che ha coinvolto gli studenti di due classi prime, i quali sono stati suddivisi a metà attraverso tecniche di randomizzazione per formare i due gruppi, sperimentale e di controllo. Dopo aver effettuato una rilevazione iniziale delle abilità di comprensione dei testi degli studenti (pre-test), è stato realizzato con quelli del gruppo sperimentale un intervento composto da 15 incontri di FA della durata di due ore ciascuno. Alla fine, sono state effettuate due rilevazioni finali (post-test) utilizzando sia la stessa prova utilizzata come pre-test sia una prova parallela. È stata calcolata la differenza post-test-pre-test per ogni gruppo ed è stato verificato quanto avesse influito la partecipazione all’intervento sperimentale su tale differenza tramite test non parametrici. I risultati hanno mostrato un incremento di abilità lievemente maggiore nel gruppo sperimentale, se confrontato con quello del gruppo di controllo, anche se questa differenza tra i due gruppi non è statisticamente significativa. Sebbene le analisi non abbiano consentito di rifiutare l’ipotesi nulla, la rilevanza di tale progetto risiede nel tentativo di aprire il dibattito sull’efficacia di prassi di FA sugli apprendimenti degli studenti in Italia.

New perspectives on A.I. in sentencing. Human decision-making between risk assessment tools and protection of humans rights.

The aim of this thesis is to investigate a field that until a few years ago was foreign to and distant from the penal system. The purpose of this undertaking is to account for the role that technology could plays in the Italian Criminal Law system. More specifically, this thesis attempts to scrutinize a very intricate phase of adjudication. After deciding on the type of an individual's liability, a judge must decide on the severity of the penalty. This type of decision implies a prognostic assessment that looks to the future. It is precisely in this field and in prognostic assessments that, as has already been anticipated in the United, instruments and processes are inserted in the pre-trial but also in the decision-making phase. In this contribution, we attempt to describe the current state of this field, trying, as a matter of method, to select the most relevant or most used tools. Using comparative and qualitative methods, the uses of some of these instruments in the supranational legal system are analyzed. Focusing attention on the Italian system, an attempt was made to investigate the nature of the element of an individual's ‘social dangerousness’ (pericolosità sociale) and capacity to commit offences, types of assessments that are fundamental in our system because they are part of various types of decisions, including the choice of the best sanctioning treatment. It was decided to turn our attention to this latter field because it is believed that the judge does not always have the time, the means and the ability to assess all the elements of a subject and identify the best 'individualizing' treatment in order to fully realize the function of Article 27, paragraph 3 of the Constitution.

Desenvolupament en Moodle d’eines d’autoaprenentatge i avaluació continua en les àrees de Física i Matemàtiques

Aquesta comunicació presenta el projecte Aula de Tests desenvolupat com a suport en el desplegament de les assignatures de física i matemàtiques de primer curs dels estudis d'enginyeria de l’Escola Superior Politècnica de la Universitat Pompeu Fabra. El projecte té com a objectiu dissenyar eines d'auto aprenentatge i d'avaluació contínua accessible on-line a través de l'entorn Moodle per a afavorir el procés d'aprenentatge de l’estudiant. El context d’aquesta experiència es caracteritzaper la inherent dificultat dels estudis d’enginyeria, pel fet que molts estudiants entren a la universitat amb mancances substancials de coneixements en aquestes àrees així com la heterogeneïtat en quant a la formació pre-universitària. S’hi descriuen lescaracterístiques de les activitats programades i el context on s’han aplicat i es presenten els resultats de satisfacció, participació i notes que aporten informació útil al professorat per a adequar la planificació i les activitats els cursos següents.

Peer Assessment and Self-assessment: Effective Learning Tools in Higher Education.

When used appropriately, self- and peer-assessment are very effective learning tools. In the present work, instructor formative assessment and feedback, self-assessment (SA), and peer-assessment (PA) have been compared. During the first part of a semester, the students followed a continuous formative assessment. Subsequently, they were divided into two subgroups based on similar performances. One subgroup performed SAs, and the other followedPAduring the last part of the course. The performances of the two groups in solving problems were compared. Results suggest that PA is a more effective learning tool than SA, and both are more effective than instructor formative assessment. However, a survey that was conducted at the end of the experiment showed higher student confidence in instructor assessment than in PA. The students recognized the usefulness of acting as peer assessors, but believed that SA helped them more than PA.

Multi-dimensional Review of Uruguay. Volume 1: initial assessment

Includes bibliography.