Viewbrics: Formative Assessment of Complex Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education

To learn complex skills, like collaboration, learners need to acquire a concrete and consistent mental model of what it means to master this skill. If learners know their current mastery level and know their targeted mastery level, they can better determine their subsequent learning activities. Rubrics support learners in judging their skill performance as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models with contextualized, time-related and observable behavioral aspects of a complex skill. This paper outlines the design of a study that intends to investigate the effect of rubrics with video modelling examples compared to text-based rubrics on skills acquisition and feedback provisioning. The hypothesis is that video-enhanced rubrics, compared to text based rubrics, will improve mental model formation of a complex skill and improve the feedback quality a learner receives (from e.g. teachers, peers) while practicing a skill, hence positively effecting final mastery of a skill.

A First Step Towards Video Enhanced Rubrics for the Formative Assessment of Complex Skills : A literature review and a plea

Paper presentation at the TEA2016 conference, Tallinn, Estonia.

Tradução e adaptação transcultural do Minnesota Handwriting Assessment para aplicação no Brasil

Pós-graduação em Desenvolvimento Humano e Tecnologias - IBRC

Desempenho de pré-escolares com queixa de Distúrbios da Comunicação no Preschool Language Assessment Instrument (Plai-2)

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Desempenho de pré-escolares com queixa de Distúrbios da Comunicação no Preschool Language Assessment Instrument (Plai-2)

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Dicas de aprendizagem auxiliam as crianças com TDC na aquisição de uma habilidade motora complexa?

O objetivo do estudo foi analisar se as dicas de aprendizagem auxiliam crianças com TDC na aquisição de uma habilidade motora complexa. Dez crianças com TDC e 14 de desenvolvimento típico, de 9 a 11 anos, foram divididas nos grupos TDC com dicas (TDCD), TDC sem dicas (TDCS), desenvolvimento típico com dicas (GDTD) e desenvolvimento típico sem dicas (GDTS). As crianças participaram de sete aulas, durante três semanas, para a aprendizagem do rolamento peixe, com o uso das dicas "empurre o chão", "coloque a mão o mais longe possível" e "queixo no peito". Os resultados não foram estatisticamente significantes entre os grupos, o que evidencia que as dicas não apresentaram efeito positivo na aprendizagem do rolamento peixe.

Autonomous Acquisition of Natural Situated Communication

An important part of human intelligence, both historically and operationally, is our ability to communicate. We learn how to communicate, and maintain our communicative skills, in a society of communicators – a highly effective way to reach and maintain proficiency in this complex skill. Principles that might allow artificial agents to learn language this way are in completely known at present – the multi-dimensional nature of socio-communicative skills are beyond every machine learning framework so far proposed. Our work begins to address the challenge of proposing a way for observation-based machine learning of natural language and communication. Our framework can learn complex communicative skills with minimal up-front knowledge. The system learns by incrementally producing predictive models of causal relationships in observed data, guided by goal-inference and reasoning using forward-inverse models. We present results from two experiments where our S1 agent learns human communication by observing two humans interacting in a realtime TV-style interview, using multimodal communicative gesture and situated language to talk about recycling of various materials and objects. S1 can learn multimodal complex language and multimodal communicative acts, a vocabulary of 100 words forming natural sentences with relatively complex sentence structure, including manual deictic reference and anaphora. S1 is seeded only with high-level information about goals of the interviewer and interviewee, and a small ontology; no grammar or other information is provided to S1 a priori. The agent learns the pragmatics, semantics, and syntax of complex utterances spoken and gestures from scratch, by observing the humans compare and contrast the cost and pollution related to recycling aluminum cans, glass bottles, newspaper, plastic, and wood. After 20 hours of observation S1 can perform an unscripted TV interview with a human, in the same style, without making mistakes.

LEARNING A COMPLEX MOTOR SKILL FROM VIDEO AND POINT-LIGHT DEMONSTRATIONS

The aim of this Study was to compare the learning process of a highly complex ballet skill following demonstrations of point light and video models 16 participants divided into point light and video groups (ns = 8) performed 160 trials of a pirouette equally distributed in blocks of 20 trials alternating periods of demonstration and practice with a retention test a day later Measures of head and trunk oscillation coordination d1 parity from the model and movement time difference showed similarities between video and point light groups ballet experts evaluations indicated superiority of performance in the video over the point light group Results are discussed in terms of the task requirements of dissociation between head and trunk rotations focusing on the hypothesis of sufficiency and higher relevance of information contained in biological motion models applied to learning of complex motor skills

LEARNING A COMPLEX MOTOR SKILL FROM VIDEO and POINT-LIGHT DEMONSTRATIONS

The aim of this Study was to compare the learning process of a highly complex ballet skill following demonstrations of point light and video models 16 participants divided into point light and video groups (ns = 8) performed 160 trials of a pirouette equally distributed in blocks of 20 trials alternating periods of demonstration and practice with a retention test a day later Measures of head and trunk oscillation coordination d1 parity from the model and movement time difference showed similarities between video and point light groups ballet experts evaluations indicated superiority of performance in the video over the point light group Results are discussed in terms of the task requirements of dissociation between head and trunk rotations focusing on the hypothesis of sufficiency and higher relevance of information contained in biological motion models applied to learning of complex motor skills

Assessing Decision Making Skill in Complex and Dynamic Environments Using Representative and Simulated Tasks

Traditional decision making research has often focused on one's ability to choose from a set of prefixed options, ignoring the process by which decision makers generate courses of action (i.e., options) in-situ (Klein, 1993). In complex and dynamic domains, this option generation process is particularly critical to understanding how successful decisions are made (Zsambok & Klein, 1997). When generating response options for oneself to pursue (i.e., during the intervention-phase of decision making) previous research has supported quick and intuitive heuristics, such as the Take-The-First heuristic (TTF; Johnson & Raab, 2003). When generating predictive options for others in the environment (i.e., during the assessment-phase of decision making), previous research has supported the situational-model-building process described by Long Term Working Memory theory (LTWM; see Ward, Ericsson, & Williams, 2013). In the first three experiments, the claims of TTF and LTWM are tested during assessment- and intervention-phase tasks in soccer. To test what other environmental constraints may dictate the use of these cognitive mechanisms, the claims of these models are also tested in the presence and absence of time pressure. In addition to understanding the option generation process, it is important that researchers in complex and dynamic domains also develop tools that can be used by `real-world' professionals. For this reason, three more experiments were conducted to evaluate the effectiveness of a new online assessment of perceptual-cognitive skill in soccer. This test differentiated between skill groups and predicted performance on a previously established test and predicted option generation behavior. The test also outperformed domain-general cognitive tests, but not a domain-specific knowledge test when predicting skill group membership. Implications for theory and training, and future directions for the development of applied tools are discussed.

Relative frequency of knowledge of results and task complexity in the motor skill acqusition

The aim of this study was to investigate the effects of knowledge of results (KR) frequency and task complexity on motor skill acquisition. The task consisted of throwing a bocha ball to place it as close as possible to the target ball. 120 students ages 11 to 73 years were assigned to one of eight experimental groups according to knowledge of results frequency (25, 50, 75, and 100%) and task complexity (simple and complex). Subjects performed 90 trials in the acquisition phase and 10 trials in the transfer test. The results showed that knowledge of results given at a frequency of 25% resulted in an inferior absolute error than 50% and inferior variable error than 50, 75, and 100 I frequencies, but no effect of task complexity was found.

Telling the truth: medical students' progress with an ethical skill.

BACKGROUND: Truth-telling is a complex task requiring multiple skills in communication, understanding, and empathy. Its application in the context of breaking bad news (BBN) is distressing and problematic if conducted with insufficient skills. PURPOSE: We investigated the long-term influence of a simulated patient-based teaching intervention integrating the learning of communication skills within an ethical reflection on students' ethical attitudes towards truth-telling, perceived competence and comfort in BBN. METHODS: We followed two cohorts of medical students from the preclinical third year to their clinical rotations (fifth year). We analysed their ethical attitudes and level of comfort and competence in BBN before, after the intervention, and during clinical rotations. RESULTS: Students' ethical attitudes towards truth-telling remained stable. Students feeling uncomfortable or incompetent improved their level of perceived comfort or competence after the intervention, but those feeling comfortable or competent became more aware of the difficulty of the situation, and consequently decreased their level of comfort and competence. CONCLUSIONS: Confronting students with a realistic situation and integrating the practice of communication skills within an ethical reflection may be effective in maintaining ethical attitudes towards truth-telling, in developing new skills and increasing awareness about the difficulty and challenges of a BBN situation.

Neuromuscular adaptation during skill acquisition on a two degree-of-freedom target-acquisition task: Dynamic movement

In this experiment, we examined the extent to which the spatiotemporal reorganization of muscle synergies mediates skill acquisition on a two degree-of-freedom (df) target-acquisition task. Eight participants completed five practice sessions on consecutive days. During each session they practiced movements to eight target positions presented by a visual display. The movements required combinations of flexion/extension and pronation/supination of the elbow joint complex. During practice sessions, eight targets displaced 5.4 cm from the start position ( representing joint excursions of 54) were presented 16 times. During pre- and posttests, participants acquired the targets at two distances (3.6 cm [36 degrees] and 7.2 cm [72 degrees]). EMG data were recorded from eight muscles contributing to the movements during the pre- and posttests. Most targets were acquired more rapidly after the practice period. Performance improvements were, in most target directions, accompanied by increases in the smoothness of the movement trajectories. When target acquisition required movement in both dfs, there were also practice-related decreases in the extent to which the trajectories deviated from a direct path to the target. The contribution of monofunctional muscles ( those producing torque in a single df) increased with practice during movements in which they acted as agonists. The activity in bifunctional muscles ( those contributing torque in both dfs) remained at pretest levels in most movements. The results suggest that performance gains were mediated primarily by changes in the spatial organization of muscles synergies. These changes were expressed most prominently in terms of the magnitude of activation of the monofunctional muscles.