Top-down and bottom-up approaches to motor skill assessment of children : are child-report and parent-report perceptions predictive of children's performance-based assessment results?

Background/ Aim: Therapists use different types of tests, scales, and instruments to assess children's motor skills, including those classified as being top-down and bottom-up. The aim of the study was to investigate the ability of measures of children's motor skill performance from the perspectives of children and parents (a type of top-down assessment) to predict children's performance-based motor ability test results (a type of bottom-up assessment).
Methods: A convenience sample of 38 children and parents was recruited from Victoria, Australia. Motor skill performance was evaluated from a top-down perspective using the Physical Self-Description Questionnaire (PSDQ) and the Movement Assessment Battery for Children – Second Edition (MABC-2) Checklist to measure children's and parents' perspectives respectively. Motor skill performance was also evaluated from a bottom-up approach using the Bruininks-Oseretsky Test of Motor Proficiency – Second Edition (BOT-2). Data were analyzed using multiple linear regression analysis to determine whether the PSDQ or MABC-2 Checklist was predictive of the children's BOT-2 performance results.
Results: Two predictive relationships were identified based on parents' perspectives, where the total score of the MABC-2 Checklist was found to be a significant predictor of the BOT-2 Manual Coordination motor composite score, accounting for 8.35% of its variance, and the BOT-2 Strength and Agility motor composite score, accounting for 11.6% of its variance. No predictive relationships were identified between the children's self-report PSDQ perspectives and the BOT-2 performance scores.
Conclusions: Therapists are encouraged to utilize a combination of top-down and bottom-up approaches and purposefully to seek parents' and children's perspectives when evaluating children's motor skill performance.

Associations between skill perceptions and young children's actual fundamental movement skills

-Given that children with low movement skill competence engage in less physical activity, it is important to understand how children's perceptions relate to actual movement competence. This study examined relationships between (i) children's self-perception and objective assessments of their movement skills (object control and locomotor) and (ii) parents' perceptions of the children's movement skills and objective assessment. Children's skill perceptions were assessed using the Pictorial Scale of Perceived Movement Skill Competence for Young Children. Parent perceptions of their child's skills were assessed using a modified version of this instrument. The Test of Gross Motor Development-2nd edition assessed children's skills objectively. Participants were 136 Australian children (51% boys; M = 6.5 yr., SD = 1.1) and 133 parents. Regression analyses (by sex) examined the relationship between perceptions and children's scores for actual skilled performance. Boys' perceptions were associated with their actual object control ability. Parents accurately perceived boys' object control ability and girls' locomotor ability, but not the reverse. This suggests interventions aiming to improve children's movement skills could target parents and be designed to teach parents how to recognize good and poor skill performance in their children.

Managing women with acute physiological deterioration: student midwives performance in a simulated setting

OBJECTIVE: Midwives' ability to manage maternal deterioration and 'failure to rescue' are of concern with questions over knowledge, clinical skills and the implications for maternal morbidity and, mortality rates. In a simulated setting our objective was to assess student midwives' ability to assess, and manage maternal deterioration using measures of knowledge, situation awareness and skill, performance. METHODS: An exploratory quantitative analysis of student performance based upon performance, ratings derived from knowledge tests and observational ratings. During 2010 thirty-five student, midwives attended a simulation laboratory completing a knowledge questionnaire and two video, recorded simulated scenarios. Patient actresses wearing a 'birthing suit' simulated deteriorating, women with post-partum and ante-partum haemorrhage (PPH and APH). Situation awareness was, measured at the end of each scenario. Applicable descriptive and inferential statistical tests were, applied to the data. FINDINGS: The mean total knowledge score was 75% (range 46-91%) with low skill performance, means for both scenarios 54% (range 39-70%). There was no difference in performance between the scenarios, however performance of key observations decreased as the women deteriorated; with significant reductions in key vital signs such as blood pressure and blood loss measurements. Situation, awareness scores were also low (54%) with awareness decreasing significantly (t(32)=2.247, p=0.032), in the second and more difficult APH scenario. CONCLUSION: Whilst knowledge levels were generally good, skills were generally poor and decreased as the women deteriorated. Such failures to apply knowledge in emergency stressful situations may be resolved by repetitive high stakes and high fidelity simulation.

Performance of children with learning difficulties in fine motor function and handwriting

This study aimed to compare and characterize the fine, sensory and perceptive function performance and handwriting quality between students with learning difficulties and students with good academic performance. Methods: This study comprised 192 students from 2nd to 4th grades, both genders, whose ages ranged from 7 to 11 years old. The students were distributed into: GI, GII, GIII and GIV, comprising 96 students with learning difficulties, and groups GV, GVI, GVII, GVIII comprising 96 students with good academic performance. The students were submitted to evaluation of fine motor, sensorial and perception functions and handwriting evaluation under dictation. Results: The results showed that the students with learning difficulties, from 1st to 3rd grade, had lower performance on tests of fine motor, sensory and perceptive function, when compared to the students with good academic performance in the same grade; the students from 4th grade, both groups, did not show changes on fine motor, sensory and perceptive function; and only the students of GII showed dysgraphia. Conclusions: the results presented in this study suggest that the qualitative aspects of fine motor, sensory and perceptive skills reflect the integrity and maturity of central nervous system and can probably play an important role in early diagnosis of development disorders and consequently prevent academic disorders such as handwriting performance.

The Quiet Eye in Motor Performance and Learning – Functional and Theoretical Considerations

High precision in motor skill performance, in both sport and other domains (e.g. surgery and aviation), requires the efficient coupling of perceptual inputs (e.g. vision) and motor actions. A particular gaze strategy, which has received much attention within the literature, has been shown to predict both inter- (expert vs. novice) and intra-individual (successful vs. unsuccessful) motor performance (see Vine et al., 2014). Vickers (1996) labelled this phenomenon the quiet eye (QE) which is defined as the final fixation before the initiation of the crucial phase of movement. While the positive influence of a long QE on accuracy has been revealed in a range of different motor skills, there is a growing number of studies suggesting that the relationship between QE and motor performance is not entirely monotonic. This raises interesting questions regarding the QE’s purview, and the theoretical approaches explaining its functionality. This talk aims to present an overview of the issues described above, and to discuss contemporary research and experimental approaches to examining the QE phenomenon. In the first part of the talk Dr. Vine will provide a brief and critical review of the literature, highlighting recent empirical advancements and potential directions for future research. In the second part, Dr. Klostermann will communicate three different theoretical approaches to explain the relationship between QE and motor performance. Drawing upon aspects of all three of these theoretical approaches, a functional inhibition role for the QE (related to movement parameterisation) will be proposed.

The effect of Amblyopia on motor and psychosocial skills in children

Background/Aims: In an investigation of the functional impact of amblyopia on children, the fine motor skills, perceived self-esteem and eye movements of amblyopic children were compared with that of age-matched controls. The influence of amblyogenic condition or treatment factors that might predict any decrement in outcome measures was investigated. The relationship between indirect measures of eye movements that are used clinically and eye movement characteristics recorded during reading was examined and the relevance of proficiency in fine motor skills to performance on standardised educational tests was explored in a sub-group of the control children. Methods: Children with amblyopia (n=82; age 8.2 ± 1.3 years) from differing causes (infantile esotropia n=17, acquired strabismus n=28, anisometropia n=15, mixed n=13 and deprivation n=9), and a control group of children (n=106; age 9.5 ± 1.2 years) participated in this study. Measures of visual function included monocular logMAR visual acuity (VA) and stereopsis assessed with the Randot Preschool Stereoacuity test, while fine motor skills were measured using the Visual-Motor Control (VMC) and Upper Limb Speed and Dexterity (ULSD) subtests of the Brunicks-Oseretsky Test of Motor Proficiency. Perceived self esteem was assessed for those children from grade 3 school level with the Harter Self Perception Profile for Children and for those in younger grades (preschool to grade 2) with the Pictorial Scale of Perceived Competence and Acceptance for Young Children. A clinical measure of eye movements was made with the Developmental Eye Movement (DEM) test for those children aged eight years and above. For appropriate case-control comparison of data, the results from amblyopic children were compared with age-matched sub-samples drawn from the group of children with normal vision who completed the tests. Eye movements during reading for comprehension were recorded by the Visagraph infra-red recording system and results of standardised tests of educational performance were also obtained for a sub-set of the control group. Results Amblyopic children (n=82; age 8.2 ± 1.7 years) performed significantly poorer than age-matched control children (n=37; age 8.3 ± 1.3 years) on 9 of 16 fine motor skills sub-items and for the overall age-standardised scores for both VMC and ULSD items (p<0.05); differences were most evident on timed manual dexterity tasks. The underlying aetiology of amblyopia and level of stereoacuity significantly affected fine motor skill performance on both items. However, when examined in a multiple regression model that took into account the inter-correlation between visual characteristics, poorer fine motor skills performance was only associated with strabismus (F1,75 = 5.428; p =0. 022), and not with the level of stereoacuity, refractive error or visual acuity in either eye. Amblyopic children from grade 3 school level and above (n=47; age 9.2 ± 1.3 years), particularly those with acquired strabismus, had significantly lower social acceptance scores than age-matched control children (n=52; age 9.4 ± 0.5 years) (F(5,93) = 3.14; p = 0.012). However, the scores of the amblyopic children were not significantly different to controls for other areas related to self-esteem, including scholastic competence, physical appearance, athletic competence, behavioural conduct and global self worth. A lower social acceptance score was independently associated with a history of treatment with patching but not with a history of strabismus or wearing glasses. Amblyopic children from pre-school to grade 2 school level (n=29; age = 6.6 ± 0.6 years) had similar self-perception scores to their age-matched peers (n=20; age = 6.4 ± 0.5 years). There were no significant differences between the amblyopic (n=39; age 9.1 ± 0.9 years) and age-matched control (n = 42; age = 9.3 ± 0.38 years) groups for any of the DEM outcome measures (Vertical Time, Horizontal Time, Number of Errors and Ratio (Horizontal time/Vertical time)). Performance on the DEM did not significantly relate to measures of VA in either eye, level of binocular function, history of strabismus or refractive error. Developmental Eye Movement test outcome measures Horizontal Time and Vertical Time were significantly correlated with reading rates measured by the Visagraph for both reading for comprehension and naming numbers (r>0.5). Some moderate correlations were also seen between the DEM Ratio and word reading rates as recorded by Visagraph (r=0.37). In children with normal vision, academic scores in mathematics, spelling and reading were associated with measures of fine motor skills. Strongest effect sizes were seen with the timed manual dexterity domain, Upper Limb Speed and Dexterity. Conclusions Amblyopia may have a negative impact on a child’s fine motor skills and an older child’s sense of acceptance by their peers may be influenced by treatment that includes eye patching. Clinical measures of eye movements were not affected in amblyopic children. A number of the outcome measures of the DEM are associated with objective recordings of reading rates, supporting its clinical use for identification of children with slower reading rates. In children with normal vision, proficiency on clinical measures of fine motor skill are associated with outcomes on standardised measures of educational performance. Scores on timed manual dexterity tasks had the strongest association with educational performance. Collectively, the results of this study indicate that, in addition to the reduction in visual acuity and binocular function that define the condition, amblyopes have functional impairment in childhood development skills that underlie proficiency in everyday activities. The study provides support for strategies aimed at early identification and remediation of amblyopia and the co-morbidities that arise from abnormal visual neurodevelopment.

The need for ‘representative task design’ in evaluating efficacy of skills tests in sport : a comment on Russell, Benton and Kingsley (2010)

Russell, Benton and Kingsley (2010) recently suggested a new association football test comprising three different tasks for the evaluation of players' passing, dribbling and shooting skills. Their stated intention was to enhance ‘ecological validity’ of current association football skills tests allowing generalisation of results from the new protocols to performance constraints that were ‘representative’ of experiences during competitive game situations. However, in this comment we raise some concerns with their use of the term ‘ecological validity’ to allude to aspects of ‘representative task design’. We propose that in their paper the authors confused understanding of environmental properties, performance achievement and generalisability of the test and its outcomes. Here, we argue that the tests designed by Russell and colleagues did not include critical sources of environmental information, such as the active role of opponents, which players typically use to organise their actions during performance. Static tasks which are not representative of the competitive performance environment may lead to different emerging patterns of movement organisation and performance outcomes, failing to effectively evaluate skills performance in sport.

Development, reliability and validity of the queensland evaluation of wheelchair skills (QEWS)

- Objectives To develop and test a valid and reliable assessment of wheelchair skills for individuals with spinal cord injuries (SCI); the Queensland Evaluation of Wheelchair Skills (QEWS). - Setting Hospital, Australia. - Methods Phase 1: Four Delphi panel rounds with clinical experts were used to develop the QEWS. Phase 2: Intra-rater and inter-rater reliability of the QEWS items were examined in 100 people with SCI. Phase 3a: Concurrent validity was investigated by examining the association between QEWS total scores and physiotherapists’ global ratings of wheelchair skill performance. Phase 3b: Construct validity was tested in 20 people with recent SCI by examining change in QEWS total scores between when they first mobilised in a wheelchair and scores obtained 10 weeks later. - Results Phase 1: The QEWS was developed. Phase 2: The intra-class correlation coefficients reflecting the intra-rater reliability and the inter-rater reliability for the QEWS total score were 1.00 and 0.98, with scores being within one point of each other 96 and 91% of the time, respectively. Phase 3a: The QEWS total scores were comparable with the global rating of wheelchair skill performance (r2=0.93). Phase 3b: The QEWS scores changed by a median (interquartile range (IQR)) of 4 (1 to 6) points over the 10-week period following first wheelchair mobilisation. - Conclusion The QEWS is a valid and reliable tool for measuring wheelchair skills in individuals with SCI. The QEWS is efficient and practical to administer and does not require specialised equipment.

Interrater reliability assessment using the Test of Gross Motor Development-2

Objectives: The aim was to examine interrater reliability of the object control subtest from the Test of Gross Motor Development-2 by live observation in a school field setting. Design:: Reliability Study - cross sectional. Methods: Raters were rated on their ability to agree on (1) the raw total for the six object control skills; (2) each skill performance and (3) the skill components. Agreement for the object control subtest and the individual skills was assessed by an intraclass correlation (ICC) and a kappa statistic assessed for skill component agreement. Results: A total of 37 children (65% girls) aged 4-8 years (M= 6.2, SD=0.8) were assessed in six skills by two raters; equating to 222 skill tests. Interrater reliability was excellent for the object control subset (ICC= 0.93), and for individual skills, highest for the dribble (ICC= 0.94) followed by strike (ICC= 0.85), overhand throw (ICC= 0.84), underhand roll (ICC= 0.82), kick (ICC= 0.80) and the catch (ICC= 0.71). The strike and the throw had more components with less agreement. Conclusions: Even though the overall subtest score and individual skill agreement was good, some skill components had lower agreement, suggesting these may be more problematic to assess. This may mean some skill components need to be specified differently in order to improve component reliability.

A new perspective on competency management: Implemented through effective human-computer interaction

Making an informed decision on whether an individual is suited to undertake an educational course or industry training programme can be very frustrating. When dealing with young adults at different cognitive skill levels, it is important to be able to identify and distinguish between their knowledge/competency levels, mostly on the basis of the evidence gathered from test-items. The current absence of appropriate measurement tools to determine skill/competency/knowledge levels remains a practical issue. The main aim of this paper is to discuss the management of this important differentiation in cognitive skill performance. One of the dilemmas surrounding this type of competency evaluation is the time it takes to test an individual. Insisting for instance, that a novice undergoes a long and arduous test, including many difficult testing items, results in lowered self-esteem, reduced motivation for learning something new, may induce stress related disorders. Similarly, expecting a more competent individual to undergo numerous simple test-items can generate the same negative result. A Competency Management System (CMS) is presented to initiate effective human-computer interaction (HCI) for cognitive skills assessment. © 2009 Springer-Verlag US.

Exercise domain profile through pulmonary gas exchange response during kendo practice by men

Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)

Viewbrics: Formative Assessment of Complex Skills with Video-Enhanced Rubrics (VER) in Dutch Secondary Education

To learn complex skills, like collaboration, learners need to acquire a concrete and consistent mental model of what it means to master this skill. If learners know their current mastery level and know their targeted mastery level, they can better determine their subsequent learning activities. Rubrics support learners in judging their skill performance as they provide textual descriptions of skills’ mastery levels with performance indicators for all constituent subskills. However, text-based rubrics have a limited capacity to support the formation of mental models with contextualized, time-related and observable behavioral aspects of a complex skill. This paper outlines the design of a study that intends to investigate the effect of rubrics with video modelling examples compared to text-based rubrics on skills acquisition and feedback provisioning. The hypothesis is that video-enhanced rubrics, compared to text based rubrics, will improve mental model formation of a complex skill and improve the feedback quality a learner receives (from e.g. teachers, peers) while practicing a skill, hence positively effecting final mastery of a skill.

Organisational challenges to delivering child investigative interviewer training via e-learning

This article examined organisational challenges arising from the implementation of a new training course for investigative interviewers of vulnerable witnesses. The course was delivered via e-learning (computer exercises) and also involved mock interviews conducted over the telephone. Thematic analysis was conducted of: (a) trainees’ anonymous written feedback submitted to an online discussion forum on the training programme’s website, (b) trainees’ responses to face-to-face questions during semi-structured qualitative interviews, and (c) correspondence between trainees and trainers regarding the training programme. Despite unanimous support for the new training programme, three challenges were identified: limited allocated work time to complete the training, conflicting work practices arising from staggered course enrolment, and difficulties associated with computer and technical skills. These organisational challenges must be addressed to ensure that any future evaluation of the programme on skill performance provides a true indication of the programme’s impact on skill development. From a managerial perspective, organisational challenges need to be addressed in order to maximise the accessibility, completion and long-term success of an e-learning training model for interviewers.

Children's movement skills when playing active video games

Active video games (AVGs) may be useful for movement skill practice. This study examined children's skill execution while playing Xbox Kinect™ and during movement skill assessment. Nineteen children (10 boys, 9 girls; M age = 7.9 yr., SD = 1.4) had their skills assessed before AVG play and then were observed once a week for 6 wk. while playing AVGs for 50 min. While AVG play showed evidence of correct skill performance (at least 30-50% of the time when playing table tennis, tennis, and baseball), nearly all skills were more correctly performed during skill assessment (generally more than 50% of the time). This study may help researchers to better understand the role AVGs could play in enhancing real life movement skills.