Validity and reliability of field-based measures for assessing movement skill competency in lifelong physical activities: a systematic review

Background: It has been suggested that young people should develop competence in a variety of ‘lifelong physical activities’ to ensure that they can be active across the lifespan. Objective: The primary aim of this systematic review is to report the methodological properties, validity, reliability, and test duration of field-based measures that assess movement skill competency in lifelong physical activities. A secondary aim was to clearly define those characteristics unique to lifelong physical activities. Data Sources: A search of four electronic databases (Scopus, SPORTDiscus, ProQuest, and PubMed) was conducted between June 2014 and April 2015 with no date restrictions. Study Selection: Studies addressing the validity and/or reliability of lifelong physical activity tests were reviewed. Included articles were required to assess lifelong physical activities using process-oriented measures, as well as report either one type of validity or reliability. Study Appraisal and Synthesis Methods: Assessment criteria for methodological quality were adapted from a checklist used in a previous review of sport skill outcome assessments. Results: Movement skill assessments for eight different lifelong physical activities (badminton, cycling, dance, golf, racquetball, resistance training, swimming, and tennis) in 17 studies were identified for inclusion. Methodological quality, validity, reliability, and test duration (time to assess a single participant), for each article were assessed. Moderate to excellent reliability results were found in 16 of 17 studies, with 71 % reporting inter-rater reliability and 41 % reporting intra-rater reliability. Only four studies in this review reported test–retest reliability. Ten studies reported validity results; content validity was cited in 41 % of these studies. Construct validity was reported in 24 % of studies, while criterion validity was only reported in 12 % of studies. Limitations: Numerous assessments for lifelong physical activities may exist, yet only assessments for eight lifelong physical activities were included in this review. Generalizability of results may be more applicable if more heterogeneous samples are used in future research. Conclusion: Moderate to excellent levels of inter- and intra-rater reliability were reported in the majority of studies. However, future work should look to establish test–retest reliability. Validity was less commonly reported than reliability, and further types of validity other than content validity need to be established in future research. Specifically, predictive validity of ‘lifelong physical activity’ movement skill competency is needed to support the assertion that such activities provide the foundation for a lifetime of activity.

Two tests of approach-iron golf skill and their ability to predict tournament performance

The aim of this study was to investigate the convergent and predictive validity of two skill tests that examine the ability of golfers to hit accurate approach-iron shots. Twenty-four high-level golfers (handicap = 2.6 ± 1.7) performed the Nine-Ball Skills Test (assesses the ability to shape/control ball trajectory with high accuracy) and the Approach-Iron Skill Test (assesses the ability to hit straight shots from varying distances with high accuracy). Participants then completed at least eight rounds of tournament golf over the following 90 days and reported an indicator of approach-iron accuracy (per cent error index). A moderate correlation (r = 0.50, P < 0.05) was noted between scores for both tests. Generalised estimating equations, using two covariates (lie of the ball and distance to hole), were used to determine model fit and the amount of variance explained for tournament per cent error index. Results showed that the Approach-Iron Skill Test was the slightly stronger predictor of on-course per cent error index. With both test scores considered together, a minimal amount of additional variance was explained. These findings suggest that either of the tests used individually or combined may be used to predict tournament approach iron performance in high-level golfers.

Physical activity of young children

Occupational therapists concerned with the long-term health and welfare of children need be aware of the decline in physical activity of children in most Western societies. The current study examined the extent of physical activity in the lives of 50 Australian children with mean age of 7.74 years through questionnaires completed by the children’s parents and pedometer (step) data collected from the children during 4 days. The current data show that higher self-perception of physical competence, child’s levels of physical skill, and low parental perception of peer teasing were the best predictors of physical activity. Higher family socioeconomic status was found to be a significant predictor of more steps being taken on weekends, and partner’s (usually a father’s) level of exercise was an important predictor of the number of weekend steps. Children who were perceived to experience more peer teasing completed fewer steps the weekend. The findings from this study indicate that children’s physical activity levels depend on the availability of family resources, and that children in their early school years already experience negative effects from teasing that, combined with reduced self-confidence, may lay the foundation for their withdrawing from physical activity as they get older.

Boron carbide reinforced aluminium matrix composite : physical, mechanical characterization and mathematical modelling

This paper investigates the manufacturing of aluminium-boron carbide composites using the stir casting method. Mechanical and physical properties tests to obtain hardness, ultimate tensile strength (UTS) and density are performed after solidification of specimens. The results show that hardness and tensile strength of aluminium based composite are higher than monolithic metal. Increasing the volume fraction of B4C, enhances the tensile strength and hardness of the composite; however over-loading of B4C caused particle agglomeration, rejection from molten metal and migration to slag. This phenomenon decreases the tensile strength and hardness of the aluminium based composite samples cast at 800 °C. For Al-15 vol% B4C samples, the ultimate tensile strength and Vickers hardness of the samples that were cast at 1000 °C, are the highest among all composites. To predict the mechanical properties of aluminium matrix composites, two key prediction modelling methods including Neural Network learned by Levenberg-Marquardt Algorithm (NN-LMA) and Thin Plate Spline (TPS) models are constructed based on experimental data. Although the results revealed that both mathematical models of mechanical properties of Al-B4C are reliable with a high level of accuracy, the TPS models predict the hardness and tensile strength values with less error compared to NN-LMA models.

Developing physical and physiological employment standards: translation of job analysis findings to assessments and performance standards - a systematic review

Physical employment standards (PES) are developed with the aim of ensuring that an employee's physical and physiological capacities are commensurate with the demands of their occupation. While previous commentaries and narrative reviews have provided frameworks for the development of PES, this is the first systematic review of the methods used to translate job analysis findings to PES tests and performance standards for physically demanding occupations. A search of PubMed and Google Scholar was conducted for research articles published in English up to and including March 2015. Two authors independently reviewed and extracted data.

The search yielded 87 potentially eligible papers, including 60 peer reviewed journal articles and 17 technical reports. 57 papers were excluded leading to a final data set of 31 papers, representing 22 studies. Job analysis was most commonly conducted through subjective determination of job tasks followed by objective quantification and validation. Determination of criterion tasks was evenly distributedthrough subjective and objective methods with criterion tasks being defined most commonly as most demanding, critical and/or frequent. Generic predictive and task-related predictive tests were more commonly observed in isolation or in combination when compared to task simulation tests. Performance standards were more commonly criterion-referenced than norm-referenced with a variety of statistical methods utilised. This review provides recommendations for researchers when developing physical employment standards for a variety of occupations.

Validity and relevance of the pack hike wildland firefighter work capacity test: a review

Fighting wildland fire is a physically demanding occupation. Wildland firefighters need to be physically fit to work safely and productively. To determine whether personnel are fit for duty, many firefighting agencies employ physical competency tests, such as the pack hike test (PHT). The PHT involves a 4.83-km hike over level terrain carrying a 20.4-kg pack within a 45-min period. The PHT was devised to test the job readiness of US wildland firefighters but is also currently used by some fire agencies in Australia and Canada. This review discusses the history and development of the PHT with emphasis on the process of test validation. Research-based training advice for the PHT is given, as well as discussion of the risks associated with completing the PHT. Different versions and modifications to the PHT have emerged in recent years and these are discussed with regard to their validity. Finally, this review addresses the relevance and validity of the PHT for Australian and Canadian wildland firefighters.

A haemodialysis exercise program using novel exercise equipment

This study explored whether an exercise programme for haemodialysis patients, including the use of a purpose built dialysis exercise machine, would improve quality of life (QoL), nutrition, physical function and biochemical indices. QoL, and biochemical indices were measured at 6 months and nutrition was measured at 12 months. Physical function was measured at 4, 8 and 12 months. Results showed improvement in physical function tests a decrease in serum phosphate. The QoL health and physical functioning domain improved also. Conclusions The development of a structured exercise programme can improve quality of life, physical functioning, PO4 levels and urea clearances of dialysis patients.

Performance and anthropometric characteristics of prospective elite junior Australian footballers : a case study in one junior team

The aim of the study was to compare anthropometric and physical performance data of players who were selected for a Victorian elite junior U18 Australian rules football squad. Prior to the selection of the final training squad, 54 players were assessed using a battery of standard anthropometric and physical performance tests. Multivariate analysis (MANOVA) showed significant (p < 0.05) differences between selected and non-selected players when height, mass, 20-m sprint, agility and vertical jump height were considered collectively. Univariate analysis revealed that the vertical jump was the only significant (p < 0.05) individual test and a near significant trend (p = 0.07) for height differentiating between selected and non-selected players with medium effect sizes for all other tests except endurance. In this elite junior football squad, physical characteristics can be observed that discriminate between players selected and non-selected, and demonstrates the value of physical fitness testing within the talent identification process of junior (16–18 years) players for squad and/or team selection. Based on MANOVA results, the findings from this study suggest team selection appeared to be related to a generally higher performance across the range of tests. Further, age was not a confounding variable as players selected tended to be younger than those non-selected. These findings reflect the general consensus that, in state-based junior competition, there is evidence of promoting overall player development, selecting those who are generally able to fulfil a range of positions and selecting players on their potential.

Subjective job task analyses for physically demanding occupations : what is best practice?

Workers in physically demanding occupations (PDOs) are frequently subjected to physical selection tests. To avoid legal ramifications, workplaces must be able to show that any personnel selection procedures reflect the inherent requirements of the job. A job task analysis (JTA) is fundamental in determining the work tasks required for employees. To date, there are no published instructions guiding PDO researchers on how to conduct job task analyses. Job task analysis research for non-PDOs offers some insight into the expected reliability and validity of data obtained on the most prevalent task domains in job analysis (importance, frequency, time spent and difficulty). This review critiques such research, and the existing published material on JTA of PDOs, and provides recommendations for future research and practice.

Interrater reliability assessment using the Test of Gross Motor Development-2

Objectives: The aim was to examine interrater reliability of the object control subtest from the Test of Gross Motor Development-2 by live observation in a school field setting. Design:: Reliability Study - cross sectional. Methods: Raters were rated on their ability to agree on (1) the raw total for the six object control skills; (2) each skill performance and (3) the skill components. Agreement for the object control subtest and the individual skills was assessed by an intraclass correlation (ICC) and a kappa statistic assessed for skill component agreement. Results: A total of 37 children (65% girls) aged 4-8 years (M= 6.2, SD=0.8) were assessed in six skills by two raters; equating to 222 skill tests. Interrater reliability was excellent for the object control subset (ICC= 0.93), and for individual skills, highest for the dribble (ICC= 0.94) followed by strike (ICC= 0.85), overhand throw (ICC= 0.84), underhand roll (ICC= 0.82), kick (ICC= 0.80) and the catch (ICC= 0.71). The strike and the throw had more components with less agreement. Conclusions: Even though the overall subtest score and individual skill agreement was good, some skill components had lower agreement, suggesting these may be more problematic to assess. This may mean some skill components need to be specified differently in order to improve component reliability.

Predicting physiological capacity of human load carriage - a review

This review article aims to evaluate a proposed maximum acceptable work duration model for load carriage tasks. It is contended that this concept has particular relevance to physically demanding occupations such as military and firefighting. Personnel in these occupations are often required to perform very physically demanding tasks, over varying time periods, often involving load carriage. Previous research has investigated concepts related to physiological workload limits in occupational settings (e.g. industrial). Evidence suggests however, that existing (unloaded) workload guidelines are not appropriate for load carriage tasks. The utility of this model warrants further work to enable prediction of load carriage durations across a range of functional workloads for physically demanding occupations. If the maximum duration for which personnel can physiologically sustain a load carriage task could be accurately predicted, commanders and supervisors could better plan for and manage tasks to ensure operational imperatives were met whilst minimising health risks for their workers.

How important is young children's actual and perceived movement skill competence to their physical activity?

OBJECTIVES: To determine the associations between young children's actual and perceived object control and locomotor skills and physical activity and whether associations differ by sex. DESIGN: Cross sectional study. METHODS: A total of 136 children consented. Children had actual skill (Test of Gross Motor Development-2), perceived skill (Pictorial Scale of Perceived Movement Skill Competence for Young Children), and moderate- to vigorous-intensity physical activity (MVPA) (accelerometers) assessed. Independent t-tests assessed sex differences. A regression (with MVPA as the outcome) was performed with all predictor variables (i.e. Actual Object Control, Actual Locomotor, Perceived Object Control, and Perceived Locomotor). Model 2 also adjusted for age, sex, accelerometer wear time and whether the child was from an English speaking background. Interaction terms between the respective actual or perceived skill factor and sex were added to assess sex differences. RESULTS: Analyses were conducted on 109 children (59 boys, 50 girls; mean age=6.5 years, SD=1.0). Boys had higher actual and perceived object control skill and were more active by an average of 19min per day. There were no sex differences in locomotor skills. There were no associations between skill factors and MVPA, except for girls, where locomotor skill was a significant predictor of MVPA (B=3.66, p=0.016). CONCLUSIONS: Actual rather than perceived skill competence was more important to MVPA in this sample. Locomotor skill competence may be more important than object control skill competence for girls as they may engage in types of physical activity that do not require object control mastery.

Perceived sports competence mediates the relationship between childhood motor skill proficiency and adolescent physical activity and fitness : a longitudinal assessment

Background: The purpose of this paper was to investigate whether perceived sports competence mediates the relationship between childhood motor skill proficiency and subsequent adolescent physical activity and fitness.

Methods: In 2000, children's motor skill proficiency was assessed as part of a school-based physical activity intervention. In 2006/07, participants were followed up as part of the Physical Activity and Skills Study and completed assessments for perceived sports competence (Physical Self-Perception Profile), physical activity (Adolescent Physical Activity Recall Questionnaire) and cardiorespiratory fitness (Multistage Fitness Test). Structural equation modelling techniques were used to determine whether perceived sports competence mediated between childhood object control skill proficiency (composite score of kick, catch and overhand throw), and subsequent adolescent self-reported time in moderate-to-vigorous physical activity and cardiorespiratory fitness.

Results: Of 928 original intervention participants, 481 were located in 28 schools and 276 (57%) were assessed with at least one follow-up measure. Slightly more than half were female (52.4%) with a mean age of 16.4 years (range 14.2 to 18.3 yrs). Relevant assessments were completed by 250 (90.6%) students for the Physical Activity Model and 227 (82.3%) for the Fitness Model. Both hypothesised mediation models had a good fit to the observed data, with the Physical Activity Model accounting for 18% (R2 = 0.18) of physical activity variance and the Fitness Model accounting for 30% (R2 = 0.30) of fitness variance. Sex did not act as a moderator in either model.

Conclusion: Developing a high perceived sports competence through object control skill development in childhood is important for both boys and girls in determining adolescent physical activity participation and fitness. Our findings highlight the need for interventions to target and improve the perceived sports competence of youth.

Childhood motor skill proficiency as a predictor of adolescent physical activity

Purpose
Cross-sectional evidence has demonstrated the importance of motor skill proficiency to physical activity participation, but it is unknown whether skill proficiency predicts subsequent physical activity.

Methods
In 2000, children's proficiency in object control (kick, catch, throw) and locomotor (hop, side gallop, vertical jump) skills were assessed in a school intervention. In 2006/07, the physical activity of former participants was assessed using the Australian Physical Activity Recall Questionnaire. Linear regressions examined relationships between the reported time adolescents spent participating in moderate-to-vigorous or organized physical activity and their childhood skill proficiency, controlling for gender and school grade. A logistic regression examined the probability of participating in vigorous activity.

Results
Of 481 original participants located, 297 (62%) consented and 276 (57%) were surveyed. All were in secondary school with females comprising 52% (144). Adolescent time in moderate-to-vigorous and organized activity was positively associated with childhood object control proficiency. Respective models accounted for 12.7% (p = .001), and 18.2% of the variation (p = .003). Object control proficient children became adolescents with a 10% to 20% higher chance of vigorous activity participation.

Conclusions
Object control proficient children were more likely to become active adolescents. Motor skill development should be a key strategy in childhood interventions aiming to promote long-term physical activity.