Tests examining skill outcomes in sport: A systematic review of measurement properties and feasibility

Background
A high level of participant skill is influential in determining the outcome of many sports. Thus, tests assessing skill outcomes in sport are commonly used by coaches and researchers to estimate an athlete’s ability level, to evaluate the effectiveness of interventions or for the purpose of talent identification.

Objective
The objective of this systematic review was to examine the methodological quality, measurement properties and feasibility characteristics of sporting skill outcome tests reported in the peer-reviewed literature.

Data Sources
A search of both SPORTDiscus and MEDLINE databases was undertaken.

Study Selection
Studies that examined tests of sporting skill outcomes were reviewed. Only studies that investigated measurement properties of the test (reliability or validity) were included. A total of 22 studies met the inclusion/exclusion criteria.

Study Appraisal and Synthesis Methods
A customised checklist of assessment criteria, based on previous research, was utilised for the purpose of this review.

Results
A range of sports were the subject of the 22 studies included in this review, with considerations relating to methodological quality being generally well addressed by authors. A range of methods and statistical procedures were used by researchers to determine the measurement properties of their skill outcome tests. The majority (95 %) of the reviewed studies investigated test–retest reliability, and where relevant, inter and intra-rater reliability was also determined. Content validity was examined in 68 % of the studies, with most tests investigating multiple skill domains relevant to the sport. Only 18 % of studies assessed all three reviewed forms of validity (content, construct and criterion), with just 14 % investigating the predictive validity of the test. Test responsiveness was reported in only 9 % of studies, whilst feasibility received varying levels of attention.

Limitations
In organised sport, further tests may exist which have not been investigated in this review. This could be due to such tests firstly not being published in the peer-review literature and secondly, not having their measurement properties (i.e., reliability or validity) examined formally.

Conclusions
Of the 22 studies included in this review, items relating to test methodological quality were, on the whole, well addressed. Test–retest reliability was determined in all but one of the reviewed studies, whilst most studies investigated at least two aspects of validity (i.e., content, construct or criterion-related validity). Few studies examined predictive validity or responsiveness. While feasibility was addressed in over half of the studies, practicality and test limitations were rarely addressed. Consideration of study quality, measurement properties and feasibility components assessed in this review can assist future researchers when developing or modifying tests of sporting skill outcomes.

Development and measurement properties of a putting skill test for high-level golf

Despite a recent increase in the amount of research investigating performance in golf, a comprehensive putting skill test has not been reported in the peer-reviewed literature. In this study, the Golf Australia Putting Test (GAPT) was developed and a series of measurement properties were assessed. Elite (n = 18) and high-level amateur (HLA; n = 22) participants completed six single putts from various areas on six concentric circles (circle radii = 0.9, 1.5, 3.0, 4.6, 6.1 and 7.6 m). Using a scoring system that rewarded participants for holing putts from longer distances, the maximum score from a single round of the test (i.e. 36 putts) was 27 points. After two rounds of the test were completed by all players, a subsample of participants (elite, n = 15; HLA, n = 7) had their putting performance recorded during tournament play for a period of 90 days to assess criterion (predictive) validity of the test. The reliability, sensitivity and discriminative validity of the GAPT were also assessed. Better agreement between Rounds 1 and 2 scores was noted in the elite group, whilst reliability values were similar for both groups. Further, the GAPT scores were shown to predict players from the elite and high-ability groups with a low classification error. An equation for predicting on-course performance from GAPT scores was also developed. Findings from this study indicate that the GAPT is a valid and reliable tool for high-level players and the GAPT may be used for player evaluation in the field.

Vehicular crash test of a continuous concrete median barrier without a footing. Final report.

Federal Highway Administration, Washington, D.C.

Small car driver inflatable restraint system evaluation. Volume III: investigation of potential crash survivability of a current production subcompact vehicle equipped with an advanced driver restraint system. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Lap belt angle measurement in adjustable rear seats: procedure development and vehicle survey. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Quantification of occupant response and injury from impact. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Subcompact vehicle energy absorbing column evaluation and improvement. Volume II: analysis of accident data, statistician/analyst's point of view. Interim report.

National Highway Traffic Safety Administration, Washington, D.C.

Subcompact vehicle energy absorbing column evaluation and improvement. Volume I: analysis of accident data, engineer's point of view. Interim report.

National Highway Traffic Safety Administration, Washington, D.C.

Dynamic response of human and primate head and neck to +Gy impact acceleration. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Bridge rail to restrain and redirect buses.

Texas State Department of Highways and Public Transportation, Transportation Planning Division, Austin

Subcompact vehicle energy absorbing column evaluation and improvement. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Small car driver inflatable restraint system evaluation. Volume IV - evolving a low mount passenger air cushion restraint system (ACRS) for the Vega subcompact vehicle. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

RSV test monitoring and data publication - Renault R20TS-to-Calspan RSV 75 degree right side impact at Renault. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

RSV test monitoring and data publication - Renault R20TS-to-Calspan RSV 75 degree left side impact at Peugeot. Final report.

National Highway Traffic Safety Administration, Washington, D.C.

Subcompact vehicle energy absorbing column evaluation and improvement. Final report, executive summary.

National Highway Traffic Safety Administration, Washington, D.C.