Tests examining skill outcomes in sport: A systematic review of measurement properties and feasibility

Background
A high level of participant skill is influential in determining the outcome of many sports. Thus, tests assessing skill outcomes in sport are commonly used by coaches and researchers to estimate an athlete’s ability level, to evaluate the effectiveness of interventions or for the purpose of talent identification.

Objective
The objective of this systematic review was to examine the methodological quality, measurement properties and feasibility characteristics of sporting skill outcome tests reported in the peer-reviewed literature.

Data Sources
A search of both SPORTDiscus and MEDLINE databases was undertaken.

Study Selection
Studies that examined tests of sporting skill outcomes were reviewed. Only studies that investigated measurement properties of the test (reliability or validity) were included. A total of 22 studies met the inclusion/exclusion criteria.

Study Appraisal and Synthesis Methods
A customised checklist of assessment criteria, based on previous research, was utilised for the purpose of this review.

Results
A range of sports were the subject of the 22 studies included in this review, with considerations relating to methodological quality being generally well addressed by authors. A range of methods and statistical procedures were used by researchers to determine the measurement properties of their skill outcome tests. The majority (95 %) of the reviewed studies investigated test–retest reliability, and where relevant, inter and intra-rater reliability was also determined. Content validity was examined in 68 % of the studies, with most tests investigating multiple skill domains relevant to the sport. Only 18 % of studies assessed all three reviewed forms of validity (content, construct and criterion), with just 14 % investigating the predictive validity of the test. Test responsiveness was reported in only 9 % of studies, whilst feasibility received varying levels of attention.

Limitations
In organised sport, further tests may exist which have not been investigated in this review. This could be due to such tests firstly not being published in the peer-review literature and secondly, not having their measurement properties (i.e., reliability or validity) examined formally.

Conclusions
Of the 22 studies included in this review, items relating to test methodological quality were, on the whole, well addressed. Test–retest reliability was determined in all but one of the reviewed studies, whilst most studies investigated at least two aspects of validity (i.e., content, construct or criterion-related validity). Few studies examined predictive validity or responsiveness. While feasibility was addressed in over half of the studies, practicality and test limitations were rarely addressed. Consideration of study quality, measurement properties and feasibility components assessed in this review can assist future researchers when developing or modifying tests of sporting skill outcomes.

The sport spectator satisfaction model : A conceputal framework for understanding the satisfaction of spectators

Customer satisfaction is associated with numerous positive business outcomes and is recognised as an important field of study. However, only limited research has addressed the satisfaction of sport spectators, with even fewer studies examining the determinants of this satisfaction. Yet an understanding of how spectators arrive at evaluations of satisfaction or dissatisfaction provides a useful insight for directing marketing and operational efforts. The Sport Spectator Satisfaction Model (SSSM) is an extension of the Disconfirmation of Expectations Model (DEM) accommodating unique aspects of the sport product, as well as accommodating the core and peripheral dimensions of the spectator service. The SSSM depicts club identification and the win/lose phenomenon as considerable influences on the satisfaction spectators derive from the game and its peripheral services. The SSSM integrates marketing theory, social identity theory and sport marketing theory to broaden our understanding of spectator satisfaction and provide a platform for further research.

Determining the professional sport broadcasting landscape : an Australian football club perspective

The professional sport broadcasting landscape has received much attention from an economic and legal perspective. While the economic and legal focus has been the predominant association with sport broadcasting, there has been little research undertaken into the breadth of delivery and significance of broadcast coverage. The aim of this paper was to identify the professional sport broadcasting landscape in Australia. The sport broadcast landscape was examined from the perspective of two professional football codes. In-depth interviewing of senior managers of 11 AFL, and 10 NRL clubs was undertaken with the resulting data analysed, coded and emergent themes identified. Three core themes emerged: identified as territory, distribution and profile. A further seven sub-themes specific to the outcomes associated within each category were also identified. Major findings highlight the territorial nature of the Australian professional football league market, identifying the way in which clubs are representative of particular regions. Issues associated with free-to-air delivery, brand recognition and core market attributes were also identified. Results are presented; implications for management and opportunities for future research are discussed.

An empirical investigation of high relational orientation sport club members

Relationships between businesses, businesses and end customers, as well as between customers are an important area of practical and scientific interest. In the present era, largely due to digital technologies such as the database, public and private networks, and data collection and information distribution via TCP/IP (Transmission Control Protocol/Internet Protocol) interface tools such as the World Wide Web (Web), the interest in relationships and related aspects such as trust as it relates to Web interactivity continues. An important antecedent empirical study established that arts patrons (customers) of a New York theatre company could be segmented according to their relational orientation, and that this orientation mediated between component attitudes and future purchase intentions. The study reported in this paper employs Web-based data collection and postal data collection methods in an investigation of the mediation effects of these data collection methods used with the same population of a premier football club in Australia. While a future aim is to more closely compare the outcomes established in the arts study with those from a similarly constructed study in the sporting arena, the focus of this initial paper is the differences in response exhibited by online respondents relative to postal survey respondents. The paper reports findings which do not support those of the antecedent arts and entertainment study concerning the weakness of overall satisfaction on the purchase intentions of high relational orientation customers. The paper also reports findings which give confidence to users of online surveys that despite differences in demographic profiles of these respondents and postal survey respondents, there is a degree of similarity in the responses of the two groups on the measures used in this study. The paper also suggests the need for further research into these data collection effects as they relate to relationship marketing.

The perceptions of expert coaches about effective leadership in sport

Research on effective leadership in sport has identified a number of characteristics and situations that impact on coaching effectiveness. These include coach effect on athlete satisfaction and performance, self-esteem and trait anxiety. This research has focused on athletes' perceptions of or preferences for specific leadership behaviors and actual coach behaviors identified by observing coaches. Few studies have recognized the views of the expert coach as a potentially valuable source of information regarding effective leadership and the coaching process. The present study investigated expert coaches' perception and interpretation of the leadership process. Twenty successful coaches working with Australian junior elite sport participants were purposefully sampled to cover a diversity of sports (team and individual) and provide a gender balance across sports. Through in-depth interviews, based on Grounded Theory, the study examined three aspects of coaching, which provided the basis of the interview guide. These were coaching history and influences, effective coaching behaviors, and coach training and accreditation. Eight major themes emerged: (a) influence of history on coaching behaviors, (b) knowledge of the sport, (c) pedagogy skills, (d) coaches' personal qualities, (e) coach-athlete relationships, (f) coaches' evaluation of the athlete, (g) coach and athlete outcomes, and (h) enjoyment of the coaching process. The results highlight the important role coaches play in future coach development, the impact of coach self-efficacy attributed to athlete self-efficacy, and how coach-related outcomes drive the coaching process. These results have noteworthy implications for coach education programs.

Consideration of corporate social orientation in managing sport organisations' internal stakeholders

Increasing pressure from the public has raised the expectations on corporations to be better citizens of their communities and society as a whole (Bennet 2002; Carroll 1999; Epstein 1989; Van Marrewijk 2003; Wood 1991). As a result, corporations have engaged in corporate social responsibility efforts with most of the subsequent research focused on its impact on consumer response (e.g., attitudes, behaviours, etc.) (Bhattacharya & Sen 2001, 2004; Porter & Kramer 2002). Similarly, research interest on corporate social responsibility in the sport industry has risen, yet no research studies have explored the influence and perceptions about corporate social responsibility of important internal constituents (employees and volunteers) of sport organisations. Particular interest would be in uncovering what employees and volunteers specifically believe are important among CSR elements (ethical, discretionary, legal, economic) and what impact a sense of 'shared CSR values' with the respective sport organisation would have on employee and volunteer response. Will understanding how shared social values influence organisational commitment provide insight on recruitment, retention and/or development strategies of employees and volunteers? Further, assessing any difference in sensemaking between these two groups would be of additional value to this line of enquiry, as the perceptions of the organisation are understood as "tantamount to reality, since organisations are social constructions made up of and acting in accordance with shared perceptions," (Brickson 2007, p. 865) particularly those of employees and volunteers of sport organisations. With increasing academic and industry interest of corporate social responsibility in sport and to address the obvious gap on CSR and employees and volunteers in the literature, the present study will explore how CSR impacts internal constituents (employees and volunteers) of sport organisations. Specifically, the main purpose of the present study is to assess the level of perceived shared values as they related to CSR (measured as corporate social orientation) between employees- organisation and volunteers- organisation. Further, the influence of the level of perceived shared corporate social orientation (CSO) on organisational identification will be evaluated in the context of a proposed model, which includes the relationship of perceived shared corporate social orientation>organisational identification> attitudinal and behavioural outcomes (i.e., commitment, satisfaction, and organisational behaviour). Using a sample of employees and volunteers of a sport organisation, the respondents will be asked to complete an online survey composed of demographic items, the corporate social orientation scale, and items that measure organisational identification, value commitment, job/ volunteer satisfaction, and organisational citizenship behaviours. Discussion of how other stakeholder (e.g., sponsors, consumers, etc.) perceptions on CSR potentially impacts the model and outcomes (e.g., corporate reputation, consumer behaviour) will be addressed. Analyses and results will support discussion and conclusions made to provide evidence for practitioner and researcher implications.

Enhancing student employability : a New Zealand case study of cooperative education in sport

This paper provides an insight into two cooperative education courses offered as part of three-year degree programmes in sport and recreation. Based in Auckland New Zealand, Unitec and Auckland University of Technology have been found to exemplify effective cooperative education strategies that compare favourably with current research into good practice in this field. Using a case study approach, the paper first establishes the context within which the cooperative courses operate, and then describes specific aspects of the courses that enhance student employability. The placement process, supervision, learning outcomes, assessment of learning and employment and career pathways are discussed in turn. These aspects are related back to relevant research on good practice and used to illuminate how student employability is embedded within these courses and across the degree programmes. It is concluded that students who undertake cooperative education as part of their degree programme have a competitive advantage in the employment marketplace.

Training patterns and negative health outcomes in triathlon : longitudinal observations across a full competitive season

AIM: Despite heavy training requirements, triathlon is a sport that is rapidly increasing in popularity. Yet, there is limited research detailing the relationship between training, the incidence of injuries and illness, psychological stress, overtraining and athlete burnout amongst triathletes. Six hypotheses relating inter-individual differences to training factors were generated to evaluate change in self-reported measures of these negative health outcomes over a training year.

METHODS: Thirty, well-trained, triathletes (males n=20: age=27.1±9.1 years and females n=10: age=27.4±6.6 years) from a local triathlon club participated in this study. The study commenced during pre-season training, and involved weekly monitoring of each athlete until the end of the competitive season 45 weeks later. Linear Mixed Modelling was used for the analysis.

RESULTS: Signs and symptoms of injury and illness (SAS) were significantly associated with increases in training factors (P≤0.05); however, greatest impact on SAS was produced by psychological stressors (P≤0.001). Common symptoms of overtraining were significantly affected by increases in exposure to both training and psychological stressors (P≤0.05). Mood disturbance was not significantly affected by training factors (P>0.05) but rather increases in psychological stressors (P≤0.001). Finally, each of the three athlete burnout subscales were significantly affected by both psychological (P≤0.001) stressors as well as varying combinations of training factors (P≤0.05).

CONCLUSIONS: Exposure to stressors (either training or psychological) had significant effects on all negative health outcomes assessed.

Return to pre-injury health status and function 12 months after hospitalisation for sport and active recreation related orthopaedic injury

Background Hospitalised sport and active recreation injuries can have serious long-term consequences. Despite this, few studies have examined the long-term outcomes of these injuries. The purpose of this study was to establish whether patients hospitalised with orthopaedic sport and active recreation injuries, have returned to their pre-injury levels of health status and function, 12 months post injury and identify factors associated with poor outcomes. The present work was a cohort study with retrospective assessment of pre-injury status and prospective assessment of outcome at 12 months post injury.

Methods Adults with orthopaedic sport and active recreation injuries, captured by the Victorian Orthopaedic Trauma Outcomes Registry were recruited to the study. Pre-injury and 12-month outcomes were assessed using the 36-item Short Form Health Survey (SF-36) and the extended Glasgow Outcome Scale. Differences in pre-injury and post-injury SF-36 scores were examined and demographic, injury, hospital and physical activity variables were assessed for associations with outcome using multivariate linear regression.

Results Of the 324 participants 98% were followed-up at 12 months post injury. At 12 months, participants reported a mean 7.0-point reduction in physical health (95% CI 5.8 to 7.8) and a 2.5-point reduction in mental health (95% CI 1.2 to 3.0), with 58% (95% CI 52.6% to 63.4%) reporting reduced function. Sporting group (p=0.001), Injury Severity Score >15 (p=0.007) and high pre-injury vigorous activity levels (p=0.04), were related to poorer physical health outcomes.

Conclusions At 12 months post injury, most participants reported large reductions in physical health and reduced function. This information is important for furthering our understanding of the burden of sport and active recreation injury and setting priorities for treatment and rehabilitation.

The impact of sport and active recreation injuries on physical activity levels at 12 months post-injury

The aim of this study was to evaluate the impact of serious sport and active recreation injury on 12-month physical activity levels. Adults admitted to hospital with sport and active recreation-related injuries, and captured by the Victorian Orthopaedic Trauma Outcomes Registry were recruited to the study. Changes between preinjury and 12 month post-injury physical activity was assessed using the short International Physical Activity Questionnaire (IPAQ). Independent demographic, injury, and hospital variables were assessed for associations with changes in physical activity levels, using multivariate linear regression. A total of 324 patients were recruited, of which 98% were followed up at 12 months. Mean short IPAQ scores decreased from 7650 METS (95% CI: 7180, 8120) preinjury to 3880 METS; (95% CI: 3530, 4250) post-injury, independent of functional recovery. Education level and occupation group were the only variables independently associated with changes in physical activity levels post-injury. These results highlighted that sport and active recreation injuries lead to significant reductions in physical activity levels. Hence, the prevention of sport and active recreation injuries is important when considering promotion of activity at a population level.

Corporate social responsibility in professional team sport organisations : towards a theory of decision-making

Research question: 

Sport-for-development: an integrated literature review

Despite the significant increase of published research in sport-for-development (SFD), to date there have been no attempts to rigorously review and synthesize scholarly contributions in this area. To address this issue, we conducted an integrative review of SFD literature to portray an overarching and holistic picture of the field. Through a comprehensive literature analysis following Whittemore and Knafl’s (2005) five-step process, we provide evidence of the status quo of current SFD research foci, authorship, geographical contexts, theoretical frameworks, sport activity, level of development, methodologies, methods, and key research findings. Our study shows an increasing trend of journal publications since 2000, with a strong focus on social and educational outcomes related to youth sport and with football (soccer) as the most common activity. A large majority of SFD research has been conducted at the community level, where qualitative approaches are dominant. The geographical contexts of authorship and study location present an interesting paradox: Although the majority of SFD projects are carried out in Africa, Asia, and Latin America, 90% of SFD authors are based in North America, Europe, and Australia. We conclude our study by providing new perspectives on key issues in SFD and by outlining current research and theoretical gaps that provide the basis for future scholarly inquiry.

Exploring the utility of collaborative governance in a National Sport Organization running head: Collaborative sport governance

This paper presents the outcomes of an 18-month developmental action research study to enhance the governance capability of a national sport organization. Bowls Australia, the national governing body for lawn bowls
in Australia, includes nine independent state and territory member-associations. An intervention was designed and implemented with the Bowls Australia Board. The purpose of the intervention was to enact collaborative governance to overcome a perceived cultural malaise in the governance of the sport. This study is one of the first to examine collaborative governance in a federal sport structure. Results demonstrate the utility of collaborative governance to overcome adversarial national, member-state relations for the purpose of establishing a common and unifying vision for bowls, while also enhancing governance capability. This study identified the importance of collective board leadership in governance decision-making throughout the sport. It also highlights future research directions in relation to collective board leadership in federal governance structures.

New approaches for studies of Muslim women and sport

This article offers a new approach for examining Muslim women in sport, which combines the domains of sporting participation, consumption and representation. It proposes moving beyond a sports development paradigm and deficit model of sports participation, whereby marginal communities are incorporated into the mainstream by playing sport, to take account of other ways that people engage with sport as consumers and fans. Conceptually, this approach is informed by transnational feminist perspectives, which foreground the role of power hierarchies in the production of knowledge about the sporting female Other. It suggests that sport practitioners, scholars and policy makers pay greater theoretical attention to how Muslim women are constructed within sport discourses. By widening the research focus to consider consumption and representation, possibilities emerge to expand on the narrow research and policy fields of ‘ethnicity’ and ‘well-being’ focused on physical health outcomes through which Muslim women’s engagement with sport is commonly framed.