Reliability of the pictorial scale of perceived movement skill competence in 2 diverse samples of young children

The purpose was to determine the reliability of an instrument designed to assess young children's perceived movement skill competence in two diverse samples.

Face validity and reliability of a pictorial instrument for assessing fundamental movement skill perceived competence in young children

To determine reliability and face validity of an instrument to assess young children's perceived fundamental movement skill competence.

Validity and reliability of field-based measures for assessing movement skill competency in lifelong physical activities: a systematic review

Background: It has been suggested that young people should develop competence in a variety of ‘lifelong physical activities’ to ensure that they can be active across the lifespan. Objective: The primary aim of this systematic review is to report the methodological properties, validity, reliability, and test duration of field-based measures that assess movement skill competency in lifelong physical activities. A secondary aim was to clearly define those characteristics unique to lifelong physical activities. Data Sources: A search of four electronic databases (Scopus, SPORTDiscus, ProQuest, and PubMed) was conducted between June 2014 and April 2015 with no date restrictions. Study Selection: Studies addressing the validity and/or reliability of lifelong physical activity tests were reviewed. Included articles were required to assess lifelong physical activities using process-oriented measures, as well as report either one type of validity or reliability. Study Appraisal and Synthesis Methods: Assessment criteria for methodological quality were adapted from a checklist used in a previous review of sport skill outcome assessments. Results: Movement skill assessments for eight different lifelong physical activities (badminton, cycling, dance, golf, racquetball, resistance training, swimming, and tennis) in 17 studies were identified for inclusion. Methodological quality, validity, reliability, and test duration (time to assess a single participant), for each article were assessed. Moderate to excellent reliability results were found in 16 of 17 studies, with 71 % reporting inter-rater reliability and 41 % reporting intra-rater reliability. Only four studies in this review reported test–retest reliability. Ten studies reported validity results; content validity was cited in 41 % of these studies. Construct validity was reported in 24 % of studies, while criterion validity was only reported in 12 % of studies. Limitations: Numerous assessments for lifelong physical activities may exist, yet only assessments for eight lifelong physical activities were included in this review. Generalizability of results may be more applicable if more heterogeneous samples are used in future research. Conclusion: Moderate to excellent levels of inter- and intra-rater reliability were reported in the majority of studies. However, future work should look to establish test–retest reliability. Validity was less commonly reported than reliability, and further types of validity other than content validity need to be established in future research. Specifically, predictive validity of ‘lifelong physical activity’ movement skill competency is needed to support the assertion that such activities provide the foundation for a lifetime of activity.

Reliability of a food frequency questionnaire to assess dietary antioxidant intake

OBJECTIVE: Epidemiologic evidence of a role for antioxidants in the prevention of chronic disease has been inconclusive, in part due to the difficulty of measuring past diets of free-living populations. The purpose of the current study was to examine the reliability of a 19-item, self-administered, semiquantitative, food frequency questionnaire to assess intake of the major dietary antioxidants. METHODS: Reliability was established by administering the food frequency questionnaire a second time by telephone. The subjects comprised 151 participants in the Melbourne Visual Impairment Project, a study of the distribution and determinants of eye disease in Melbourne residents aged 40 and over. RESULTS: Spearman correlation coefficients ranged from 0.39 for spinach to 0.76 for yoghurt, and all were highly significant (all p = 0.001). The reliability of the instrument was not influenced by gender, English speaking ability, or the number of days between the first and second administration of the questionnaire. CONCLUSION: In conclusion, we have shown this 19-item food frequency questionnaire to be highly reliable. It should be useful for anyone involved in the study of the relationship of dietary antioxidant intake to health outcomes in large populations where limitations of time and money prohibit the collection of more detailed dietary intake information.

Development and interrater reliability of the UK Mental Health Triage Scale

Mental health triage scales are clinical tools used at point of entry to specialist mental health service to provide a systematic way of categorizing the urgency of clinical presentations, and determining an appropriate service response and an optimal timeframe for intervention. The aim of the present study was to test the interrater reliability of a mental health triage scale developed for use in UK mental health triage and crisis services. An interrater reliability study was undertaken. Triage clinicians from England and Wales (n = 66) used the UK Mental Health Triage Scale (UK MHTS) to rate the urgency of 21 validated mental health triage scenarios derived from real occasions of triage. Interrater reliability was calculated using Kendall's coefficient of concordance (w) and intraclass correlation coefficient (ICC) statistics. The average ICC was 0.997 (95% confidence interval (CI): 0.996-0.999 (F (20, 1300) = 394.762, P < 0.001). The single measure ICC was 0.856 (95% CI: 0.776-0.926 (F (20, 1300) = 394.762, P < 0.001). The overall Kendall's w was 0.88 (P < 0.001). The UK MHTS shows substantial levels of interrater reliability. Reliable mental health triage scales employed within effective mental health triage systems offer possibilities for not only improved patient outcomes and experiences, but also for efficient use of finite specialist mental health services.

Influence of pacing on reliability of middle-distance cycling performance

The purpose of the present study was to examine the reliability of middle distance cycling time trials using fast-, even-, and slow-starts. Eighteen endurance-trained male cyclists [mean ± standard deviation; VO2peak 63.1 ± 6.1 mL⋅kg-1⋅min-1] performed nine cycling time trials where the total external work (96.5 ± 11.2 kJ) was identical to the better of two, 5-minute habituation time trials. Power output during the first quarter of the time-trials (24.1 ± 2.8 kJ) was fixed to induce fast-, even- or slow-starting strategies (60, 75 and 90 s, respectively). In consecutive sessions, participants performed three trials of each pacing condition although the order of these pacing conditions was counterbalanced. Average power output and performance time were unaffected by trial number in the fast- (P = 0.60), even- (P = 0.18) and slow-start (P = 0.53) trials. In all three pacing conditions, average power output was highly reliable and similar between trial 1 to 2 and trial 2 to 3 in fast- (standard error of measurement; SEM=8.3 and 8.2W), even (coefficient of variation; CV=2.8 and 2.4%) and slow-start (CV=2.4 and 1.5%) trials. In conclusion, the reproducibility of 5-min cycling time trials is unaffected by starting strategy and is acceptable following two selfpaced habituation trials. Research examining the influence of pacing strategies may therefore be conducted without the need for familiarisation trials using each individual pacing condition.

The diagnostic validity and reliability of an internet-based clinical assessment program for mental disorders

BACKGROUND: Internet-based assessment has the potential to assist with the diagnosis of mental health disorders and overcome the barriers associated with traditional services (eg, cost, stigma, distance). Further to existing online screening programs available, there is an opportunity to deliver more comprehensive and accurate diagnostic tools to supplement the assessment and treatment of mental health disorders. OBJECTIVE: The aim was to evaluate the diagnostic criterion validity and test-retest reliability of the electronic Psychological Assessment System (e-PASS), an online, self-report, multidisorder, clinical assessment and referral system. METHODS: Participants were 616 adults residing in Australia, recruited online, and representing prospective e-PASS users. Following e-PASS completion, 158 participants underwent a telephone-administered structured clinical interview and 39 participants repeated the e-PASS within 25 days of initial completion. RESULTS: With structured clinical interview results serving as the gold standard, diagnostic agreement with the e-PASS varied considerably from fair (eg, generalized anxiety disorder: κ=.37) to strong (eg, panic disorder: κ=.62). Although the e-PASS' sensitivity also varied (0.43-0.86) the specificity was generally high (0.68-1.00). The e-PASS sensitivity generally improved when reducing the e-PASS threshold to a subclinical result. Test-retest reliability ranged from moderate (eg, specific phobia: κ=.54) to substantial (eg, bulimia nervosa: κ=.87). CONCLUSIONS: The e-PASS produces reliable diagnostic results and performs generally well in excluding mental disorders, although at the expense of sensitivity. For screening purposes, the e-PASS subclinical result generally appears better than a clinical result as a diagnostic indicator. Further development and evaluation is needed to support the use of online diagnostic assessment programs for mental disorders. TRIAL REGISTRATION: Australian and New Zealand Clinical Trials Registry ACTRN121611000704998; http://www.anzctr.org.au/trial_view.aspx?ID=336143 (Archived by WebCite at http://www.webcitation.org/618r3wvOG).

Validity and reliability of questionnaires measuring physical activity self-efficacy, enjoyment, social support among Hong Kong Chinese children

BACKGROUND: Physical activity (PA) correlates have not been extensively studied in Hong Kong children.

OBJECTIVE: The aim of this study is to assess the validity and reliability of translated scales to measure PA related self-efficacy, enjoyment and social support in Hong Kong Chinese children.

METHODS: Sample 1 (n = 273, aged 8-12 years) was recruited (May-June, 2013) from two primary schools. Confirmatory factor analyses (CFA) were conducted to assess factorial validity. Criterion validity was assessed by correlating measured constructs with self-reported PA. Cronbach's alpha was computed to assess scale internal consistency. The intraclass correlation coefficient (ICC) was performed to assess scale test-retest reliability. Criterion validity was further examined in Sample 2 (n = 84, aged 8-12 years) from a third school by correlating measured constructs with objectively measured PA collected in September 2013 and February 2014.

RESULTS: The CFA results supported the one-factor structure of the scales. All PA correlates were significantly (p < 0.01) associated with self-reported PA in Sample 1. Self-efficacy and enjoyment were significantly (p < 0.05) correlated with objectively measured PA in Sample 2. All the scales demonstrated acceptable internal consistency. All ICC values of the scales suggested acceptable test-retest reliability.

CONCLUSION: The results provide psychometric support for using the scales to measure PA correlates among Hong Kong Chinese children.

Reliability of the nociceptive flexor reflex (RIII) threshold and association with pain threshold

The purpose of this study was to assess the reliability of the RIII reflex threshold and Pain threshold in three repeated trials using electrocutaneous stimuli. Each trial was separated by a mean of 4.3 +/- 2.9 days (between-trials) and included two repeated measurements (within-trial) of the RIII reflex threshold (RIII-T) and the Pain threshold (PT) separated by 20 min. The participants were 14 healthy males (mean age +/- SD, 23.5 +/- 5.3 years). There was a significant difference between the RIII-T and PT. The reliability of the RIII-T and PT shows a between-trials coefficient of variance (CV(SEM)) of 16.1 and 16.9%, respectively. The within-trial CV(SEM) for RIII-T and PT was 5.4 and 4.3%, respectively. There was a significant correlation between the RIII-T threshold and PT. The parallel association and correlation of the RIII-T with the PT suggests that the RIII-T is valid in experimental pain studies under standardised resting conditions.

Setting the record straight: assessing the reliability of retrospective accounts of change

Conservation Letters published by Wiley Periodicals, Inc. Ecological degradation is accelerating, reducing our ability to detect and reverse declines. Resource user accounts have the potential to provide critical information on past change but their reliability can rarely be tested, hence they are often perceived as less valid than other forms of scientific data. We compared individual fishers' catch records, recorded 1-50 years ago, with their memories of past good, typical and poor catches for the corresponding time period. Good and poor catches were recalled with reasonable accuracy, matching variability in recorded catch with no significant change observed over time. Typical recalled catches were overestimated and became significantly more exaggerated over time, but were more comparable to mean than median recorded values. While accuracy of resource users' memory varied with the type of information recalled, our results suggest that carefully structured interview questions can produce reliable quantitative data to inform resource management, even after several decades have elapsed.