Test-retest reliability of four physical activity measures used in population surveys

Accurate monitoring of prevalence and trends in population levels of physical activity (PA) is a fundamental public health need. Test-retest reliability (repeatability) was assessed in population samples for four self-report PA measures: the Active Australia survey (AA, N=356), the short International Physical Activity Questionnaire (IPAQ, N=104), the physical activity items in the Behavioral Risk Factor Surveillance System (BRFSS, N=127) and in the Australian National Health Survey (NHS, N=122). Percent agreement and Kappa statistics were used to assess reliability of classification of activity status as 'active', 'insufficiently active' or 'sedentary'. Intraclass correlations (ICCs) were used to assess agreement on minutes of activity reported for each item of each survey and for total minutes. Percent agreement scores for activity status were very good on all four instruments, ranging from 60% for the NHS to 79% for the IPAQ. Corresponding Kappa statistics ranged from 0.40 (NHS) to 0.52 (AA). For individual items, ICCs were highest for walking (0.45 to 0.78) and vigorous activity (0.22 to 0.64) and lowest for the moderate questions (0.16 to 0.44). All four measures provide acceptable levels of test-retest reliability for assessing both activity status and sedentariness, and moderate reliability for assessing total minutes of activity.

The concurrent validity and test-retest reliability of a visuospatial working memory task

To determine whether the visuospatial n-back working memory task is a reliable and valid measure of cognitive processes believed to underlie intelligence, this study compared the reaction times and accuracy of perforniance of 70 participants, with performance on the Multidimensional Aptitude Battery (MAB). Testing was conducted over two sessions separated by 1 week. Participants completed the MAB during the second test session. Moderate testretest reliability for percentage accuracy scores was found across the four levels of the n-back task, whilst reaction times were highly reliable. Furthermore, participants' performance on the MAB was negatively correlated with accuracy of performance at the easier levels of the n-back task and positively correlated with accuracy of performance at the harder task levels. These findings confirm previous research examining the cognitive basis of intelligence, and suggest that intelligence is the product of faster speed of information processing, as well as superior working memory capacity. (C) 2004 Elsevier Inc. All rights reserved.

Test-retest reliability and practice effects of a rapid screen of mild traumatic brain injury

Test-retest reliabilities and practice affects of measures from the Rapid Screen of Concussion (RSC), in addition to the Digit Symbol Substitution Test (Digit Symbol), were examined. Twenty five male participants were tested three times; each testing session scheduled a week apart. The test-retest reliability estimates for most measures were reasonably good, ranging from .79 to .97. An exception was the delayed word recall test, which has had a reliability estimate of .66 for the first retest, and .59 for the second retest. Practice effects were evident from Times 1 to 2 on the sentence comprehension and delayed recall subtests of the RSC, Digit Symbol and a composite score. There was also a practice effect of the same magnitude found from Time 2 to Time 3 on Digit Symbol, delayed recall and the composite score. Statistics on measures for both the first and second retest intervals, with associated practice affects, are presented to enable the calculation of reliable change indices (RCI). The RCI may be used to assess any improvement in cognitive functioning after mild Traumatic Brain Injury.

Reliability of the Knee Examination in Osteoarthritis: Effect of Standardization

Objective. To assess the reliability of physical examination of the osteoarthritic (OA) knee by rheumatologists, and to evaluate the benefits of standardization. Methods. Forty-two physical signs and techniques were evaluated using a 6 X 6 Latin square design. Patients with mild to severe knee OA, based on physical and radiographic signs, were examined in random order prior to and following standardization of techniques. For those signs with dichotomous scales, agreement among the rheumatologists was calculated as the prevalence-adjusted bias-adjusted kappa (PABAK), while for the signs with continuous and ordinal scales, a reliability coefficient (R-c) was calculated using analysis of variance. A PABAK of >0.60 and an Re of >0.80 were considered to indicate adequate reliability. Results. Adequate poststandardization reliability was achieved for 30 of 42 physical signs/techniques (71%). The most highly reliable signs identified by physical examination of the OA knee included alignment by goniometer (R-c = 0.99), bony swelling (R-c = 0.97), general passive crepitus (R-c = 0.96), gait by inspection (PABAK = 0.78), effusion bulge sign (R-c = 0.97), quadriceps atrophy (R. = 0.97), medial tibiofemoral tenderness (R-c = 0.94), lateral tibiofemoral tenderness (R-c = 0.85), patellofemoral tenderness by grind test (R-c = 0.94), and flexion contracture (R-c = 0.95). The standardization process resulted in substantial improvements in reliability for evaluation of a number of physical signs, although for some signs, minimal or no effect of standardization was noted. After standardization, warmth (PABAK = 0.14), medial instability at 30degrees flexion (PABAK = 0.02), and lateral instability at 30degrees flexion (PABAK = 0.34) were the only 3 signs that were highly unreliable. Conclusion. With the exception of physical examinations for instability, a comprehensive knee examination can be performed with adequate reliability. Standardization further improves the reliability for some physical signs and techniques. The application of these findings to future OA studies will contribute to improved outcome assessments in OA.

Random error in willingness to pay measurement: A multiple indicators, latent variable approach to the reliability of contingent values

The reliability of measurement refers to unsystematic error in observed responses. Investigations of the prevalence of random error in stated estimates of willingness to pay (WTP) are important to an understanding of why tests of validity in CV can fail. However, published reliability studies have tended to adopt empirical methods that have practical and conceptual limitations when applied to WTP responses. This contention is supported in a review of contingent valuation reliability studies that demonstrate important limitations of existing approaches to WTP reliability. It is argued that empirical assessments of the reliability of contingent values may be better dealt with by using multiple indicators to measure the latent WTP distribution. This latent variable approach is demonstrated with data obtained from a WTP study for stormwater pollution abatement. Attitude variables were employed as a way of assessing the reliability of open-ended WTP (with benchmarked payment cards) for stormwater pollution abatement. The results indicated that participants' decisions to pay were reliably measured, but not the magnitude of the WTP bids. This finding highlights the need to better discern what is actually being measured in VVTP studies, (C) 2003 Elsevier B.V. All rights reserved.

Patients with neck pain demonstrate reduced electromyographic activity of the deep cervical flexor muscles during performance of the craniocervical flexion test

Study Design. Cross-sectional study. Objective. The present study compared activity of deep and superficial cervical flexor muscles and craniocervical flexion range of motion during a test of craniocervical flexion between 10 patients with chronic neck pain and 10 controls. Summary of Background Data. Individuals with chronic neck pain exhibit reduced performance on a test of craniocervical flexion, and training of this maneuver is effective in management of neck complaints. Although this test is hypothesized to reflect dysfunction of the deep cervical flexor muscles, this has not been tested. Methods. Deep cervical flexor electromyographic activity was recorded with custom electrodes inserted via the nose and fixed by suction to the posterior mucosa of the oropharynx. Surface electrodes were placed over the superficial neck muscles ( sternocleidomastoid and anterior scalene). Root mean square electromyographic amplitude and craniocervical flexion range of motion was measured during five incremental levels of craniocervical flexion in supine. Results. There was a strong linear relation between the electromyographic amplitude of the deep cervical flexor muscles and the incremental stages of the craniocervical flexion test for control and individuals with neck pain ( P = 0.002). However, the amplitude of deep cervical flexor electromyographic activity was less for the group with neck pain than controls, and this difference was significant for the higher increments of the task ( P < 0.05). Although not significant, there was a strong trend for greater sternocleidomastoid and anterior scalene electromyographic activity for the group with neck pain. Conclusions. These data confirm that reduced performance of the craniocervical flexion test is associated with dysfunction of the deep cervical flexor muscles and support the validity of this test for patients with neck pain.

Are interactions in Gray's Reinforcement Sensitivity Theory proximal or distal in the prediction of religiosity: a test of the joint subsystems hypothesis

Gray's Reinforcement Sensitivity Theory (RST) consists of the Behavioural Activation System (BAS) which is the basis of Impulsivity, and Behavioural Inhibition System (BIS) which is the basis of Anxiety. In this study, Impulsivity and Anxiety were used as distal predictors of attitudes to religion in the prediction of three religious dependent variables (Church attendance, Amount of prayer, and Importance of church). We hypothesised that Impulsivity would independently predict a Rewarding attitude to the Church and that Anxiety would independently predict an Anxious attitude to the church, and that these attitudes would be proximal predictors of our dependent variables. Moreover, we predicted that interactions between predictors would be proximal. Using structural equation modelling, data from 400 participants supported the hypotheses. We also tested Eysenck's personality scales of Extraversion and Neuroticism and found a key path of the structural equation model to be non-significant. (C) 2003 Elsevier Ltd. All rights reserved.

The comprehensive osteoarthritis test: a simple index for measurement of treatment effects in clinical trials

Objective. To assess the measurement properties of a simple index of symptom severity in osteoarthritis (OA) of the hips and knees. Methods. Both the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) and the proposed new Comprehensive Osteoarthritis Test (COAT) instrument were completed weekly by 125 subjects in the context of a randomized, 12-week, 3 parallel-arm clinical trial. The reliabilities of the various scales were assessed on a weekly basis by use of Cronbach's alpha coefficients. The validity of the COAT total scale was assessed by correlation with the WOMAC total scale on a weekly basis with correlation coefficients, and in terms of the correlations between subject-level intercepts and slopes over time. The relative responsiveness of the WOMAC and COAT total scales was assessed using a multilevel (longitudinal) multivariate (WOMAC, COAT) linear model. Results. The WOMAC and COAT total scales were highly reliable (mean over weeks: WOMAC alpha = 0.98; COAT alpha = 0.97). The correlations between the WOMAC and COAT scales were very high (mean over weeks = 0.92; subject-level intercepts = 0.91, slopes = 0.88). The COAT total scale was significantly more responsive than the WOMAC total scale in the active treatment (34.8% improvement vs 26.8%; p = 0.002). Conclusion. The COAT total scale is simple to administer, reliable, valid, and responsive to treatment effects.

California older adult Stroop test (COAST): Development of a Stroop test adapted for geriatric populations

An adaptation of the traditional Stroop test, the California Older Adult Stroop Test (COAST) (Pachana, Marcopulos, Yoash-Gantz & Thompson, 1995), has been developed specifically for use with a geriatric population, utilizing larger typeface, fewer items (50) per task, and more easily distinguished colors (red, yellow and green). Test-retest reliability and validity data are reviewed for both control and clinical populations. Increased error rates on the Stroop test compared to the COAST were found for the color and color/word interference tasks. These results are discussed in terms of changes in the visual system with increasing age. The implications for better test sensitivity with the COAST for older adult populations are discussed.

Testing the reliability of a new ultrasonic cardiac output monitor, the USCOM, by using aortic flowprobes in anesthetized dogs

We have used an animal model to test the reliability of a new portable continuous-wave Doppler ultrasonic cardiac output monitor, the USCOM. In six anesthetized dogs, cardiac output was measured with a high-precision transit time ultrasonic flowprobe placed on the ascending aorta. The dogs' cardiac output was increased with a dopamine infusion (0-15 mug (.) kg(-1) (.) min(-1)). Simultaneous flowprobe and USCOM cardiac output measurements were made. Up to 64 pairs of readings were collected from each dog. Data were compared by using the Bland and Altman plot method and Lin's concordance correlation coefficient. A total of 319 sets of paired readings were collected. The mean (+/-SD) cardiac output was 2.62 +/- 1.04 L/min, and readings ranged from 0.79 to 5.73 L/min. The mean bias between the 2 sets of readings was -0.01 L/min, with limits of agreement (95% confidence intervals) of -0.34 to 0.31 L/min. This represents a 13% error. In five of six dogs, there was a high degree of concordance, or agreement, between the 2 methods, with coefficients >0.9. The USCOM provided reliable measurements of cardiac output over a wide range of values. Clinical trials are needed to validate the device in humans.

Reliability of a measure of prediagnosis physical activity for cancer survivors

Purpose: This study was conducted to examine the test-retest reliability of a measure of prediagnosis physical activity participation administered to colorecial cancer survivors recruited from a population-based state cancer registry. Methods: A total of 112 participants completed two telephone interviews. I month apart, reporting usual weekly physical activity in the year before their cancer diagnosis. Intraclass correlation coefficients (ICC) and standard en-or of measurement (SEM) were used to describe the test-retest reliability of the measure across the sample: the Bland-Altman approach was used to describe reliability at the individual level. The test-retest reliability for categorized total physical activity (active, insufficiently active, sedentary) was assessed using the kappa statistic. Results: When the complete sample was considered, the ICC ranged from 0.40 (95% Cl: 0.24, 0.55) for vigorous gardening to 0.77 (95% Cl: 0.68, 0.84) for moderate physical activity. The SEM, however, were large. indicating high measurement error. The Bland-Altman plots indicated that the reproducibility of data decreases as the aniount of physical activity reported each week increases The kappa coefficient for the categorized data was 0.62 (95% Cl: 0.48, 0.76). Conclusion: Overall. the results indicated low levels of repeatability for this measure of historical physical activity. Categorizing participants as active, insufficiently active, or sedentary provides a higher level of test-retest reliability.