Behaviour state analysis in Rett syndrome: Continuous data reliability measurement

Awareness of optimal behaviour states of children with profound intellectual disability has been reported in the literature as a potentially useful tool for planning intervention within this population. Some arguments have been raised, however, which question the reliability and validity of previously published work on behaviour state analysis. This article sheds light on the debate by presenting two stages of a study of behaviour state analysis for eight girls with Rett syndrome. The results support Mudford, Hogg, and Roberts' (1997, 1999) concerns with the pooling of participant data. The results of Stage 2 also suggest, however, that most categories of behaviour state can be reliably distinguished once definitions of behaviours for each state are clearly defined.

Random error in willingness to pay measurement: A multiple indicators, latent variable approach to the reliability of contingent values

The reliability of measurement refers to unsystematic error in observed responses. Investigations of the prevalence of random error in stated estimates of willingness to pay (WTP) are important to an understanding of why tests of validity in CV can fail. However, published reliability studies have tended to adopt empirical methods that have practical and conceptual limitations when applied to WTP responses. This contention is supported in a review of contingent valuation reliability studies that demonstrate important limitations of existing approaches to WTP reliability. It is argued that empirical assessments of the reliability of contingent values may be better dealt with by using multiple indicators to measure the latent WTP distribution. This latent variable approach is demonstrated with data obtained from a WTP study for stormwater pollution abatement. Attitude variables were employed as a way of assessing the reliability of open-ended WTP (with benchmarked payment cards) for stormwater pollution abatement. The results indicated that participants' decisions to pay were reliably measured, but not the magnitude of the WTP bids. This finding highlights the need to better discern what is actually being measured in VVTP studies, (C) 2003 Elsevier B.V. All rights reserved.

The comprehensive osteoarthritis test: a simple index for measurement of treatment effects in clinical trials

Objective. To assess the measurement properties of a simple index of symptom severity in osteoarthritis (OA) of the hips and knees. Methods. Both the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) and the proposed new Comprehensive Osteoarthritis Test (COAT) instrument were completed weekly by 125 subjects in the context of a randomized, 12-week, 3 parallel-arm clinical trial. The reliabilities of the various scales were assessed on a weekly basis by use of Cronbach's alpha coefficients. The validity of the COAT total scale was assessed by correlation with the WOMAC total scale on a weekly basis with correlation coefficients, and in terms of the correlations between subject-level intercepts and slopes over time. The relative responsiveness of the WOMAC and COAT total scales was assessed using a multilevel (longitudinal) multivariate (WOMAC, COAT) linear model. Results. The WOMAC and COAT total scales were highly reliable (mean over weeks: WOMAC alpha = 0.98; COAT alpha = 0.97). The correlations between the WOMAC and COAT scales were very high (mean over weeks = 0.92; subject-level intercepts = 0.91, slopes = 0.88). The COAT total scale was significantly more responsive than the WOMAC total scale in the active treatment (34.8% improvement vs 26.8%; p = 0.002). Conclusion. The COAT total scale is simple to administer, reliable, valid, and responsive to treatment effects.

Outcome measurement in Australian rehabilitation environments

Objective: To determine the frequency and pattern of methods of outcome assessment used in Australian physical rehabilitation environments. Design: Postal survey. Methods: A questionnaire on service type, staffing, numbers of adults treated and outcome measures used for 7 conditions related to injury and road trauma as well as stroke and neuromuscular disorders was sent to 973 services providing adult physical rehabilitation treatment. Results: Questionnaires were completed by 440 service providers for a response rate of 45%, similar to that reported in a recent European survey reported in this journal. A small number of measures were reported as in use by most respondents, while a large number of measures were used by a few respondents. Measures of physical changes were used more frequently than those of generic well-being or quality of life. Ease of use and reporting to other professionals were cited as the most important reasons in selection of outcome measures. Conclusion: This Australian-wide survey detected considerable heterogeneity in outcome measurement procedures used in rehabilitation environments. While the goal of measurement may vary between providers and differ between conditions, the results highlight opportunities for harmonization, benchmarking and measurement of health-related quality of life.

Measurement properties of the CHAMPS physical activity questionnaire in a sample of older Australians

Background: The effective evaluation of physical activity interventions for older adults requires measurement instruments with acceptable psychometric properties that are sufficiently sensitive to detect changes in this population. Aim: To assess the measurement properties (reliability and validity) of the Community Healthy Activities Model Program for Seniors (CHAMPS) questionnaire in a sample of older Australians. Methods: CHAMPS data were collected from 167 older adults (mean age 79.1 S.D. 6.3 years) and validated with tests of physical ability and the SF-12 measures of physical and mental health. Responses from a sub-sample of 43 older adults were used to assess 1-week test-retest reliability. Results: Approximately 25% of participants needed assistance to complete the CHAMPS questionnaire. There were low but significant correlations between the CHAMPS scores and the physical performance measures (rho=0.14-0.32) and the physical health scale of the SF-12 (rho=0.12-0.24). Reliability coefficients were highest for moderate-intensity (ICC=0.81-0.88) and lowest for vigorous-intensity physical activity (ICC=0.34-0.45). Agreement between test-retest estimates of sufficient physical activity for health benefits (>= 150 min and >= 5 sessions per week) was high (percent agreement = 88% and Cohen's kappa = 0.68). Conclusion: These findings suggest that the CHAMPS questionnaire has acceptable measurement properties, and is therefore suitable for use among older Australian adults, as long as adequate assistance is provided during administration. (c) 2006 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Reliability and validity of arm volume measurements for assessment of lymphedema

Background and Purpose. Arm lymphedema following breast cancer In this study, we assessed the surgery is a continuing problem. reliability and validity of circumferential measurements and water displacement for measuring upper-limb volume. Subjects. Participants included subjects who had had breast cancer surgery, including axillary dissection-19 with and 22 without a diagnosis of arm lymphedema-and 25 control subjects. Methods. Two raters measured each subject by using circumferential tape measurements at specified distances from the fingertips and in relation to anatornic landmarks and by using water displacement. Interrater reliability was calculated by analysis of variance and multilevel modeling. Volumes from circumferential measurements were compared with those from water displacement by use of means and correlation coefficients, respectively. The standard error of measurement, minimum detectable change (MDC), and limits of agreement (LOA) for volumes also were calculated. Results. Arm volumes obtained with these methods had high reliability. Compared with volumes from water displacement, volumes from circumferential measurements had high validity, although these volumes were slightly larger. Expected differences between subjects with and without clinical lymphedema following breast cancer were found. The MDC of volumes or the error associated with a single measure for data based oil anatomic landmarks was lower than that based oil distance from fingertips. The mean LOA with water displacement were lower for data based on anatomic landmarks than for data based on distance from fingertips. Discussion and Conclusion. Volumes calculated from anatomic landmarks are reliable, valid, and more accurate than those obtained from circumferential measurements based on distance from fingertips.

Reliability of a measure of prediagnosis physical activity for cancer survivors

Purpose: This study was conducted to examine the test-retest reliability of a measure of prediagnosis physical activity participation administered to colorecial cancer survivors recruited from a population-based state cancer registry. Methods: A total of 112 participants completed two telephone interviews. I month apart, reporting usual weekly physical activity in the year before their cancer diagnosis. Intraclass correlation coefficients (ICC) and standard en-or of measurement (SEM) were used to describe the test-retest reliability of the measure across the sample: the Bland-Altman approach was used to describe reliability at the individual level. The test-retest reliability for categorized total physical activity (active, insufficiently active, sedentary) was assessed using the kappa statistic. Results: When the complete sample was considered, the ICC ranged from 0.40 (95% Cl: 0.24, 0.55) for vigorous gardening to 0.77 (95% Cl: 0.68, 0.84) for moderate physical activity. The SEM, however, were large. indicating high measurement error. The Bland-Altman plots indicated that the reproducibility of data decreases as the aniount of physical activity reported each week increases The kappa coefficient for the categorized data was 0.62 (95% Cl: 0.48, 0.76). Conclusion: Overall. the results indicated low levels of repeatability for this measure of historical physical activity. Categorizing participants as active, insufficiently active, or sedentary provides a higher level of test-retest reliability.

Measurement of community beliefs about colorectal cancer

Few educational campaigns have focused on bowel cancer, though studies have indicated that members of the community need and want current information about relevant issues. In order to facilitate research in this area, reliable and valid measures of community attitudes are needed. Content validity of a survey instrument was obtained through use of a Delphi process with Directors of Education from the Australia Cancer Council and focus group discussions with informed members of the public. The subsequent survey of community perceptions about colorectal cancer included a broad range of content areas related to the risk of bowel cancer, preventing and coping with bowel cancer and beliefs about susceptibility and severity. The construct validity of these content areas was investigated by use of a factor analysis and confirmation of an association with related predictor variables. Two measures related to personal influence and anticipated coping responses showed favourable psychometric properties, including moderate to high levels of internal consistency and test-retest reliability. A test of the concurrent validity of these measures requires further development of instruments related to colorectal cancer or adaptation of measures from other areas of health research. (C) 2000 Elsevier Science Ltd. All rights reserved.