The diagnostic reliability of Internet-based observational kinematic gait analysis

We investigated the accuracy and reliability of observational kinematic gait assessments performed via a low-bandwidth Internet link (118 kbit/s) and a higher-speed Internet link (128 kbit/s). Twenty-four subjects were randomized to either bandwidth group. Gait was assessed with the Gait Assessment Rating Scale (GARS) in the traditional manner, which is from video-recordings, and with repeated measurements via the online method. Online assessment was found to provide as accurate a measure of gait performance as the traditional assessment (limits of agreement

The List of Social Situation Problems: Reliability and validity in an adolescent Spanish-speaking sample

The aim of this study was to analyze the psychometric properties of the Spanish translation of the List of Social Situation Problems (LSSP; S. H. Spence, 1980). The questionnaire was administered to a sample of 388 adolescents between the ages of 12 and 18. Exploratory factor analysis identified four factors: Social Anxiety, Adult Oppositional, Assertiveness, and Making Friends, which accounted for 26.64% of the variance. Internal consistency of the total scale was high (alpha = .86). Correlations between the LSSP and two self-report measures of social anxiety, the Questionnaire about Interpersonal Difficulties for Adolescents (r = .45) and the Social Phobia and Anxiety Inventory (r = .48), were statistically significant. A significant difference was found between LSSP total scores for adolescents with and without social anxiety (d = 1.14), supporting the construct validity of the scale.

Reliability measures for local nodes assessment in classification trees

Most of the modem developments with classification trees are aimed at improving their predictive capacity. This article considers a curiously neglected aspect of classification trees, namely the reliability of predictions that come from a given classification tree. In the sense that a node of a tree represents a point in the predictor space in the limit, the aim of this article is the development of localized assessment of the reliability of prediction rules. A classification tree may be used either to provide a probability forecast, where for each node the membership probabilities for each class constitutes the prediction, or a true classification where each new observation is predictively assigned to a unique class. Correspondingly, two types of reliability measure will be derived-namely, prediction reliability and classification reliability. We use bootstrapping methods as the main tool to construct these measures. We also provide a suite of graphical displays by which they may be easily appreciated. In addition to providing some estimate of the reliability of specific forecasts of each type, these measures can also be used to guide future data collection to improve the effectiveness of the tree model. The motivating example we give has a binary response, namely the presence or absence of a species of Eucalypt, Eucalyptus cloeziana, at a given sampling location in response to a suite of environmental covariates, (although the methods are not restricted to binary response data).

Optimal reliability improvement for used items sold with warranty

The market for used products is becoming more competitive and dealers of used products use warranty to promote sales as well as to provide assurnace to customers. Offering warranty results in additional costs associated with warranty servicing. This cost can be reduced through actions such as overhaul and upgrade that improves the reliability of the item. This is worthwhile only if the cost of improvement is less than the reduction in the warranty servicing cost. This paper deals with two models to decide on the reliability improvement strategies for used items sold with FRW policy.

Reliability of the Knee Examination in Osteoarthritis: Effect of Standardization

Objective. To assess the reliability of physical examination of the osteoarthritic (OA) knee by rheumatologists, and to evaluate the benefits of standardization. Methods. Forty-two physical signs and techniques were evaluated using a 6 X 6 Latin square design. Patients with mild to severe knee OA, based on physical and radiographic signs, were examined in random order prior to and following standardization of techniques. For those signs with dichotomous scales, agreement among the rheumatologists was calculated as the prevalence-adjusted bias-adjusted kappa (PABAK), while for the signs with continuous and ordinal scales, a reliability coefficient (R-c) was calculated using analysis of variance. A PABAK of >0.60 and an Re of >0.80 were considered to indicate adequate reliability. Results. Adequate poststandardization reliability was achieved for 30 of 42 physical signs/techniques (71%). The most highly reliable signs identified by physical examination of the OA knee included alignment by goniometer (R-c = 0.99), bony swelling (R-c = 0.97), general passive crepitus (R-c = 0.96), gait by inspection (PABAK = 0.78), effusion bulge sign (R-c = 0.97), quadriceps atrophy (R. = 0.97), medial tibiofemoral tenderness (R-c = 0.94), lateral tibiofemoral tenderness (R-c = 0.85), patellofemoral tenderness by grind test (R-c = 0.94), and flexion contracture (R-c = 0.95). The standardization process resulted in substantial improvements in reliability for evaluation of a number of physical signs, although for some signs, minimal or no effect of standardization was noted. After standardization, warmth (PABAK = 0.14), medial instability at 30degrees flexion (PABAK = 0.02), and lateral instability at 30degrees flexion (PABAK = 0.34) were the only 3 signs that were highly unreliable. Conclusion. With the exception of physical examinations for instability, a comprehensive knee examination can be performed with adequate reliability. Standardization further improves the reliability for some physical signs and techniques. The application of these findings to future OA studies will contribute to improved outcome assessments in OA.

Test-retest reliability of four physical activity measures used in population surveys

Accurate monitoring of prevalence and trends in population levels of physical activity (PA) is a fundamental public health need. Test-retest reliability (repeatability) was assessed in population samples for four self-report PA measures: the Active Australia survey (AA, N=356), the short International Physical Activity Questionnaire (IPAQ, N=104), the physical activity items in the Behavioral Risk Factor Surveillance System (BRFSS, N=127) and in the Australian National Health Survey (NHS, N=122). Percent agreement and Kappa statistics were used to assess reliability of classification of activity status as 'active', 'insufficiently active' or 'sedentary'. Intraclass correlations (ICCs) were used to assess agreement on minutes of activity reported for each item of each survey and for total minutes. Percent agreement scores for activity status were very good on all four instruments, ranging from 60% for the NHS to 79% for the IPAQ. Corresponding Kappa statistics ranged from 0.40 (NHS) to 0.52 (AA). For individual items, ICCs were highest for walking (0.45 to 0.78) and vigorous activity (0.22 to 0.64) and lowest for the moderate questions (0.16 to 0.44). All four measures provide acceptable levels of test-retest reliability for assessing both activity status and sedentariness, and moderate reliability for assessing total minutes of activity.

Random error in willingness to pay measurement: A multiple indicators, latent variable approach to the reliability of contingent values

The reliability of measurement refers to unsystematic error in observed responses. Investigations of the prevalence of random error in stated estimates of willingness to pay (WTP) are important to an understanding of why tests of validity in CV can fail. However, published reliability studies have tended to adopt empirical methods that have practical and conceptual limitations when applied to WTP responses. This contention is supported in a review of contingent valuation reliability studies that demonstrate important limitations of existing approaches to WTP reliability. It is argued that empirical assessments of the reliability of contingent values may be better dealt with by using multiple indicators to measure the latent WTP distribution. This latent variable approach is demonstrated with data obtained from a WTP study for stormwater pollution abatement. Attitude variables were employed as a way of assessing the reliability of open-ended WTP (with benchmarked payment cards) for stormwater pollution abatement. The results indicated that participants' decisions to pay were reliably measured, but not the magnitude of the WTP bids. This finding highlights the need to better discern what is actually being measured in VVTP studies, (C) 2003 Elsevier B.V. All rights reserved.

Papillary urothelial neoplasm of low malignant potential: reliability of diagnosis and outcome

OBJECTIVE To determine the ability of pathologists to reproducibly diagnose a newly defined lesion, i.e. the papillary urothelial neoplasm of low malignant potential (PUNLMP) using the published criteria, defined by the 1998 World Health Organisation/International Society of Urological Pathology (WHO/ISUP) classification system; in addition, debate remains about the clinical behaviour of these lesions, thus the rates of recurrence and progression of PUNLMP lesions were assessed and compared with low-grade papillary urothelial carcinomas (LG-PUC) and high-grade (HG-PUC) over a 10-year follow-up. PATIENTS AND METHODS Forty-nine cases of superficial bladder cancer (G1-3 pTa) representing an initial diagnosis of transitional cell carcinoma made in 1990 were identified and re-graded using the 1998 WHO/ISUP classification by two pathologists. Inter-observer agreement was assessed using Cohen weighted kappa statistics. After reclassification the clinical follow-up was reviewed retrospectively, and episodes of recurrence and progression recorded. RESULTS The inter-observer agreement was moderate, regardless of whether one (kappa 0.45) or two (kappa 0.60) pathologists were used to grade these lesions. Re-classification identified 12 PUNLMP, 28 LG-PUC and nine HG-PUC. PUNLMP lesions recurred in 25% (3/12) of cases; no progression was documented. Recurrence rates were 75% (21/28) and 67% (6/9) for LG- and HG-PUC, respectively, and progression rates were 4% (1/28) and 22% (2/9). CONCLUSION The 1998 WHO/ISUP classification of urothelial neoplasms can be reproducibly applied by pathologists, with a moderate level of agreement. There is evidence that PUNLMP lesions have a more indolent clinical behaviour than urothelial carcinomas. However, the risk of recurrence and progression remains, and clinical monitoring of these patients is important.

Behaviour state analysis in Rett syndrome: Continuous data reliability measurement

Awareness of optimal behaviour states of children with profound intellectual disability has been reported in the literature as a potentially useful tool for planning intervention within this population. Some arguments have been raised, however, which question the reliability and validity of previously published work on behaviour state analysis. This article sheds light on the debate by presenting two stages of a study of behaviour state analysis for eight girls with Rett syndrome. The results support Mudford, Hogg, and Roberts' (1997, 1999) concerns with the pooling of participant data. The results of Stage 2 also suggest, however, that most categories of behaviour state can be reliably distinguished once definitions of behaviours for each state are clearly defined.

The concurrent validity and test-retest reliability of a visuospatial working memory task

To determine whether the visuospatial n-back working memory task is a reliable and valid measure of cognitive processes believed to underlie intelligence, this study compared the reaction times and accuracy of perforniance of 70 participants, with performance on the Multidimensional Aptitude Battery (MAB). Testing was conducted over two sessions separated by 1 week. Participants completed the MAB during the second test session. Moderate testretest reliability for percentage accuracy scores was found across the four levels of the n-back task, whilst reaction times were highly reliable. Furthermore, participants' performance on the MAB was negatively correlated with accuracy of performance at the easier levels of the n-back task and positively correlated with accuracy of performance at the harder task levels. These findings confirm previous research examining the cognitive basis of intelligence, and suggest that intelligence is the product of faster speed of information processing, as well as superior working memory capacity. (C) 2004 Elsevier Inc. All rights reserved.

The HIPASS catalogue - II. Completeness reliability and parameter accuracy

The H I Parkes All Sky Survey (HIPASS) is a blind extragalactic H I 21-cm emission-line survey covering the whole southern sky from declination -90degrees to +25degrees. The HIPASS catalogue (HICAT), containing 4315 H I-selected galaxies from the region south of declination +2degrees, is presented in Meyer et al. (Paper I). This paper describes in detail the completeness and reliability of HICAT, which are calculated from the recovery rate of synthetic sources and follow-up observations, respectively. HICAT is found to be 99 per cent complete at a peak flux of 84 mJy and an integrated flux of 9.4 Jy km. s(-1). The overall reliability is 95 per cent, but rises to 99 per cent for sources with peak fluxes >58 mJy or integrated flux >8.2 Jy km s(-1). Expressions are derived for the uncertainties on the most important HICAT parameters: peak flux, integrated flux, velocity width and recessional velocity. The errors on HICAT parameters are dominated by the noise in the HIPASS data, rather than by the parametrization procedure.