Reliability of the Knee Examination in Osteoarthritis: Effect of Standardization

Objective. To assess the reliability of physical examination of the osteoarthritic (OA) knee by rheumatologists, and to evaluate the benefits of standardization. Methods. Forty-two physical signs and techniques were evaluated using a 6 X 6 Latin square design. Patients with mild to severe knee OA, based on physical and radiographic signs, were examined in random order prior to and following standardization of techniques. For those signs with dichotomous scales, agreement among the rheumatologists was calculated as the prevalence-adjusted bias-adjusted kappa (PABAK), while for the signs with continuous and ordinal scales, a reliability coefficient (R-c) was calculated using analysis of variance. A PABAK of >0.60 and an Re of >0.80 were considered to indicate adequate reliability. Results. Adequate poststandardization reliability was achieved for 30 of 42 physical signs/techniques (71%). The most highly reliable signs identified by physical examination of the OA knee included alignment by goniometer (R-c = 0.99), bony swelling (R-c = 0.97), general passive crepitus (R-c = 0.96), gait by inspection (PABAK = 0.78), effusion bulge sign (R-c = 0.97), quadriceps atrophy (R. = 0.97), medial tibiofemoral tenderness (R-c = 0.94), lateral tibiofemoral tenderness (R-c = 0.85), patellofemoral tenderness by grind test (R-c = 0.94), and flexion contracture (R-c = 0.95). The standardization process resulted in substantial improvements in reliability for evaluation of a number of physical signs, although for some signs, minimal or no effect of standardization was noted. After standardization, warmth (PABAK = 0.14), medial instability at 30degrees flexion (PABAK = 0.02), and lateral instability at 30degrees flexion (PABAK = 0.34) were the only 3 signs that were highly unreliable. Conclusion. With the exception of physical examinations for instability, a comprehensive knee examination can be performed with adequate reliability. Standardization further improves the reliability for some physical signs and techniques. The application of these findings to future OA studies will contribute to improved outcome assessments in OA.

A hybrid probabilistic criterion for market-based transmission expansion planning

Market-based transmission expansion planning gives information to investors on where is the most cost efficient place to invest and brings benefits to those who invest in this grid. However, both market issue and power system adequacy problems are system planers’ concern. In this paper, a hybrid probabilistic criterion of Expected Economical Loss (EEL) is proposed as an index to evaluate the systems’ overall expected economical losses during system operation in a competitive market. It stands on both investors’ and planner’s point of view and will further improves the traditional reliability cost. By applying EEL, it is possible for system planners to obtain a clear idea regarding the transmission network’s bottleneck and the amount of losses arises from this weak point. Sequentially, it enables planners to assess the worth of providing reliable services. Also, the EEL will contain valuable information for moneymen to undertake their investment. This index could truly reflect the random behaviors of power systems and uncertainties from electricity market. The performance of the EEL index is enhanced by applying Normalized Coefficient of Probability (NCP), so it can be utilized in large real power systems. A numerical example is carried out on IEEE Reliability Test System (RTS), which will show how the EEL can predict the current system bottleneck under future operational conditions and how to use EEL as one of planning objectives to determine future optimal plans. A well-known simulation method, Monte Carlo simulation, is employed to achieve the probabilistic characteristic of electricity market and Genetic Algorithms (GAs) is used as a multi-objective optimization tool.

The development and evaluation of an incontinence screening questionnaire for female primary care

Although there is a high prevalence of leaking urine among Australian women, there are currently no standardized procedures for screening patients for incontinence in the primary care setting (known in Australia as general practice). In response to this, an incontinence screening questionnaire (ISQ) was developed and evaluated for use in general practice. Eighty-nine women completed an original compilation of 33 items that asked about situations associated with leaking urine, avoidance of leakage, and concern about leakage. Each item was assessed according to its acceptability for the population of female general practice patients, discriminative value, and test-retest reliability. These patients also underwent an objective test of incontinence, the 48-hour pad test, so that the screening items could be validated against an objective classification of incontinence. The study included women who had bladder control problems and those who did not. Eight items on the ISQ were shown to be acceptable to patients, discriminative, reliable, and valid indicators of objective incontinence. Five items were capable of predicting almost 70% of patients who showed objective leakage of urine and misclassified fewer than 15% of these patients. Those five items were selected for inclusion in the (refined) ISQ. (C) 2000 Wiley-Liss, Inc.

Adolescents' perceptions of social status: Development and evaluation of a new indicator

Objective. Eliminating health disparities, including those that are a result of socioeconomic status (SES), is one of the overarching goals of Healthy People 2010. This article reports on the development of a new, adolescent-specific measure of subjective social status (SSS) and on initial exploratory analyses of the relationship of SSS to adolescents' physical and psychological health. Methods. A cross-sectional study of 10 843 adolescents and a subsample of 166 paired adolescent/mother dyads who participated in the Growing Up Today Study was conducted. The newly developed MacArthur Scale of Subjective Social Status (10-point scale) was used to measure SSS. Paternal education was the measure of SES. Indicators of psychological and physical health included depressive symptoms and obesity, respectively. Linear regression analyses determined the association of SSS to depressive symptoms, and logistic regression determined the association of SSS to overweight and obesity, controlling for sociodemographic factors and SES. Results. Mean society ladder ranking, a subjective measure of SES, was 7.2 ± 1.3. Mean community ladder ranking, a measure of perceived placement in the school community, was 7.6 ± 1.7. Reliability of the instrument was excellent: the intraclass correlation coefficient was 0.73 for the society ladder and 0.79 for the community ladder. Adolescents had higher society ladder rankings than their mothers (µteen = 7.2 ± 1.3 vs µmom = 6.8 ± 1.2; P = .002). Older adolescents' perceptions of familial placement in society were more closely correlated with maternal subjective perceptions of placement than those of younger adolescents (Spearman's rhoteens

Psychometric evaluation of the Early/Late Preferences Scale

This paper examines the psychometric quality of the Early/Late Preferences Scale (PS) relative to that of the Composite Morningness Scale (CS). Questionnaires were completed by 670 undergraduate students aged 16-37 years (mean 22.5), of whom 64% were female. Both scales displayed satisfactory inter-item correlations and similar total mean scores to those reported previously, although the CS had higher variability. Principal axis factor analysis produced single-factor solutions for both scales, although loadings for Items 7 and 9 on the PS were low. Internal consistencies for both scales were good (PS=0.86, CS=0.90) with only a small improvement achieved by deleting Items 7 and 9 from the PS. Test-retest reliability over 11 weeks was good for both scales (PS=0.92, CS=0.89). Differences between morning, evening and intermediate groups in self-rated alertness at different times of day, and significant correlations with other indices of morning-evening orientation, provided evidence of validity for both scales. These results indicate that PS is psychometrically comparable with CS. In view of its simpler format and lower cultural specificity, PS may be considered a preferable measure for most applications.

Expert review of an approach to functional capacity evaluation

Functional capacity evaluation (FCE) is a widely used tool in work rehabilitation, despite the limited examination of the soundness of its measurement properties. This paper outlines the development of a new approach to FCE, the GAPP FCE, and reports on the findings of an expert review of aspects of its content validity and technical adequacy and how it meets established test criteria. Five expert occupational therapists reviewed the materials of the GAPP FCE then completed a questionnaire related to the content validity, technical adequacy and safety, reliability, validity, practicality and utility of the GAPP FCE. The experts gave support to most aspects of these criteria. The main issue identified by the review was related to interpretation and extrapolation of the FCE results for return to work. This and other issues are discussed in relation to recent developments in FCE and plans for future development of the GAPP FCE.

Extensive multiple test centre evaluation of the VecTest malaria antigen panel assay

To determine which species and populations of Anopheles transmit malaria in any given situation, immunological assays for malaria sporozoite antigen can replace traditional microscopical examination of freshly dissected Anopheles. We developed a wicking assay for use with mosquitoes that identifies the presence or absence of specific peptide epitopes of circumsporozoite (CS) protein of Plasmodium falciparum and two strains of Plasmodium vivax (variants 210 and 247). The resulting assay (VecTest(TM) Malaria) is a rapid, one-step procedure using a 'dipstick' test strip capable of detecting and distinguishing between P. falciparum and P. vivax infections in mosquitoes. The objective of the present study was to test the efficacy, sensitivity, stability and field-user acceptability of this wicking dipstick assay. In collaboration with 16 test centres world-wide, we evaluated more than 40 000 units of this assay, comparing it to the standard CS ELISA. The 'VecTest(TM) Malaria' was found to show 92% sensitivity and 98.1% specificity, with 97.8% accuracy overall. In accelerated storage tests, the dipsticks remained stable for >15 weeks in dry conditions up to 45degreesC and in humid conditions up to 37degreesC. Evidently, this quick and easy dipstick test performs at an acceptable level of reliability and offers practical advantages for field workers needing to make rapid surveys of malaria vectors.

The reliability of video based time motion analysis

Time motion analysis is extensively used to assess the demands of team sports. At present there is only limited information on the reliability of measurements using this analysis tool. The aim of this study was to establish the reliability of an individual observer's time motion analysis of rugby union. Ten elite level rugby players were individually tracked in Southern Hemisphere Super 12 matches using a digital video camera. The video footage was subsequently analysed by a single researcher on two occasions one month apart. The test-retest reliability was quantified as the typical error of measurement (TEM) and rated as either good (10% TEM). The total time spent in the individual movements of walking, jogging, striding, sprinting, static exertion and being stationary had moderate to poor reliability (5.8-11.1% TEM). The frequency of individual movements had good to poor reliability (4.3-13.6% TEM), while the mean duration of individual movements had moderate reliability (7.1-9.3% TEM). For the individual observer in the present investigation, time motion analysis was shown to be moderately reliable as an evaluation tool for examining the movement patterns of players in competitive rugby. These reliability values should be considered when assessing the movement patterns of rugby players within competition.

Reliability of scores between stroke patients and significant others on the Reintegration to Normal Living (RNL) Index

Purpose: This study measured reliability between stroke patients' and significant others' scores on items on the Reintegration to Normal Living (RNL) Index and whether there were any scoring biases. Method The 11-item RNL Index was administered to 57 pairs of patients and significants six months after stroke rehabilitation. The index was scored using a 10-point visual analogue scale. Patient and significant other demographic information and data on patients' clinical, functional and cognitive status were collected. Reliability was measured using the intra-class correlation coefficient (ICC) and percent agreement. Results: Overall poor reliability was found for the RNL Index total score (ICC=.36, 95% CI. 07 to .59) and the daily functioning subscale (ICC=.24, 95% CI -.003 to .46) and moderate reliability was found for the perception of self subscale (ICC=.55, 95 % CI .28 to .73). There was a moderate bias for patients to rate themselves as achieving better reintegration than was indicated by significant others, although no demographic or clinical factors were associated with this bias. Exact match agreement was best for the subjective items and worse for items reflecting mobility around the community and participation in a work activity. Conclusions: Caution is needed when interpreting patient information reported by significant others on the RNL Index. The use of a shorter scale to rate the RNL Index requires investigation.

Reliability of electromyographic and torque measures during isometric axial rotation exertions of the trunk

Objective: The aim of the present study was to investigate the between-days reliability of electromyographic (EMG) measurement of 6 bilateral trunk muscles and also the torque output in 3 planes during isometric right and left axial rotation at different exertion levels. Methods: Ten healthy subjects performed isometric right and left axial rotation at 100, 70, 50 and 30% maximum voluntary contractions in two testing sessions at least 7 days apart. EMG amplitude and frequency analyses of the recorded surface EMG signals were performed for rectus abdominis, external oblique, internal oblique, latissimus dorsi, iliocostalis lumborum and multifidus bilaterally. The primary torque in the transverse plane and the coupling torques in sagittal and coronal planes were measured. Results: For both EMG amplitude and frequency values, good (intraclass correlation coefficient, ICC = 0.75-0.89) to excellent (ICC greater than or equal to 0.90) reliability was found in the 6 trunk muscles at different exertion levels during axial rotation. The reliability of both maximal isometric axial rotation torque and coupling torques in sagittal and coronal planes were found to be excellent (ICC greater than or equal to 0.93). Conclusions: Good to excellent reliability of EMG measures of trunk muscles and torque measurements during isometric axial rotation was demonstrated. This provides further confidence of using EMG and triaxial torque assessment as outcome measures in rehabilitation and in the evaluation of the human performance in the work place. (C) 2003 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Spatio-temporal evaluation of neck muscle activation during postural perturbations in healthy subjects

The purpose of this study was to examine the spatio-temporal activation of the sternocleidomastoid (SCM) and cervical extensor (CE) muscles with respect to the deltoid muscle onset during rapid voluntary upper limb movement in healthy volunteers. The repeatability and reliability of the spatio-temporal aspects of the myoelectric signals were also examined. Ten subjects performed bilateral and unilateral rapid upper limb flexion, abduction and extension in response to a visual stimulus. EMG onsets and normalised root mean square (nRMS) values were calculated for the SCM and CE muscles. Subjects attended three testing sessions over non-consecutive days allowing the repeatability and reliability of these measures to be assessed. The SCM and CE muscles demonstrated feed-forward activation (activation within 50 ms of deltoid onset) during rapid arm movements in all directions. The sequence and magnitude of neck muscle activation displayed directional specificity, however, the neck flexor and extensor muscles displayed co-activation during all perturbations. EMG onsets demonstrated high repeatability in terms of repeated measure precision (nSEM in the range 1.9-5.7%). This was less evident for the repeatability of nRMS values. The results of this study provide a greater understanding of cervical neuromotor control strategies. During bilateral and unilateral upper limb perturbations, the SCM and CE muscles demonstrate feed-forward co-activation. It seems apparent that feed-forward activation of neck muscles is a mechanism necessary to achieve stability for the visual and vestibular systems, whilst ensuring stabilisation and protection of the cervical spine. (C) 2004 Elsevier Ltd. All rights reserved.

Screening for physical activity in family practice - Evaluation of two brief assessment tools

Background: Physical activity (PA) is relevant to the prevention and management of many health conditions in family practice. There is a need for an efficient, reliable, and valid assessment tool to identify patients in need of PA interventions. Methods: Twenty-eight family physicians in three Australian cities assessed the PA of their adult patients during 2004 using either a two- (2Q) or three-question (3Q) assessment. This was administered again approximately 3 days later to evaluate test-retest reliability. Concurrent validity was evaluated by measuring agreement with the Active Australia Questionnaire, and criterion validity by comparison with 7-day Computer Science Applications, Inc. (CSA) accelerometer counts. Results: A total of 509 patients participated, with 428 (84%) completing a repeat assessment, and 415 (82%) accelerometer monitoring. The brief assessments had moderate test-retest reliability (2Q k = 58.0%, 95% confidence interval [CI] = 47.2-68.8%; 3Q k = 55.6%, 95% CI = 43.8-67.4%); fair to moderate concurrent validity (2Q k = 46.7%, 95% CI = 35.657.9%; 3Q k = 38.7%, 95% CI = 26.4-51.1%); and poor to fair criterion validity (2Q k = 18.2%, 95% CI = 3.9-32.6%; 3Q k = 24.3%, 95% CI = 11.6-36.9%) for identifying patients as sufficiently active. A four-level scale of PA derived from the PA assessments was significantly correlated with accelerometer minutes (2Q rho = 0.39, 95% CI = 0.28-0.49; 3Q rho = 0.31, 95% CI = 0.18-0.43). Physicians reported that the assessments took I to 2 minutes to complete. Conclusions: Both PA assessments were feasible to use in family practice, and were suitable for identifying the least active patients. The 2Q assessment was preferred by clinicians and may be most appropriate for dissemination.

Functional capacity evaluation as a performance measure - Evidence for a new approach for clients with chronic back pain

Objectives: To report the research and development of a new approach to Functional Capacity Evaluation, the Gibson Approach to Functional Capacity Evaluation (GAPP FCE) for chronic back pain clients. Methods: Four Studies, including pilot and feasibility testing, expert review, and preliminary interrater reliability examination, are described here. Participants included 7 healthy young adults and 19 rehabilitation clients with back pain who underwent assessment using the GAPP FCE. Thirteen therapists were trained in the approach and were silently observed administering the Functional Capacity Evalutions by at least 1 other trained therapists or the first investigator Or both. An expert review using 5 expert occupational therapists was also conducted. Results: Study 1, the pilot with healthy individuals, indicated that the GAPP FCE was a feasible approach with good utility. Study 2, a pilot using 2 trained therapists assessing 5 back pain clients, supported the clinical feasibility of the approach. The expert review in Study 3 found support for GAPP FCE. Study 4, a trial of the approach with 14 rehabilitation clients, found support for the interrater reliability of recommendations for return to work based on performance in the GAPP FCE. Discussion: The evidence thus far available supports the GAPP FCE as ail approach that provides a Sound method for evaluating the performance of the physical demands of work with clients with chronic back pain. The tool has been shown to have good face and content validity, to meet acceptable test standards, and to have reasonable interrater reliability. Further research is occurring to look at a larger interrater reliability study, to further examine content validity, and to examine predictive validity.