How reliably do rheumatologists measure shoulder movement?

Objective: To assess the intrarater and interrater reliability among rheumatologists of a standardised protocol for measurement of shoulder movements using a gravity inclinometer. Methods: After instruction, six rheurnatologists independently assessed eight movements of the shoulder, including total and glenohumeral flexion, total and glenohumeral abduction, external rotation in neutral and in abduction, internal rotation in abduction and hand behind back, in random order in six patients with shoulder pain and stiffness according to a 6x6 Latin square design using a standardised protocol. These assessments were then repeated. Analysis of variance was used to partition total variability into components of variance in order to calculate intraclass correlation coefficients (ICCs). Results: The intrarater and interrater reliability of different shoulder movements varied widely. The movement of hand behind back and total shoulder flexion yielded the highest ICC scores for both intrarater reliability (0.91 and 0.83, respectively) and interrater reliability (0.80 and 0.72, respectively). Low ICC scores were found for the movements of glenohumeral abduction, external rotation in abduction, and internal rotation in abduction (intrarater ICCs 0.35, 0.43, and 0.32, respectively), and external rotation in neutral, external rotation in abduction, and internal rotation in abduction (interrater ICCs 0.29, 0.11, and 0.06, respectively). Conclusions: The measurement of shoulder movements using a standardised protocol by rheumatologists produced variable intrarater and interrater reliability. Reasonable reliability was obtained only for the movement of hand behind back and total shoulder flexion.

Reliability of scores between stroke patients and significant others on the Reintegration to Normal Living (RNL) Index

Purpose: This study measured reliability between stroke patients' and significant others' scores on items on the Reintegration to Normal Living (RNL) Index and whether there were any scoring biases. Method The 11-item RNL Index was administered to 57 pairs of patients and significants six months after stroke rehabilitation. The index was scored using a 10-point visual analogue scale. Patient and significant other demographic information and data on patients' clinical, functional and cognitive status were collected. Reliability was measured using the intra-class correlation coefficient (ICC) and percent agreement. Results: Overall poor reliability was found for the RNL Index total score (ICC=.36, 95% CI. 07 to .59) and the daily functioning subscale (ICC=.24, 95% CI -.003 to .46) and moderate reliability was found for the perception of self subscale (ICC=.55, 95 % CI .28 to .73). There was a moderate bias for patients to rate themselves as achieving better reintegration than was indicated by significant others, although no demographic or clinical factors were associated with this bias. Exact match agreement was best for the subjective items and worse for items reflecting mobility around the community and participation in a work activity. Conclusions: Caution is needed when interpreting patient information reported by significant others on the RNL Index. The use of a shorter scale to rate the RNL Index requires investigation.

The reliability and validity of the Therapeutic activity index

Purpose To assess the psychometric properties of the Simplified Therapeutic Intervention Scoring System (TISS 28) scale. Materials and Methods A prospective observational design was used. Patients were recruited from a medical-surgical intensive care unit (ICU) and 4 rehabilitation wards of 2 university-affiliated hospitals in Hong Kong. Results Data necessary for the calculation of the TISS 28, the Therapeutic Intervention Scoring System (TISS 76), and severity of illness scoring system (Simplified Acute Physiology Score [SAPS II]) were recorded for each patient during the first 24 hours after his/her admission to an ICU. A significant positive correlation was found between the TISS 76 and the TISS 28 scores as well as the TISS 28 and the SAPS II scores. There was a significant difference between the TISS 28 scores among ICU patients and patients in rehabilitation wards. A significant correlation was found between the TISS 28 scores of the first and second set of TISS 28 scores. Conclusions Although the findings supported the validity and reliability of the TISS 28, there were limitations of the TISS 28 in measuring nursing workload in ICUs. Hence, continued amendment and validation of the TISS 28 on larger samples in different ICUs would be required so as to provide clinical nurses with a valid and reliable assessment of nursing workload.

The Coefficient of Variance as an index of L2 lexical processing skill

The Coefficient of Variance (mean standard deviation/mean Response time) is a measure of response time variability that corrects for differences in mean Response time (RT) (Segalowitz & Segalowitz, 1993). A positive correlation between decreasing mean RTs and CVs (rCV-RT) has been proposed as an indicator of L2 automaticity and more generally as an index of processing efficiency. The current study evaluates this claim by examining lexical decision performance by individuals from three levels of English proficiency (Intermediate ESL, Advanced ESL and L1 controls) on stimuli from four levels of item familiarity, as defined by frequency of occurrence. A three-phase model of skill development defined by changing rCV-RT.values was tested. Results showed that RTs and CVs systematically decreased as a function of increasing proficiency and frequency levels, with the rCV-RT serving as a stable indicator of individual differences in lexical decision performance. The rCV-RT and automaticity/restructuring account is discussed in light of the findings. The CV is also evaluated as a more general quantitative index of processing efficiency in the L2.

Between-year fluctuations in schizophrenia birth rate and associations with the Southern Oscillation Index, cloud cover and sunshine

Our group have recently proposed that low prenatal vitamin D may be a risk-modifying factor for schizophrenia. Climate variability impacts on vitamin D levels in a population via fluctuations in the amount of available UV radiation. In order to explore this hypothesis, we examined fluctuations in the birthrates for people with schizophrenia born between 1920 and 1967 and three sets of variables strongly associated with UV radiation. These included: (a) the Southern Oscillation Index (SOI), a marker of El Nino which is the most prominent meteorological factor that influences Queensland weather: (b) measures of cloud cover and (c) measures of sunshine. Schizophrenia births were extracted from the Queensland Mental Health register and corrected for background population birth rates. Schizophrenia birth rates had several apparently non-random features in common with the SO1. The prominent SO1 fluctuation event that occurred between 1937 and 1943 is congruent with the most prominent fluctuation in schizophrenia birth rates. The relatively flat profile of SOI activity between 1927 and 1936 also corresponds to the flattest period in the schizophrenia time series. Both time series have prominent oscillations in the 3 ~, year range between 1946 and 1960. Significant associations between schizophrenia birth rates and measures of both sunshine and cloud cover were identified,and all three time series shared periodicity in the 3-4 year range. The analyses suggest that the risk of schizophrenia is higher for those born during times of increased cloud cover,reduced sunshine and positive SO1. These ecological analyses provide initial support for the vitamin D hypothesis, however alternative non-genetic candidate exposures also need to be considered. Other sites with year-to-year fluctuations in cloud cover and sunshine should examine patterns of association between these climate variables and schizophrenia birth rates. The Stanley Foundation supported this project.

Long range forecasts of the numbers of Helicoverpa punctigera and H-armigera (Lepidoptera : Noctuidae) in Australia using the Southern Oscillation Index and the Sea Surface Temperature

The use of long-term forecasts of pest pressure is central to better pest management. We relate the Southern Oscillation Index (SOI) and the Sea Surface Temperature (SST) to long-term light-trap catches of the two key moth pests of Australian agriculture, Helicoverpa punctigera (Wallengren) and H. armigera (Hubner), at Narrabri, New South Wales over 11 years, and for H. punctigera only at Turretfield, South Australia over 22 years. At Narrabri, the size of the first spring generation of both species was significantly correlated with the SOI in certain months, sometimes up to 15 months before the date of trapping. Differences in the SOI and SST between significant months were used to build composite variables in multiple regressions which gave fitted values of the trap catches to less than 25% of the observed values. The regressions suggested that useful forecasts of both species could be made 6-15 months ahead. The influence of the two weather variables on trap catches of H. punctigera at Turretfield were not as strong as at Narrabri, probably because the SOI was not as strongly related to rainfall in southern Australia as it is in eastern Australia. The best fits were again given by multiple regressions with SOI plus SST variables, to within 40% of the observed values. The reliability of both variables as predictors of moth numbers may be limited by the lack of stability in the SOI-rainfall correlation over the historical record. As no other data set is available to test the regressions, they can only be tested by future use. The use of long-term forecasts in pest management is discussed, and preliminary analyses of other long sets of insect numbers suggest that the Southern Oscillation Index may be a useful predictor of insect numbers in other parts of the world.

Reliability of multiple frequency bioelectrical impedance analysis: An intermachine comparison

The technical reliability (i.e., interinstrument and interoperator reliability) of three SEAC-swept frequency bioimpedance monitors was assessed for both errors of measurement and associated analyses. In addition, intraoperator and intrainstrument variability was evaluated for repeat measures over a 4-hour period. The measured impedance values from a range of resistance-capacitance circuits were accurate to within 3% of theoretical values over a range of 50-800 ohms. Similarly, phase was measured over the range 1 degrees-19 degrees with a maximum deviation of 1.3 degrees from the theoretical value. The extrapolated impedance at zero frequency was equally well determined (+/-3%). However, the accuracy of the extrapolated value at infinite frequency was decreased, particularly at impedances below 50 ohms (approaching the lower limit of the measurement range of the instrument). The interinstrument/operator variation for whole body measurements were recorded on human volunteers with biases of less than +/-1% for measured impedance values and less than 3% for phase. The variation in the extrapolated values of impedance at zero and infinite frequencies included variations due to operator choice of the analysis parameters but was still less than +/-0.5%. (C) 1997 Wiley-Liss, Inc.

Dimensionality and clinical importance of pain and disability in hand osteoarthritis: Development of the Australian/Canadian (AUSCAN) Osteoarthritis Hand Index

Objective: To develop a reliable, valid, and responsive self-administered questionnaire to probe pain, stiffness and physical disability in patients with osteoarthritis (OA) of the hand. Design: In order to assess the dimensionality of the symptomatology of hand OA, a self-administered questionnaire was developed to probe various aspects of pain (10 items), stiffness (two items), and physical function (83 items). The question inventory was generated from eight existing health status measures and an interactive process involving four rheumatologists, two physiotherapists, and an orthopaedic surgeon. Results: Face-to-face interviews were conducted with 50 OA hand patients; 39 females and 11 males with mean age 62.8 years and mean disease duration 9.4 years. Items retained were those which fulfilled specified selection criteria: prevalence greater than or equal to60% and mean importance score approximating or exceeding 2.0 Item exclusion criteria included low prevalence, gender-based, ambiguous, duplicates or similarities, alternatives, composite items, and items that were too restrictive. This process resulted in five pain, one stiffness and nine function items which have been proposed for incorporation in the AUSCAN Index. Conclusions: Using a traditional development strategy, we have constructed a self-administered multi-dimensional outcome measure for assessing hand OA. The next stage includes reliability, validity and responsiveness testing of the 15-item questionnaire. (C) 2002 OsteoArthritis Research Society Intenational. Published by Elsevier Science Ltd. All rights reserved.

Further evidence for the agreement between patients with stroke and their proxies on the Frenchay Activities Index

Objective: To determine item, subscale and total score agreement on the Frenchay Activities Index (FAI) between stroke patients and proxies six months after discharge from rehabilitation. Design: Prospective study design. Setting/subjects: Fifty patient-proxy pairs, interviewed separately, in the patient's residence. Main outcome measures: Modified FAI using 13 items. Individual FAI items, subscales and total score agreement as measured by weighted kappa and intraclass correlation coefficients (ICC). Results: Excellent agreement was found for the total FAI (ICC 0.87, 95% confidence interval (CI) 0.78-0.93), and domestic (ICC 0.85, 95% CI 0.73-0.91) and outdoor (ICC 0.87, 95% CI 0.78-0.95) subscales, with moderate agreement found for the work/leisure subscale (ICC 0.63, 95% CI 0.34-0.78). For the individual FAI items, good, moderate, fair and poor agreement was found for five, three, four and one item, respectively. The best agreement was for objective items of preparing meals, washing-up, washing clothes, shopping and driving. The poorest agreement was for participation in hobbies, social outings and heavy housework. Scoring biases associated with patient or proxy demographic characteristics were found. Female proxies, and those who were spouses, scored patients lower on domestic activities; male patients, and those who were younger, scored themselves higher on outdoor activities and higher patient FIM scores were positively correlated with higher FAI scores. Conclusions: While total and subscale agreement on the FAI was high, individual item agreement varied. Proxy scores should be used with caution due to bias.

On measuring quality of a probabilistic commodity forecast for a system that incorporates seasonal climate forecasts

Regional commodity forecasts are being used increasingly in agricultural industries to enhance their risk management and decision-making processes. These commodity forecasts are probabilistic in nature and are often integrated with a seasonal climate forecast system. The climate forecast system is based on a subset of analogue years drawn from the full climatological distribution. In this study we sought to measure forecast quality for such an integrated system. We investigated the quality of a commodity (i.e. wheat and sugar) forecast based on a subset of analogue years in relation to a standard reference forecast based on the full climatological set. We derived three key dimensions of forecast quality for such probabilistic forecasts: reliability, distribution shift, and change in dispersion. A measure of reliability was required to ensure no bias in the forecast distribution. This was assessed via the slope of the reliability plot, which was derived from examination of probability levels of forecasts and associated frequencies of realizations. The other two dimensions related to changes in features of the forecast distribution relative to the reference distribution. The relationship of 13 published accuracy/skill measures to these dimensions of forecast quality was assessed using principal component analysis in case studies of commodity forecasting using seasonal climate forecasting for the wheat and sugar industries in Australia. There were two orthogonal dimensions of forecast quality: one associated with distribution shift relative to the reference distribution and the other associated with relative distribution dispersion. Although the conventional quality measures aligned with these dimensions, none measured both adequately. We conclude that a multi-dimensional approach to assessment of forecast quality is required and that simple measures of reliability, distribution shift, and change in dispersion provide a means for such assessment. The analysis presented was also relevant to measuring quality of probabilistic seasonal climate forecasting systems. The importance of retaining a focus on the probabilistic nature of the forecast and avoiding simplifying, but erroneous, distortions was discussed in relation to applying this new forecast quality assessment paradigm to seasonal climate forecasts. Copyright (K) 2003 Royal Meteorological Society.

The comprehensive osteoarthritis test: a simple index for measurement of treatment effects in clinical trials

Objective. To assess the measurement properties of a simple index of symptom severity in osteoarthritis (OA) of the hips and knees. Methods. Both the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) and the proposed new Comprehensive Osteoarthritis Test (COAT) instrument were completed weekly by 125 subjects in the context of a randomized, 12-week, 3 parallel-arm clinical trial. The reliabilities of the various scales were assessed on a weekly basis by use of Cronbach's alpha coefficients. The validity of the COAT total scale was assessed by correlation with the WOMAC total scale on a weekly basis with correlation coefficients, and in terms of the correlations between subject-level intercepts and slopes over time. The relative responsiveness of the WOMAC and COAT total scales was assessed using a multilevel (longitudinal) multivariate (WOMAC, COAT) linear model. Results. The WOMAC and COAT total scales were highly reliable (mean over weeks: WOMAC alpha = 0.98; COAT alpha = 0.97). The correlations between the WOMAC and COAT scales were very high (mean over weeks = 0.92; subject-level intercepts = 0.91, slopes = 0.88). The COAT total scale was significantly more responsive than the WOMAC total scale in the active treatment (34.8% improvement vs 26.8%; p = 0.002). Conclusion. The COAT total scale is simple to administer, reliable, valid, and responsive to treatment effects.

Three putative types of El Nino revealed by spatial variability in impact on Australian wheat yield

The El Nino-Southern Oscillation (ENSO) phenomenon significantly impacts rainfall and ensuing crop yields in many parts of the world. In Australia, El Nino events are often associated with severe drought conditions. However, El Nino events differ spatially and temporally in their manifestations and impacts, reducing the relevance of ENSO-based seasonal forecasts. In this analysis, three putative types of El Nino are identified among the 24 occurrences since the beginning of the twentieth century. The three types are based on coherent spatial patterns (footprints) found in the El Nino impact on Australian wheat yield. This bioindicator reveals aligned spatial patterns in rainfall anomalies, indicating linkage to atmospheric drivers. Analysis of the associated ocean-atmosphere dynamics identifies three types of El Nino differing in the timing of onset and location of major ocean temperature and atmospheric pressure anomalies. Potential causal mechanisms associated with these differences in anomaly patterns need to be investigated further using the increasing capabilities of general circulation models. Any improved predictability would be extremely valuable in forecasting effects of individual El Nino events on agricultural systems.

Validating the functional capacity index: A comparison of predicted versus observed total body scores

Background: The Functional Capacity Index (FCI) was designed to predict physical function 12 months after injury. We report a validation study of the FCI. Methods: This was a consecutive case series registered in the Queensland Trauma Registry who consented to the prospective 12-month telephone-administered follow-up study. FCI scores measured at 12 months were compared with those originally predicted. Results: Complete Abbreviated Injury Scale score information was available for 617 individuals, of whom 587 (95%) could be assigned at least one FCI score (range, 1-17). Agreement between the largest predicted FCI and observed FCI score was poor (kappa = 0.05; 95% confidence interval, 0.00-0.10) and explained only 1% of the variability in observed FCI. Using an encompassing model that included all FCI assignments, agreement remained poor (kappa = 0.05; 95% confidence interval, -0.02-0.12), and the model explained only 9% of the variability in observed FCI. Conclusion: The predicted functional capacity poorly agrees with actual functional outcomes. Further research should consider including other (noninjury) explanatory factors in predicting FCI at 12 months.

Appraising the quality of randomized controlled trials: inter-rater reliability for the OTseeker evidence database

Rationale and aims 'OTseeker' is an online database of randomized controlled trials (RCTs) and systematic reviews relevant to occupational therapy. RCTs are critically appraised and rated for quality using the 'PEDro' scale. We aimed to investigate the inter-rater reliability of the PEDro scale before and after revising rating guidelines. Methods In study 1, five raters scored 100 RCTs using the original PEDro scale guidelines. In study 2, two raters scored 40 different RCTs using revised guidelines. All RCTs were randomly selected from the OTseeker database. Reliability was calculated using Kappa and intraclass correlation coefficients [ICC (model 2,1)]. Results Inter-rater reliability was 'good to excellent' in the first study (Kappas >= 0.53; ICCs >= 0.71). After revising the rating guidelines, the reliability levels were equivalent or higher to those previously obtained (Kappas >= 0.53; ICCs >= 0.89), except for the item, 'groups similar at baseline', which still had moderate reliability (Kappa = 0.53). In study 2, two PEDro scale items, which had their definitions revised, 'less than 15% dropout' and 'point measures and variability', showed higher reliability. In both studies, the PEDro items with the lowest reliability were 'groups similar at baseline' (Kappas = 0.53), 'less than 15% dropout' (Kappas