Appraising the quality of randomized controlled trials: inter-rater reliability for the OTseeker evidence database

Rationale and aims 'OTseeker' is an online database of randomized controlled trials (RCTs) and systematic reviews relevant to occupational therapy. RCTs are critically appraised and rated for quality using the 'PEDro' scale. We aimed to investigate the inter-rater reliability of the PEDro scale before and after revising rating guidelines. Methods In study 1, five raters scored 100 RCTs using the original PEDro scale guidelines. In study 2, two raters scored 40 different RCTs using revised guidelines. All RCTs were randomly selected from the OTseeker database. Reliability was calculated using Kappa and intraclass correlation coefficients [ICC (model 2,1)]. Results Inter-rater reliability was 'good to excellent' in the first study (Kappas >= 0.53; ICCs >= 0.71). After revising the rating guidelines, the reliability levels were equivalent or higher to those previously obtained (Kappas >= 0.53; ICCs >= 0.89), except for the item, 'groups similar at baseline', which still had moderate reliability (Kappa = 0.53). In study 2, two PEDro scale items, which had their definitions revised, 'less than 15% dropout' and 'point measures and variability', showed higher reliability. In both studies, the PEDro items with the lowest reliability were 'groups similar at baseline' (Kappas = 0.53), 'less than 15% dropout' (Kappas

Dimensions of quality of life and psychosocial variables most salient to colorectal cancer patients

Colorectal cancer is one of the most common invasive cancers, and is responsible for considerable physical and psychosocial morbidity. Understanding the quality of life experienced by colorectal cancer patients is essential for evaluating the full impact of the disease on individuals, their families and their communities. Patient perspective is essential in establishing a proper understanding of the quality of life of colorectal cancer patients. Despite this, few studies have employed a qualitative methodology to explore quality of life issues for colorectal cancer patients. A review of the literature identified only seven qualitative studies pertaining to quality of life issues for colorectal cancer patients, a surprising finding given the prevalence of this cancer. Accordingly, this study sought to build on the findings of previous qualitative research by providing descriptive data on the quality of life and psychosocial variables most salient to colorectal cancer patients. Six core themes emerged from interview and focus group data: Satisfaction with diagnosis and treatment; support (including information provision); quality of life; benefits of diagnosis; making sense of the cancer experience; and coping strategies. The information derived from this study will help inform the development of supportive care services to address the needs of the increasing number of people diagnosed with colorectal cancer. Copyright (c) 2005 John Wiley & Sons, Ltd.

Assessing the quality of risk factor survey data: lessons from the WHO MONICA Project

Background and purpose Survey data quality is a combination of the representativeness of the sample, the accuracy and precision of measurements, data processing and management with several subcomponents in each. The purpose of this paper is to show how, in the final risk factor surveys of the WHO MONICA Project, information on data quality were obtained, quantified, and used in the analysis. Methods and results In the WHO MONICA (Multinational MONItoring of trends and determinants in CArdiovascular disease) Project, the information about the data quality components was documented in retrospective quality assessment reports. On the basis of the documented information and the survey data, the quality of each data component was assessed and summarized using quality scores. The quality scores were used in sensitivity testing of the results both by excluding populations with low quality scores and by weighting the data by its quality scores. Conclusions Detailed documentation of all survey procedures with standardized protocols, training, and quality control are steps towards optimizing data quality. Quantifying data quality is a further step. Methods used in the WHO MONICA Project could be adopted to improve quality in other health surveys.

The effect of music therapy services on classroom behaviours of newly arrived refugee students in Australia

This pilot study examined the effects of a short-term music therapy program on the classroom behaviours of newly arrived refugee students who were attending an intensive 'English as a Second Language' secondary school. A cross-over design with two five-week intervention periods was employed with group music therapy sessions conducted one or two times per week. Data from the Behaviour Assessment Scale for Children were used to evaluate a range of positive and negative school behaviours. A significant decrease in externalising behaviours was found with particular reference to hyperactivity and aggression. No significant differences were found in other behaviours. Explanations and implications of these findings are discussed.

An innovative use of the web to build graduate team skills

Successful graduates in today's competitive business environments must possess sound interpersonal skills and the ability to work effectively in team situations within, and across, disciplines. However, developing these skills within the higher education curriculum is fraught with organisational and pedagogical difficulties, with many teachers not having the skills, time or resources to facilitate productive group processes. Furthermore, many students find their teamwork experiences frustrating, demanding, conflict-ridden and unproductive. This paper brings together the perspectives and experiences of an engineer and a social scientist in a cross-disciplinary examination of the characteristics of effective teamwork skills and processes. A focus is the development and operation of 'TeamWorker', an innovative online system that helps students and staff manage their team activities and assessment. TeamWorker was created to enhance team teaching and learning processes and outcomes including team creation, administration, development and evaluation. Importantly, TeamWorker can facilitate the early identification of problematic group dynamics, thereby enabling early intervention.